00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2385 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3646 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.056 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.057 The recommended git tool is: git 00:00:00.058 using credential 00000000-0000-0000-0000-000000000002 00:00:00.061 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.086 Fetching changes from the remote Git repository 00:00:00.088 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.120 Using shallow fetch with depth 1 00:00:00.120 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.120 > git --version # timeout=10 00:00:00.159 > git --version # 'git version 2.39.2' 00:00:00.159 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.195 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.195 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:07.342 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:07.355 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:07.368 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:07.368 > git config core.sparsecheckout # timeout=10 00:00:07.382 > git read-tree -mu HEAD # timeout=10 00:00:07.398 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:07.419 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:07.419 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:07.553 [Pipeline] Start of Pipeline 00:00:07.569 [Pipeline] library 00:00:07.571 Loading library shm_lib@master 00:00:07.571 Library shm_lib@master is cached. Copying from home. 00:00:07.591 [Pipeline] node 00:00:07.612 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:07.613 [Pipeline] { 00:00:07.621 [Pipeline] catchError 00:00:07.623 [Pipeline] { 00:00:07.632 [Pipeline] wrap 00:00:07.639 [Pipeline] { 00:00:07.646 [Pipeline] stage 00:00:07.648 [Pipeline] { (Prologue) 00:00:07.921 [Pipeline] sh 00:00:08.208 + logger -p user.info -t JENKINS-CI 00:00:08.226 [Pipeline] echo 00:00:08.227 Node: GP11 00:00:08.235 [Pipeline] sh 00:00:08.540 [Pipeline] setCustomBuildProperty 00:00:08.553 [Pipeline] echo 00:00:08.554 Cleanup processes 00:00:08.560 [Pipeline] sh 00:00:08.845 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.845 2567117 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.860 [Pipeline] sh 00:00:09.147 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.147 ++ grep -v 'sudo pgrep' 00:00:09.147 ++ awk '{print $1}' 00:00:09.147 + sudo kill -9 00:00:09.147 + true 00:00:09.164 [Pipeline] cleanWs 00:00:09.174 [WS-CLEANUP] Deleting project workspace... 00:00:09.174 [WS-CLEANUP] Deferred wipeout is used... 00:00:09.181 [WS-CLEANUP] done 00:00:09.185 [Pipeline] setCustomBuildProperty 00:00:09.201 [Pipeline] sh 00:00:09.486 + sudo git config --global --replace-all safe.directory '*' 00:00:09.602 [Pipeline] httpRequest 00:00:09.975 [Pipeline] echo 00:00:09.977 Sorcerer 10.211.164.20 is alive 00:00:09.987 [Pipeline] retry 00:00:09.989 [Pipeline] { 00:00:10.003 [Pipeline] httpRequest 00:00:10.007 HttpMethod: GET 00:00:10.008 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.008 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.033 Response Code: HTTP/1.1 200 OK 00:00:10.034 Success: Status code 200 is in the accepted range: 200,404 00:00:10.034 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:31.015 [Pipeline] } 00:00:31.031 [Pipeline] // retry 00:00:31.037 [Pipeline] sh 00:00:31.317 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:31.334 [Pipeline] httpRequest 00:00:31.743 [Pipeline] echo 00:00:31.752 Sorcerer 10.211.164.20 is alive 00:00:31.762 [Pipeline] retry 00:00:31.764 [Pipeline] { 00:00:31.781 [Pipeline] httpRequest 00:00:31.786 HttpMethod: GET 00:00:31.786 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:31.787 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:31.804 Response Code: HTTP/1.1 200 OK 00:00:31.805 Success: Status code 200 is in the accepted range: 200,404 00:00:31.805 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:18.987 [Pipeline] } 00:01:19.007 [Pipeline] // retry 00:01:19.015 [Pipeline] sh 00:01:19.302 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:21.849 [Pipeline] sh 00:01:22.137 + git -C spdk log --oneline -n5 00:01:22.137 c13c99a5e test: Various fixes for Fedora40 00:01:22.137 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:22.137 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:22.137 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:22.137 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:22.149 [Pipeline] } 00:01:22.164 [Pipeline] // stage 00:01:22.174 [Pipeline] stage 00:01:22.176 [Pipeline] { (Prepare) 00:01:22.195 [Pipeline] writeFile 00:01:22.210 [Pipeline] sh 00:01:22.497 + logger -p user.info -t JENKINS-CI 00:01:22.510 [Pipeline] sh 00:01:22.798 + logger -p user.info -t JENKINS-CI 00:01:22.812 [Pipeline] sh 00:01:23.099 + cat autorun-spdk.conf 00:01:23.099 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.099 SPDK_TEST_NVMF=1 00:01:23.099 SPDK_TEST_NVME_CLI=1 00:01:23.099 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.099 SPDK_TEST_NVMF_NICS=e810 00:01:23.099 SPDK_RUN_UBSAN=1 00:01:23.099 NET_TYPE=phy 00:01:23.108 RUN_NIGHTLY=1 00:01:23.113 [Pipeline] readFile 00:01:23.145 [Pipeline] withEnv 00:01:23.148 [Pipeline] { 00:01:23.161 [Pipeline] sh 00:01:23.449 + set -ex 00:01:23.449 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:23.449 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:23.449 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.449 ++ SPDK_TEST_NVMF=1 00:01:23.449 ++ SPDK_TEST_NVME_CLI=1 00:01:23.449 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.449 ++ SPDK_TEST_NVMF_NICS=e810 00:01:23.449 ++ SPDK_RUN_UBSAN=1 00:01:23.449 ++ NET_TYPE=phy 00:01:23.449 ++ RUN_NIGHTLY=1 00:01:23.449 + case $SPDK_TEST_NVMF_NICS in 00:01:23.449 + DRIVERS=ice 00:01:23.449 + [[ tcp == \r\d\m\a ]] 00:01:23.449 + [[ -n ice ]] 00:01:23.449 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:23.449 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:23.449 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:23.449 rmmod: ERROR: Module irdma is not currently loaded 00:01:23.449 rmmod: ERROR: Module i40iw is not currently loaded 00:01:23.449 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:23.449 + true 00:01:23.449 + for D in $DRIVERS 00:01:23.449 + sudo modprobe ice 00:01:23.449 + exit 0 00:01:23.460 [Pipeline] } 00:01:23.475 [Pipeline] // withEnv 00:01:23.480 [Pipeline] } 00:01:23.493 [Pipeline] // stage 00:01:23.502 [Pipeline] catchError 00:01:23.503 [Pipeline] { 00:01:23.517 [Pipeline] timeout 00:01:23.517 Timeout set to expire in 1 hr 0 min 00:01:23.519 [Pipeline] { 00:01:23.535 [Pipeline] stage 00:01:23.537 [Pipeline] { (Tests) 00:01:23.551 [Pipeline] sh 00:01:23.840 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.840 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.840 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.840 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:23.840 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:23.840 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.840 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:23.840 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.840 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.840 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.840 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:23.840 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.840 + source /etc/os-release 00:01:23.840 ++ NAME='Fedora Linux' 00:01:23.840 ++ VERSION='39 (Cloud Edition)' 00:01:23.840 ++ ID=fedora 00:01:23.840 ++ VERSION_ID=39 00:01:23.840 ++ VERSION_CODENAME= 00:01:23.840 ++ PLATFORM_ID=platform:f39 00:01:23.840 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:23.840 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:23.840 ++ LOGO=fedora-logo-icon 00:01:23.840 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:23.840 ++ HOME_URL=https://fedoraproject.org/ 00:01:23.840 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:23.840 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:23.840 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:23.840 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:23.840 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:23.840 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:23.840 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:23.840 ++ SUPPORT_END=2024-11-12 00:01:23.840 ++ VARIANT='Cloud Edition' 00:01:23.840 ++ VARIANT_ID=cloud 00:01:23.840 + uname -a 00:01:23.840 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:23.840 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:24.782 Hugepages 00:01:24.782 node hugesize free / total 00:01:24.782 node0 1048576kB 0 / 0 00:01:24.782 node0 2048kB 0 / 0 00:01:24.782 node1 1048576kB 0 / 0 00:01:24.782 node1 2048kB 0 / 0 00:01:24.782 00:01:24.782 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:24.782 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:24.782 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:24.782 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:24.782 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:24.782 + rm -f /tmp/spdk-ld-path 00:01:24.782 + source autorun-spdk.conf 00:01:24.782 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.782 ++ SPDK_TEST_NVMF=1 00:01:24.782 ++ SPDK_TEST_NVME_CLI=1 00:01:24.782 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.782 ++ SPDK_TEST_NVMF_NICS=e810 00:01:24.782 ++ SPDK_RUN_UBSAN=1 00:01:24.782 ++ NET_TYPE=phy 00:01:24.782 ++ RUN_NIGHTLY=1 00:01:24.782 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:24.782 + [[ -n '' ]] 00:01:24.782 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.782 + for M in /var/spdk/build-*-manifest.txt 00:01:24.782 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:24.782 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:24.782 + for M in /var/spdk/build-*-manifest.txt 00:01:24.782 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:24.782 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:24.782 + for M in /var/spdk/build-*-manifest.txt 00:01:24.782 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:24.782 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:24.782 ++ uname 00:01:24.782 + [[ Linux == \L\i\n\u\x ]] 00:01:24.782 + sudo dmesg -T 00:01:24.782 + sudo dmesg --clear 00:01:24.782 + dmesg_pid=2567789 00:01:24.782 + [[ Fedora Linux == FreeBSD ]] 00:01:24.782 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:24.782 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:24.782 + sudo dmesg -Tw 00:01:24.782 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:24.782 + [[ -x /usr/src/fio-static/fio ]] 00:01:24.782 + export FIO_BIN=/usr/src/fio-static/fio 00:01:24.782 + FIO_BIN=/usr/src/fio-static/fio 00:01:24.782 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:24.782 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:24.782 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:24.782 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:24.782 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:24.782 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:24.782 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:24.782 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:24.782 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:24.782 Test configuration: 00:01:24.782 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.782 SPDK_TEST_NVMF=1 00:01:24.782 SPDK_TEST_NVME_CLI=1 00:01:24.782 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.782 SPDK_TEST_NVMF_NICS=e810 00:01:24.782 SPDK_RUN_UBSAN=1 00:01:24.782 NET_TYPE=phy 00:01:24.782 RUN_NIGHTLY=1 15:02:23 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:24.782 15:02:23 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:24.782 15:02:23 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:24.782 15:02:23 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:24.782 15:02:23 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:24.782 15:02:23 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.783 15:02:23 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.783 15:02:23 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.783 15:02:23 -- paths/export.sh@5 -- $ export PATH 00:01:24.783 15:02:23 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.044 15:02:23 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.044 15:02:23 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.044 15:02:23 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732024943.XXXXXX 00:01:25.044 15:02:23 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732024943.gthBN8 00:01:25.044 15:02:23 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.044 15:02:23 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:25.044 15:02:23 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:25.044 15:02:23 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.044 15:02:23 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.044 15:02:23 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.044 15:02:23 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:25.044 15:02:23 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.044 15:02:23 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:25.044 15:02:23 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.044 15:02:23 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.044 15:02:23 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.044 15:02:23 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.044 Tue Nov 19 02:02:23 PM UTC 2024 00:01:25.044 15:02:23 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:25.044 LTS-67-gc13c99a5e 00:01:25.044 15:02:23 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:25.044 15:02:23 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:25.044 15:02:23 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:25.044 15:02:23 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:25.044 15:02:23 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:25.044 15:02:23 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.044 ************************************ 00:01:25.044 START TEST ubsan 00:01:25.044 ************************************ 00:01:25.044 15:02:23 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:25.044 using ubsan 00:01:25.044 00:01:25.044 real 0m0.000s 00:01:25.044 user 0m0.000s 00:01:25.044 sys 0m0.000s 00:01:25.044 15:02:23 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:25.044 15:02:23 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.044 ************************************ 00:01:25.044 END TEST ubsan 00:01:25.044 ************************************ 00:01:25.044 15:02:23 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:25.044 15:02:23 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:25.044 15:02:23 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:25.044 15:02:23 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:25.044 15:02:23 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:25.044 15:02:23 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:25.044 15:02:23 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:25.044 15:02:23 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:25.045 15:02:23 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:25.045 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:25.045 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:25.306 Using 'verbs' RDMA provider 00:01:35.563 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:45.541 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:45.541 Creating mk/config.mk...done. 00:01:45.541 Creating mk/cc.flags.mk...done. 00:01:45.541 Type 'make' to build. 00:01:45.541 15:02:43 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:45.541 15:02:43 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:45.541 15:02:43 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:45.541 15:02:43 -- common/autotest_common.sh@10 -- $ set +x 00:01:45.541 ************************************ 00:01:45.541 START TEST make 00:01:45.541 ************************************ 00:01:45.541 15:02:43 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:45.541 make[1]: Nothing to be done for 'all'. 00:01:55.560 The Meson build system 00:01:55.560 Version: 1.5.0 00:01:55.560 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:55.560 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:55.560 Build type: native build 00:01:55.560 Program cat found: YES (/usr/bin/cat) 00:01:55.560 Project name: DPDK 00:01:55.560 Project version: 23.11.0 00:01:55.560 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:55.560 C linker for the host machine: cc ld.bfd 2.40-14 00:01:55.560 Host machine cpu family: x86_64 00:01:55.560 Host machine cpu: x86_64 00:01:55.560 Message: ## Building in Developer Mode ## 00:01:55.560 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:55.560 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:55.560 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:55.560 Program python3 found: YES (/usr/bin/python3) 00:01:55.560 Program cat found: YES (/usr/bin/cat) 00:01:55.560 Compiler for C supports arguments -march=native: YES 00:01:55.560 Checking for size of "void *" : 8 00:01:55.560 Checking for size of "void *" : 8 (cached) 00:01:55.560 Library m found: YES 00:01:55.560 Library numa found: YES 00:01:55.560 Has header "numaif.h" : YES 00:01:55.560 Library fdt found: NO 00:01:55.560 Library execinfo found: NO 00:01:55.560 Has header "execinfo.h" : YES 00:01:55.560 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:55.560 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:55.560 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:55.560 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:55.560 Run-time dependency openssl found: YES 3.1.1 00:01:55.560 Run-time dependency libpcap found: YES 1.10.4 00:01:55.560 Has header "pcap.h" with dependency libpcap: YES 00:01:55.560 Compiler for C supports arguments -Wcast-qual: YES 00:01:55.560 Compiler for C supports arguments -Wdeprecated: YES 00:01:55.560 Compiler for C supports arguments -Wformat: YES 00:01:55.560 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:55.560 Compiler for C supports arguments -Wformat-security: NO 00:01:55.560 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:55.560 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:55.560 Compiler for C supports arguments -Wnested-externs: YES 00:01:55.560 Compiler for C supports arguments -Wold-style-definition: YES 00:01:55.560 Compiler for C supports arguments -Wpointer-arith: YES 00:01:55.560 Compiler for C supports arguments -Wsign-compare: YES 00:01:55.560 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:55.560 Compiler for C supports arguments -Wundef: YES 00:01:55.560 Compiler for C supports arguments -Wwrite-strings: YES 00:01:55.560 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:55.560 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:55.560 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:55.560 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:55.560 Program objdump found: YES (/usr/bin/objdump) 00:01:55.560 Compiler for C supports arguments -mavx512f: YES 00:01:55.560 Checking if "AVX512 checking" compiles: YES 00:01:55.560 Fetching value of define "__SSE4_2__" : 1 00:01:55.560 Fetching value of define "__AES__" : 1 00:01:55.560 Fetching value of define "__AVX__" : 1 00:01:55.560 Fetching value of define "__AVX2__" : (undefined) 00:01:55.560 Fetching value of define "__AVX512BW__" : (undefined) 00:01:55.560 Fetching value of define "__AVX512CD__" : (undefined) 00:01:55.560 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:55.560 Fetching value of define "__AVX512F__" : (undefined) 00:01:55.560 Fetching value of define "__AVX512VL__" : (undefined) 00:01:55.561 Fetching value of define "__PCLMUL__" : 1 00:01:55.561 Fetching value of define "__RDRND__" : 1 00:01:55.561 Fetching value of define "__RDSEED__" : (undefined) 00:01:55.561 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:55.561 Fetching value of define "__znver1__" : (undefined) 00:01:55.561 Fetching value of define "__znver2__" : (undefined) 00:01:55.561 Fetching value of define "__znver3__" : (undefined) 00:01:55.561 Fetching value of define "__znver4__" : (undefined) 00:01:55.561 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:55.561 Message: lib/log: Defining dependency "log" 00:01:55.561 Message: lib/kvargs: Defining dependency "kvargs" 00:01:55.561 Message: lib/telemetry: Defining dependency "telemetry" 00:01:55.561 Checking for function "getentropy" : NO 00:01:55.561 Message: lib/eal: Defining dependency "eal" 00:01:55.561 Message: lib/ring: Defining dependency "ring" 00:01:55.561 Message: lib/rcu: Defining dependency "rcu" 00:01:55.561 Message: lib/mempool: Defining dependency "mempool" 00:01:55.561 Message: lib/mbuf: Defining dependency "mbuf" 00:01:55.561 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:55.561 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:55.561 Compiler for C supports arguments -mpclmul: YES 00:01:55.561 Compiler for C supports arguments -maes: YES 00:01:55.561 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:55.561 Compiler for C supports arguments -mavx512bw: YES 00:01:55.561 Compiler for C supports arguments -mavx512dq: YES 00:01:55.561 Compiler for C supports arguments -mavx512vl: YES 00:01:55.561 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:55.561 Compiler for C supports arguments -mavx2: YES 00:01:55.561 Compiler for C supports arguments -mavx: YES 00:01:55.561 Message: lib/net: Defining dependency "net" 00:01:55.561 Message: lib/meter: Defining dependency "meter" 00:01:55.561 Message: lib/ethdev: Defining dependency "ethdev" 00:01:55.561 Message: lib/pci: Defining dependency "pci" 00:01:55.561 Message: lib/cmdline: Defining dependency "cmdline" 00:01:55.561 Message: lib/hash: Defining dependency "hash" 00:01:55.561 Message: lib/timer: Defining dependency "timer" 00:01:55.561 Message: lib/compressdev: Defining dependency "compressdev" 00:01:55.561 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:55.561 Message: lib/dmadev: Defining dependency "dmadev" 00:01:55.561 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:55.561 Message: lib/power: Defining dependency "power" 00:01:55.561 Message: lib/reorder: Defining dependency "reorder" 00:01:55.561 Message: lib/security: Defining dependency "security" 00:01:55.561 Has header "linux/userfaultfd.h" : YES 00:01:55.561 Has header "linux/vduse.h" : YES 00:01:55.561 Message: lib/vhost: Defining dependency "vhost" 00:01:55.561 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:55.561 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:55.561 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:55.561 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:55.561 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:55.561 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:55.561 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:55.561 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:55.561 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:55.561 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:55.561 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:55.561 Configuring doxy-api-html.conf using configuration 00:01:55.561 Configuring doxy-api-man.conf using configuration 00:01:55.561 Program mandb found: YES (/usr/bin/mandb) 00:01:55.561 Program sphinx-build found: NO 00:01:55.561 Configuring rte_build_config.h using configuration 00:01:55.561 Message: 00:01:55.561 ================= 00:01:55.561 Applications Enabled 00:01:55.561 ================= 00:01:55.561 00:01:55.561 apps: 00:01:55.561 00:01:55.561 00:01:55.561 Message: 00:01:55.561 ================= 00:01:55.561 Libraries Enabled 00:01:55.561 ================= 00:01:55.561 00:01:55.561 libs: 00:01:55.561 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:55.561 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:55.561 cryptodev, dmadev, power, reorder, security, vhost, 00:01:55.561 00:01:55.561 Message: 00:01:55.561 =============== 00:01:55.561 Drivers Enabled 00:01:55.561 =============== 00:01:55.561 00:01:55.561 common: 00:01:55.561 00:01:55.561 bus: 00:01:55.561 pci, vdev, 00:01:55.561 mempool: 00:01:55.561 ring, 00:01:55.561 dma: 00:01:55.561 00:01:55.561 net: 00:01:55.561 00:01:55.561 crypto: 00:01:55.561 00:01:55.561 compress: 00:01:55.561 00:01:55.561 vdpa: 00:01:55.561 00:01:55.561 00:01:55.561 Message: 00:01:55.561 ================= 00:01:55.561 Content Skipped 00:01:55.561 ================= 00:01:55.561 00:01:55.561 apps: 00:01:55.561 dumpcap: explicitly disabled via build config 00:01:55.561 graph: explicitly disabled via build config 00:01:55.561 pdump: explicitly disabled via build config 00:01:55.561 proc-info: explicitly disabled via build config 00:01:55.561 test-acl: explicitly disabled via build config 00:01:55.561 test-bbdev: explicitly disabled via build config 00:01:55.561 test-cmdline: explicitly disabled via build config 00:01:55.561 test-compress-perf: explicitly disabled via build config 00:01:55.561 test-crypto-perf: explicitly disabled via build config 00:01:55.561 test-dma-perf: explicitly disabled via build config 00:01:55.561 test-eventdev: explicitly disabled via build config 00:01:55.561 test-fib: explicitly disabled via build config 00:01:55.561 test-flow-perf: explicitly disabled via build config 00:01:55.561 test-gpudev: explicitly disabled via build config 00:01:55.561 test-mldev: explicitly disabled via build config 00:01:55.561 test-pipeline: explicitly disabled via build config 00:01:55.561 test-pmd: explicitly disabled via build config 00:01:55.561 test-regex: explicitly disabled via build config 00:01:55.561 test-sad: explicitly disabled via build config 00:01:55.561 test-security-perf: explicitly disabled via build config 00:01:55.561 00:01:55.561 libs: 00:01:55.561 metrics: explicitly disabled via build config 00:01:55.561 acl: explicitly disabled via build config 00:01:55.561 bbdev: explicitly disabled via build config 00:01:55.561 bitratestats: explicitly disabled via build config 00:01:55.561 bpf: explicitly disabled via build config 00:01:55.561 cfgfile: explicitly disabled via build config 00:01:55.561 distributor: explicitly disabled via build config 00:01:55.561 efd: explicitly disabled via build config 00:01:55.561 eventdev: explicitly disabled via build config 00:01:55.561 dispatcher: explicitly disabled via build config 00:01:55.561 gpudev: explicitly disabled via build config 00:01:55.561 gro: explicitly disabled via build config 00:01:55.561 gso: explicitly disabled via build config 00:01:55.561 ip_frag: explicitly disabled via build config 00:01:55.561 jobstats: explicitly disabled via build config 00:01:55.561 latencystats: explicitly disabled via build config 00:01:55.561 lpm: explicitly disabled via build config 00:01:55.561 member: explicitly disabled via build config 00:01:55.561 pcapng: explicitly disabled via build config 00:01:55.561 rawdev: explicitly disabled via build config 00:01:55.561 regexdev: explicitly disabled via build config 00:01:55.561 mldev: explicitly disabled via build config 00:01:55.561 rib: explicitly disabled via build config 00:01:55.561 sched: explicitly disabled via build config 00:01:55.561 stack: explicitly disabled via build config 00:01:55.561 ipsec: explicitly disabled via build config 00:01:55.561 pdcp: explicitly disabled via build config 00:01:55.561 fib: explicitly disabled via build config 00:01:55.561 port: explicitly disabled via build config 00:01:55.561 pdump: explicitly disabled via build config 00:01:55.561 table: explicitly disabled via build config 00:01:55.561 pipeline: explicitly disabled via build config 00:01:55.561 graph: explicitly disabled via build config 00:01:55.561 node: explicitly disabled via build config 00:01:55.561 00:01:55.561 drivers: 00:01:55.561 common/cpt: not in enabled drivers build config 00:01:55.561 common/dpaax: not in enabled drivers build config 00:01:55.561 common/iavf: not in enabled drivers build config 00:01:55.561 common/idpf: not in enabled drivers build config 00:01:55.561 common/mvep: not in enabled drivers build config 00:01:55.561 common/octeontx: not in enabled drivers build config 00:01:55.561 bus/auxiliary: not in enabled drivers build config 00:01:55.561 bus/cdx: not in enabled drivers build config 00:01:55.561 bus/dpaa: not in enabled drivers build config 00:01:55.561 bus/fslmc: not in enabled drivers build config 00:01:55.561 bus/ifpga: not in enabled drivers build config 00:01:55.561 bus/platform: not in enabled drivers build config 00:01:55.561 bus/vmbus: not in enabled drivers build config 00:01:55.561 common/cnxk: not in enabled drivers build config 00:01:55.561 common/mlx5: not in enabled drivers build config 00:01:55.561 common/nfp: not in enabled drivers build config 00:01:55.561 common/qat: not in enabled drivers build config 00:01:55.561 common/sfc_efx: not in enabled drivers build config 00:01:55.561 mempool/bucket: not in enabled drivers build config 00:01:55.561 mempool/cnxk: not in enabled drivers build config 00:01:55.561 mempool/dpaa: not in enabled drivers build config 00:01:55.561 mempool/dpaa2: not in enabled drivers build config 00:01:55.561 mempool/octeontx: not in enabled drivers build config 00:01:55.561 mempool/stack: not in enabled drivers build config 00:01:55.561 dma/cnxk: not in enabled drivers build config 00:01:55.561 dma/dpaa: not in enabled drivers build config 00:01:55.561 dma/dpaa2: not in enabled drivers build config 00:01:55.561 dma/hisilicon: not in enabled drivers build config 00:01:55.561 dma/idxd: not in enabled drivers build config 00:01:55.561 dma/ioat: not in enabled drivers build config 00:01:55.561 dma/skeleton: not in enabled drivers build config 00:01:55.561 net/af_packet: not in enabled drivers build config 00:01:55.561 net/af_xdp: not in enabled drivers build config 00:01:55.561 net/ark: not in enabled drivers build config 00:01:55.562 net/atlantic: not in enabled drivers build config 00:01:55.562 net/avp: not in enabled drivers build config 00:01:55.562 net/axgbe: not in enabled drivers build config 00:01:55.562 net/bnx2x: not in enabled drivers build config 00:01:55.562 net/bnxt: not in enabled drivers build config 00:01:55.562 net/bonding: not in enabled drivers build config 00:01:55.562 net/cnxk: not in enabled drivers build config 00:01:55.562 net/cpfl: not in enabled drivers build config 00:01:55.562 net/cxgbe: not in enabled drivers build config 00:01:55.562 net/dpaa: not in enabled drivers build config 00:01:55.562 net/dpaa2: not in enabled drivers build config 00:01:55.562 net/e1000: not in enabled drivers build config 00:01:55.562 net/ena: not in enabled drivers build config 00:01:55.562 net/enetc: not in enabled drivers build config 00:01:55.562 net/enetfec: not in enabled drivers build config 00:01:55.562 net/enic: not in enabled drivers build config 00:01:55.562 net/failsafe: not in enabled drivers build config 00:01:55.562 net/fm10k: not in enabled drivers build config 00:01:55.562 net/gve: not in enabled drivers build config 00:01:55.562 net/hinic: not in enabled drivers build config 00:01:55.562 net/hns3: not in enabled drivers build config 00:01:55.562 net/i40e: not in enabled drivers build config 00:01:55.562 net/iavf: not in enabled drivers build config 00:01:55.562 net/ice: not in enabled drivers build config 00:01:55.562 net/idpf: not in enabled drivers build config 00:01:55.562 net/igc: not in enabled drivers build config 00:01:55.562 net/ionic: not in enabled drivers build config 00:01:55.562 net/ipn3ke: not in enabled drivers build config 00:01:55.562 net/ixgbe: not in enabled drivers build config 00:01:55.562 net/mana: not in enabled drivers build config 00:01:55.562 net/memif: not in enabled drivers build config 00:01:55.562 net/mlx4: not in enabled drivers build config 00:01:55.562 net/mlx5: not in enabled drivers build config 00:01:55.562 net/mvneta: not in enabled drivers build config 00:01:55.562 net/mvpp2: not in enabled drivers build config 00:01:55.562 net/netvsc: not in enabled drivers build config 00:01:55.562 net/nfb: not in enabled drivers build config 00:01:55.562 net/nfp: not in enabled drivers build config 00:01:55.562 net/ngbe: not in enabled drivers build config 00:01:55.562 net/null: not in enabled drivers build config 00:01:55.562 net/octeontx: not in enabled drivers build config 00:01:55.562 net/octeon_ep: not in enabled drivers build config 00:01:55.562 net/pcap: not in enabled drivers build config 00:01:55.562 net/pfe: not in enabled drivers build config 00:01:55.562 net/qede: not in enabled drivers build config 00:01:55.562 net/ring: not in enabled drivers build config 00:01:55.562 net/sfc: not in enabled drivers build config 00:01:55.562 net/softnic: not in enabled drivers build config 00:01:55.562 net/tap: not in enabled drivers build config 00:01:55.562 net/thunderx: not in enabled drivers build config 00:01:55.562 net/txgbe: not in enabled drivers build config 00:01:55.562 net/vdev_netvsc: not in enabled drivers build config 00:01:55.562 net/vhost: not in enabled drivers build config 00:01:55.562 net/virtio: not in enabled drivers build config 00:01:55.562 net/vmxnet3: not in enabled drivers build config 00:01:55.562 raw/*: missing internal dependency, "rawdev" 00:01:55.562 crypto/armv8: not in enabled drivers build config 00:01:55.562 crypto/bcmfs: not in enabled drivers build config 00:01:55.562 crypto/caam_jr: not in enabled drivers build config 00:01:55.562 crypto/ccp: not in enabled drivers build config 00:01:55.562 crypto/cnxk: not in enabled drivers build config 00:01:55.562 crypto/dpaa_sec: not in enabled drivers build config 00:01:55.562 crypto/dpaa2_sec: not in enabled drivers build config 00:01:55.562 crypto/ipsec_mb: not in enabled drivers build config 00:01:55.562 crypto/mlx5: not in enabled drivers build config 00:01:55.562 crypto/mvsam: not in enabled drivers build config 00:01:55.562 crypto/nitrox: not in enabled drivers build config 00:01:55.562 crypto/null: not in enabled drivers build config 00:01:55.562 crypto/octeontx: not in enabled drivers build config 00:01:55.562 crypto/openssl: not in enabled drivers build config 00:01:55.562 crypto/scheduler: not in enabled drivers build config 00:01:55.562 crypto/uadk: not in enabled drivers build config 00:01:55.562 crypto/virtio: not in enabled drivers build config 00:01:55.562 compress/isal: not in enabled drivers build config 00:01:55.562 compress/mlx5: not in enabled drivers build config 00:01:55.562 compress/octeontx: not in enabled drivers build config 00:01:55.562 compress/zlib: not in enabled drivers build config 00:01:55.562 regex/*: missing internal dependency, "regexdev" 00:01:55.562 ml/*: missing internal dependency, "mldev" 00:01:55.562 vdpa/ifc: not in enabled drivers build config 00:01:55.562 vdpa/mlx5: not in enabled drivers build config 00:01:55.562 vdpa/nfp: not in enabled drivers build config 00:01:55.562 vdpa/sfc: not in enabled drivers build config 00:01:55.562 event/*: missing internal dependency, "eventdev" 00:01:55.562 baseband/*: missing internal dependency, "bbdev" 00:01:55.562 gpu/*: missing internal dependency, "gpudev" 00:01:55.562 00:01:55.562 00:01:55.562 Build targets in project: 85 00:01:55.562 00:01:55.562 DPDK 23.11.0 00:01:55.562 00:01:55.562 User defined options 00:01:55.562 buildtype : debug 00:01:55.562 default_library : shared 00:01:55.562 libdir : lib 00:01:55.562 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:55.562 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:55.562 c_link_args : 00:01:55.562 cpu_instruction_set: native 00:01:55.562 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:55.562 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:55.562 enable_docs : false 00:01:55.562 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:55.562 enable_kmods : false 00:01:55.562 tests : false 00:01:55.562 00:01:55.562 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:55.562 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:55.562 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:55.562 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:55.562 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:55.562 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:55.562 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:55.562 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:55.562 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:55.562 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:55.562 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:55.562 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:55.562 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:55.562 [12/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:55.562 [13/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:55.562 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:55.562 [15/265] Linking static target lib/librte_kvargs.a 00:01:55.562 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:55.562 [17/265] Linking static target lib/librte_log.a 00:01:55.562 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:55.562 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:55.562 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:55.562 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:55.825 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.825 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:55.825 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:55.825 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:55.825 [26/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:56.084 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:56.084 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:56.084 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:56.084 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:56.084 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:56.084 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:56.085 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:56.085 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:56.085 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:56.085 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:56.085 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:56.085 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:56.085 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:56.085 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:56.085 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:56.085 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:56.085 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:56.085 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:56.085 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:56.085 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:56.085 [47/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:56.085 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:56.085 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:56.085 [50/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:56.085 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:56.085 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:56.085 [53/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:56.085 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:56.085 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:56.085 [56/265] Linking static target lib/librte_telemetry.a 00:01:56.085 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:56.085 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:56.085 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:56.085 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:56.085 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:56.085 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:56.085 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:56.347 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:56.347 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:56.347 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:56.347 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:56.347 [68/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:56.347 [69/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:56.347 [70/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.347 [71/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:56.347 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:56.347 [73/265] Linking static target lib/librte_pci.a 00:01:56.347 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:56.347 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:56.610 [76/265] Linking target lib/librte_log.so.24.0 00:01:56.610 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:56.610 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:56.610 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:56.610 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:56.610 [81/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:56.610 [82/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:56.610 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:56.610 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:56.610 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:56.610 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:56.872 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:56.872 [88/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:56.872 [89/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:56.872 [90/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:56.872 [91/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:56.872 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.872 [93/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:56.872 [94/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:56.872 [95/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:56.872 [96/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:56.872 [97/265] Linking static target lib/librte_ring.a 00:01:56.872 [98/265] Linking target lib/librte_kvargs.so.24.0 00:01:56.872 [99/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:56.872 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:56.872 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:57.140 [102/265] Linking static target lib/librte_meter.a 00:01:57.141 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:57.141 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:57.141 [105/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:57.141 [106/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.141 [107/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:57.141 [108/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:57.141 [109/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:57.141 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:57.141 [111/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:57.141 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:57.141 [113/265] Linking target lib/librte_telemetry.so.24.0 00:01:57.141 [114/265] Linking static target lib/librte_rcu.a 00:01:57.141 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:57.141 [116/265] Linking static target lib/librte_eal.a 00:01:57.141 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:57.141 [118/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:57.141 [119/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:57.141 [120/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:57.141 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:57.141 [122/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:57.141 [123/265] Linking static target lib/librte_mempool.a 00:01:57.141 [124/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:57.141 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:57.404 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:57.404 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:57.404 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:57.404 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:57.404 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:57.404 [131/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:57.404 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:57.404 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:57.404 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:57.404 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:57.404 [136/265] Linking static target lib/librte_cmdline.a 00:01:57.666 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.666 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:57.666 [139/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.666 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:57.666 [141/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:57.666 [142/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:57.666 [143/265] Linking static target lib/librte_net.a 00:01:57.666 [144/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:57.666 [145/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:57.666 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:57.666 [147/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.927 [148/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:57.927 [149/265] Linking static target lib/librte_timer.a 00:01:57.927 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:57.927 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:57.927 [152/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:57.927 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:58.186 [154/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.186 [155/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:58.186 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:58.186 [157/265] Linking static target lib/librte_dmadev.a 00:01:58.186 [158/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:58.186 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:58.186 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:58.186 [161/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:58.186 [162/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:58.186 [163/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.186 [164/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:58.186 [165/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:58.186 [166/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:58.186 [167/265] Linking static target lib/librte_compressdev.a 00:01:58.186 [168/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:58.186 [169/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.186 [170/265] Linking static target lib/librte_hash.a 00:01:58.446 [171/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:58.446 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:58.446 [173/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:58.446 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:58.446 [175/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:58.446 [176/265] Linking static target lib/librte_power.a 00:01:58.446 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:58.446 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:58.446 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:58.446 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:58.446 [181/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:58.446 [182/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:58.446 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:58.446 [184/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.446 [185/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.446 [186/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:58.446 [187/265] Linking static target lib/librte_reorder.a 00:01:58.446 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:58.706 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:58.706 [190/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:58.706 [191/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:58.706 [192/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:58.706 [193/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:58.706 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:58.706 [195/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:58.706 [196/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.706 [197/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.706 [198/265] Linking static target drivers/librte_bus_vdev.a 00:01:58.706 [199/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.706 [200/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:58.706 [201/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:58.706 [202/265] Linking static target lib/librte_security.a 00:01:58.706 [203/265] Linking static target lib/librte_mbuf.a 00:01:58.706 [204/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.706 [205/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.965 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:58.965 [207/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:58.965 [208/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:58.965 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:58.965 [210/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:58.965 [211/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.965 [212/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.965 [213/265] Linking static target drivers/librte_bus_pci.a 00:01:58.965 [214/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.965 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.965 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:58.965 [217/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:58.965 [218/265] Linking static target lib/librte_ethdev.a 00:01:59.224 [219/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.224 [220/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.224 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:59.224 [222/265] Linking static target lib/librte_cryptodev.a 00:01:59.224 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.601 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.537 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:03.497 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.497 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.497 [228/265] Linking target lib/librte_eal.so.24.0 00:02:03.497 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:03.497 [230/265] Linking target lib/librte_ring.so.24.0 00:02:03.497 [231/265] Linking target lib/librte_timer.so.24.0 00:02:03.497 [232/265] Linking target lib/librte_dmadev.so.24.0 00:02:03.497 [233/265] Linking target lib/librte_meter.so.24.0 00:02:03.498 [234/265] Linking target lib/librte_pci.so.24.0 00:02:03.498 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:03.756 [236/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:03.756 [237/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:03.756 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:03.756 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:03.756 [240/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:03.756 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:03.756 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:03.756 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:03.756 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:03.756 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:04.015 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:04.015 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:04.015 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:04.015 [249/265] Linking target lib/librte_compressdev.so.24.0 00:02:04.015 [250/265] Linking target lib/librte_net.so.24.0 00:02:04.015 [251/265] Linking target lib/librte_reorder.so.24.0 00:02:04.015 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:04.273 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:04.273 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:04.273 [255/265] Linking target lib/librte_hash.so.24.0 00:02:04.273 [256/265] Linking target lib/librte_security.so.24.0 00:02:04.273 [257/265] Linking target lib/librte_cmdline.so.24.0 00:02:04.273 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:04.273 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:04.273 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:04.532 [261/265] Linking target lib/librte_power.so.24.0 00:02:07.064 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:07.064 [263/265] Linking static target lib/librte_vhost.a 00:02:08.439 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.439 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:08.439 INFO: autodetecting backend as ninja 00:02:08.439 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:09.374 CC lib/ut_mock/mock.o 00:02:09.374 CC lib/log/log.o 00:02:09.374 CC lib/log/log_flags.o 00:02:09.374 CC lib/log/log_deprecated.o 00:02:09.374 CC lib/ut/ut.o 00:02:09.374 LIB libspdk_ut_mock.a 00:02:09.374 SO libspdk_ut_mock.so.5.0 00:02:09.374 LIB libspdk_log.a 00:02:09.374 LIB libspdk_ut.a 00:02:09.374 SO libspdk_ut.so.1.0 00:02:09.374 SO libspdk_log.so.6.1 00:02:09.374 SYMLINK libspdk_ut_mock.so 00:02:09.374 SYMLINK libspdk_ut.so 00:02:09.374 SYMLINK libspdk_log.so 00:02:09.632 CC lib/dma/dma.o 00:02:09.632 CC lib/util/base64.o 00:02:09.632 CC lib/ioat/ioat.o 00:02:09.632 CXX lib/trace_parser/trace.o 00:02:09.632 CC lib/util/bit_array.o 00:02:09.632 CC lib/util/cpuset.o 00:02:09.632 CC lib/util/crc16.o 00:02:09.632 CC lib/util/crc32.o 00:02:09.632 CC lib/util/crc32c.o 00:02:09.632 CC lib/util/crc32_ieee.o 00:02:09.632 CC lib/util/crc64.o 00:02:09.632 CC lib/util/dif.o 00:02:09.632 CC lib/util/fd.o 00:02:09.632 CC lib/util/file.o 00:02:09.632 CC lib/util/hexlify.o 00:02:09.632 CC lib/util/iov.o 00:02:09.632 CC lib/util/math.o 00:02:09.632 CC lib/util/pipe.o 00:02:09.632 CC lib/util/strerror_tls.o 00:02:09.632 CC lib/util/string.o 00:02:09.632 CC lib/util/uuid.o 00:02:09.632 CC lib/util/fd_group.o 00:02:09.632 CC lib/util/xor.o 00:02:09.632 CC lib/util/zipf.o 00:02:09.632 CC lib/vfio_user/host/vfio_user_pci.o 00:02:09.632 CC lib/vfio_user/host/vfio_user.o 00:02:09.891 LIB libspdk_dma.a 00:02:09.891 SO libspdk_dma.so.3.0 00:02:09.891 SYMLINK libspdk_dma.so 00:02:09.891 LIB libspdk_ioat.a 00:02:09.891 SO libspdk_ioat.so.6.0 00:02:09.891 LIB libspdk_vfio_user.a 00:02:09.891 SO libspdk_vfio_user.so.4.0 00:02:09.891 SYMLINK libspdk_ioat.so 00:02:09.891 SYMLINK libspdk_vfio_user.so 00:02:10.150 LIB libspdk_util.a 00:02:10.150 SO libspdk_util.so.8.0 00:02:10.409 SYMLINK libspdk_util.so 00:02:10.409 CC lib/vmd/vmd.o 00:02:10.409 CC lib/rdma/common.o 00:02:10.409 CC lib/conf/conf.o 00:02:10.409 CC lib/vmd/led.o 00:02:10.409 CC lib/idxd/idxd.o 00:02:10.409 CC lib/rdma/rdma_verbs.o 00:02:10.409 CC lib/idxd/idxd_user.o 00:02:10.409 CC lib/idxd/idxd_kernel.o 00:02:10.409 CC lib/env_dpdk/env.o 00:02:10.409 CC lib/json/json_parse.o 00:02:10.409 CC lib/env_dpdk/memory.o 00:02:10.409 CC lib/json/json_util.o 00:02:10.409 CC lib/env_dpdk/pci.o 00:02:10.409 CC lib/json/json_write.o 00:02:10.409 CC lib/env_dpdk/init.o 00:02:10.409 CC lib/env_dpdk/threads.o 00:02:10.409 CC lib/env_dpdk/pci_ioat.o 00:02:10.409 CC lib/env_dpdk/pci_virtio.o 00:02:10.409 CC lib/env_dpdk/pci_vmd.o 00:02:10.409 CC lib/env_dpdk/pci_idxd.o 00:02:10.409 CC lib/env_dpdk/pci_event.o 00:02:10.409 CC lib/env_dpdk/sigbus_handler.o 00:02:10.409 CC lib/env_dpdk/pci_dpdk.o 00:02:10.409 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:10.409 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:10.667 LIB libspdk_trace_parser.a 00:02:10.667 SO libspdk_trace_parser.so.4.0 00:02:10.667 LIB libspdk_conf.a 00:02:10.667 SO libspdk_conf.so.5.0 00:02:10.667 SYMLINK libspdk_trace_parser.so 00:02:10.667 SYMLINK libspdk_conf.so 00:02:10.667 LIB libspdk_json.a 00:02:10.667 SO libspdk_json.so.5.1 00:02:10.925 LIB libspdk_rdma.a 00:02:10.925 SYMLINK libspdk_json.so 00:02:10.925 SO libspdk_rdma.so.5.0 00:02:10.925 SYMLINK libspdk_rdma.so 00:02:10.925 CC lib/jsonrpc/jsonrpc_server.o 00:02:10.925 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:10.925 CC lib/jsonrpc/jsonrpc_client.o 00:02:10.925 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:10.925 LIB libspdk_idxd.a 00:02:10.925 SO libspdk_idxd.so.11.0 00:02:10.925 SYMLINK libspdk_idxd.so 00:02:11.184 LIB libspdk_vmd.a 00:02:11.184 SO libspdk_vmd.so.5.0 00:02:11.184 SYMLINK libspdk_vmd.so 00:02:11.184 LIB libspdk_jsonrpc.a 00:02:11.184 SO libspdk_jsonrpc.so.5.1 00:02:11.184 SYMLINK libspdk_jsonrpc.so 00:02:11.441 CC lib/rpc/rpc.o 00:02:11.699 LIB libspdk_rpc.a 00:02:11.699 SO libspdk_rpc.so.5.0 00:02:11.699 SYMLINK libspdk_rpc.so 00:02:11.699 CC lib/sock/sock.o 00:02:11.699 CC lib/trace/trace.o 00:02:11.699 CC lib/sock/sock_rpc.o 00:02:11.699 CC lib/trace/trace_flags.o 00:02:11.699 CC lib/trace/trace_rpc.o 00:02:11.699 CC lib/notify/notify.o 00:02:11.699 CC lib/notify/notify_rpc.o 00:02:11.957 LIB libspdk_notify.a 00:02:11.957 SO libspdk_notify.so.5.0 00:02:11.957 SYMLINK libspdk_notify.so 00:02:11.957 LIB libspdk_trace.a 00:02:11.957 SO libspdk_trace.so.9.0 00:02:11.957 SYMLINK libspdk_trace.so 00:02:12.216 LIB libspdk_sock.a 00:02:12.216 SO libspdk_sock.so.8.0 00:02:12.216 CC lib/thread/thread.o 00:02:12.216 CC lib/thread/iobuf.o 00:02:12.216 SYMLINK libspdk_sock.so 00:02:12.474 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:12.474 CC lib/nvme/nvme_ctrlr.o 00:02:12.474 CC lib/nvme/nvme_fabric.o 00:02:12.474 CC lib/nvme/nvme_ns_cmd.o 00:02:12.474 CC lib/nvme/nvme_ns.o 00:02:12.474 CC lib/nvme/nvme_pcie_common.o 00:02:12.474 CC lib/nvme/nvme_pcie.o 00:02:12.474 CC lib/nvme/nvme_qpair.o 00:02:12.474 CC lib/nvme/nvme.o 00:02:12.474 CC lib/nvme/nvme_quirks.o 00:02:12.474 CC lib/nvme/nvme_transport.o 00:02:12.474 CC lib/nvme/nvme_discovery.o 00:02:12.474 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:12.474 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:12.474 CC lib/nvme/nvme_tcp.o 00:02:12.474 CC lib/nvme/nvme_opal.o 00:02:12.474 CC lib/nvme/nvme_io_msg.o 00:02:12.474 CC lib/nvme/nvme_poll_group.o 00:02:12.475 CC lib/nvme/nvme_zns.o 00:02:12.475 CC lib/nvme/nvme_cuse.o 00:02:12.475 CC lib/nvme/nvme_vfio_user.o 00:02:12.475 CC lib/nvme/nvme_rdma.o 00:02:12.475 LIB libspdk_env_dpdk.a 00:02:12.733 SO libspdk_env_dpdk.so.13.0 00:02:12.733 SYMLINK libspdk_env_dpdk.so 00:02:13.667 LIB libspdk_thread.a 00:02:13.926 SO libspdk_thread.so.9.0 00:02:13.926 SYMLINK libspdk_thread.so 00:02:13.926 CC lib/init/json_config.o 00:02:13.926 CC lib/blob/blobstore.o 00:02:13.926 CC lib/init/subsystem.o 00:02:13.926 CC lib/virtio/virtio.o 00:02:13.926 CC lib/init/subsystem_rpc.o 00:02:13.926 CC lib/virtio/virtio_vhost_user.o 00:02:13.926 CC lib/accel/accel.o 00:02:13.926 CC lib/init/rpc.o 00:02:13.926 CC lib/blob/request.o 00:02:13.926 CC lib/virtio/virtio_vfio_user.o 00:02:13.926 CC lib/blob/blob_bs_dev.o 00:02:13.926 CC lib/virtio/virtio_pci.o 00:02:13.926 CC lib/accel/accel_sw.o 00:02:13.926 CC lib/blob/zeroes.o 00:02:13.926 CC lib/accel/accel_rpc.o 00:02:14.184 LIB libspdk_init.a 00:02:14.184 SO libspdk_init.so.4.0 00:02:14.184 SYMLINK libspdk_init.so 00:02:14.443 LIB libspdk_virtio.a 00:02:14.443 SO libspdk_virtio.so.6.0 00:02:14.443 SYMLINK libspdk_virtio.so 00:02:14.443 CC lib/event/app.o 00:02:14.443 CC lib/event/reactor.o 00:02:14.443 CC lib/event/log_rpc.o 00:02:14.443 CC lib/event/app_rpc.o 00:02:14.443 CC lib/event/scheduler_static.o 00:02:14.701 LIB libspdk_nvme.a 00:02:14.702 SO libspdk_nvme.so.12.0 00:02:14.960 LIB libspdk_event.a 00:02:14.960 SO libspdk_event.so.12.0 00:02:14.960 SYMLINK libspdk_event.so 00:02:14.960 SYMLINK libspdk_nvme.so 00:02:14.960 LIB libspdk_accel.a 00:02:15.218 SO libspdk_accel.so.14.0 00:02:15.218 SYMLINK libspdk_accel.so 00:02:15.218 CC lib/bdev/bdev.o 00:02:15.218 CC lib/bdev/bdev_rpc.o 00:02:15.218 CC lib/bdev/bdev_zone.o 00:02:15.218 CC lib/bdev/part.o 00:02:15.218 CC lib/bdev/scsi_nvme.o 00:02:17.120 LIB libspdk_blob.a 00:02:17.120 SO libspdk_blob.so.10.1 00:02:17.120 SYMLINK libspdk_blob.so 00:02:17.120 CC lib/blobfs/blobfs.o 00:02:17.120 CC lib/blobfs/tree.o 00:02:17.120 CC lib/lvol/lvol.o 00:02:17.687 LIB libspdk_blobfs.a 00:02:17.687 LIB libspdk_bdev.a 00:02:17.687 SO libspdk_blobfs.so.9.0 00:02:17.687 SO libspdk_bdev.so.14.0 00:02:17.687 LIB libspdk_lvol.a 00:02:17.687 SYMLINK libspdk_blobfs.so 00:02:17.687 SO libspdk_lvol.so.9.1 00:02:17.952 SYMLINK libspdk_bdev.so 00:02:17.952 SYMLINK libspdk_lvol.so 00:02:17.952 CC lib/scsi/dev.o 00:02:17.952 CC lib/nvmf/ctrlr.o 00:02:17.952 CC lib/nbd/nbd.o 00:02:17.952 CC lib/ublk/ublk.o 00:02:17.952 CC lib/scsi/lun.o 00:02:17.952 CC lib/scsi/port.o 00:02:17.952 CC lib/nvmf/ctrlr_discovery.o 00:02:17.953 CC lib/nbd/nbd_rpc.o 00:02:17.953 CC lib/ftl/ftl_core.o 00:02:17.953 CC lib/ublk/ublk_rpc.o 00:02:17.953 CC lib/scsi/scsi.o 00:02:17.953 CC lib/nvmf/ctrlr_bdev.o 00:02:17.953 CC lib/ftl/ftl_init.o 00:02:17.953 CC lib/scsi/scsi_bdev.o 00:02:17.953 CC lib/nvmf/subsystem.o 00:02:17.953 CC lib/ftl/ftl_layout.o 00:02:17.953 CC lib/nvmf/nvmf.o 00:02:17.953 CC lib/scsi/scsi_pr.o 00:02:17.953 CC lib/ftl/ftl_debug.o 00:02:17.953 CC lib/nvmf/nvmf_rpc.o 00:02:17.953 CC lib/scsi/scsi_rpc.o 00:02:17.953 CC lib/nvmf/transport.o 00:02:17.953 CC lib/ftl/ftl_sb.o 00:02:17.953 CC lib/ftl/ftl_io.o 00:02:17.953 CC lib/nvmf/tcp.o 00:02:17.953 CC lib/scsi/task.o 00:02:17.953 CC lib/ftl/ftl_l2p.o 00:02:17.953 CC lib/nvmf/rdma.o 00:02:17.953 CC lib/ftl/ftl_nv_cache.o 00:02:17.953 CC lib/ftl/ftl_l2p_flat.o 00:02:17.953 CC lib/ftl/ftl_band.o 00:02:17.953 CC lib/ftl/ftl_band_ops.o 00:02:17.953 CC lib/ftl/ftl_writer.o 00:02:17.953 CC lib/ftl/ftl_reloc.o 00:02:17.953 CC lib/ftl/ftl_rq.o 00:02:17.953 CC lib/ftl/ftl_l2p_cache.o 00:02:17.953 CC lib/ftl/ftl_p2l.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:17.953 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:18.217 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:18.217 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:18.217 CC lib/ftl/utils/ftl_conf.o 00:02:18.217 CC lib/ftl/utils/ftl_md.o 00:02:18.217 CC lib/ftl/utils/ftl_mempool.o 00:02:18.217 CC lib/ftl/utils/ftl_bitmap.o 00:02:18.476 CC lib/ftl/utils/ftl_property.o 00:02:18.476 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:18.476 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:18.476 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:18.476 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:18.476 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:18.476 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:18.476 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:18.476 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:18.476 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:18.476 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:18.476 CC lib/ftl/base/ftl_base_dev.o 00:02:18.476 CC lib/ftl/base/ftl_base_bdev.o 00:02:18.476 CC lib/ftl/ftl_trace.o 00:02:18.735 LIB libspdk_nbd.a 00:02:18.735 SO libspdk_nbd.so.6.0 00:02:18.735 SYMLINK libspdk_nbd.so 00:02:18.735 LIB libspdk_scsi.a 00:02:18.993 SO libspdk_scsi.so.8.0 00:02:18.993 LIB libspdk_ublk.a 00:02:18.993 SO libspdk_ublk.so.2.0 00:02:18.993 SYMLINK libspdk_scsi.so 00:02:18.993 SYMLINK libspdk_ublk.so 00:02:18.993 CC lib/vhost/vhost.o 00:02:18.993 CC lib/iscsi/conn.o 00:02:18.993 CC lib/vhost/vhost_rpc.o 00:02:18.993 CC lib/iscsi/init_grp.o 00:02:18.993 CC lib/vhost/vhost_scsi.o 00:02:18.993 CC lib/iscsi/iscsi.o 00:02:18.993 CC lib/vhost/vhost_blk.o 00:02:18.993 CC lib/iscsi/md5.o 00:02:18.993 CC lib/vhost/rte_vhost_user.o 00:02:18.993 CC lib/iscsi/param.o 00:02:18.993 CC lib/iscsi/portal_grp.o 00:02:18.993 CC lib/iscsi/tgt_node.o 00:02:18.993 CC lib/iscsi/iscsi_subsystem.o 00:02:18.993 CC lib/iscsi/iscsi_rpc.o 00:02:18.993 CC lib/iscsi/task.o 00:02:19.252 LIB libspdk_ftl.a 00:02:19.511 SO libspdk_ftl.so.8.0 00:02:19.769 SYMLINK libspdk_ftl.so 00:02:20.336 LIB libspdk_vhost.a 00:02:20.337 SO libspdk_vhost.so.7.1 00:02:20.337 SYMLINK libspdk_vhost.so 00:02:20.596 LIB libspdk_nvmf.a 00:02:20.596 LIB libspdk_iscsi.a 00:02:20.596 SO libspdk_nvmf.so.17.0 00:02:20.596 SO libspdk_iscsi.so.7.0 00:02:20.596 SYMLINK libspdk_nvmf.so 00:02:20.596 SYMLINK libspdk_iscsi.so 00:02:20.854 CC module/env_dpdk/env_dpdk_rpc.o 00:02:20.854 CC module/blob/bdev/blob_bdev.o 00:02:20.854 CC module/accel/dsa/accel_dsa.o 00:02:20.854 CC module/accel/dsa/accel_dsa_rpc.o 00:02:20.854 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:20.854 CC module/accel/iaa/accel_iaa.o 00:02:20.854 CC module/scheduler/gscheduler/gscheduler.o 00:02:20.854 CC module/accel/iaa/accel_iaa_rpc.o 00:02:20.854 CC module/accel/ioat/accel_ioat.o 00:02:20.854 CC module/accel/error/accel_error.o 00:02:20.854 CC module/sock/posix/posix.o 00:02:20.854 CC module/accel/ioat/accel_ioat_rpc.o 00:02:20.854 CC module/accel/error/accel_error_rpc.o 00:02:20.854 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:21.112 LIB libspdk_env_dpdk_rpc.a 00:02:21.112 SO libspdk_env_dpdk_rpc.so.5.0 00:02:21.112 SYMLINK libspdk_env_dpdk_rpc.so 00:02:21.112 LIB libspdk_scheduler_gscheduler.a 00:02:21.112 LIB libspdk_scheduler_dpdk_governor.a 00:02:21.112 SO libspdk_scheduler_gscheduler.so.3.0 00:02:21.112 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:21.112 LIB libspdk_accel_error.a 00:02:21.112 LIB libspdk_accel_ioat.a 00:02:21.112 LIB libspdk_scheduler_dynamic.a 00:02:21.112 LIB libspdk_accel_iaa.a 00:02:21.112 SO libspdk_accel_error.so.1.0 00:02:21.112 SO libspdk_accel_ioat.so.5.0 00:02:21.112 SO libspdk_scheduler_dynamic.so.3.0 00:02:21.112 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:21.112 SYMLINK libspdk_scheduler_gscheduler.so 00:02:21.112 SO libspdk_accel_iaa.so.2.0 00:02:21.112 LIB libspdk_accel_dsa.a 00:02:21.112 SYMLINK libspdk_accel_error.so 00:02:21.112 SYMLINK libspdk_scheduler_dynamic.so 00:02:21.112 SYMLINK libspdk_accel_ioat.so 00:02:21.112 LIB libspdk_blob_bdev.a 00:02:21.112 SO libspdk_accel_dsa.so.4.0 00:02:21.112 SYMLINK libspdk_accel_iaa.so 00:02:21.112 SO libspdk_blob_bdev.so.10.1 00:02:21.372 SYMLINK libspdk_accel_dsa.so 00:02:21.372 SYMLINK libspdk_blob_bdev.so 00:02:21.372 CC module/bdev/malloc/bdev_malloc.o 00:02:21.372 CC module/bdev/delay/vbdev_delay.o 00:02:21.372 CC module/bdev/raid/bdev_raid.o 00:02:21.372 CC module/bdev/nvme/bdev_nvme.o 00:02:21.372 CC module/bdev/gpt/gpt.o 00:02:21.372 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:21.372 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:21.372 CC module/bdev/lvol/vbdev_lvol.o 00:02:21.372 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:21.372 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:21.372 CC module/bdev/raid/bdev_raid_rpc.o 00:02:21.372 CC module/bdev/nvme/nvme_rpc.o 00:02:21.372 CC module/bdev/nvme/bdev_mdns_client.o 00:02:21.372 CC module/bdev/gpt/vbdev_gpt.o 00:02:21.372 CC module/bdev/passthru/vbdev_passthru.o 00:02:21.372 CC module/bdev/raid/bdev_raid_sb.o 00:02:21.372 CC module/bdev/error/vbdev_error.o 00:02:21.372 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:21.372 CC module/bdev/nvme/vbdev_opal.o 00:02:21.372 CC module/bdev/error/vbdev_error_rpc.o 00:02:21.372 CC module/bdev/raid/raid1.o 00:02:21.372 CC module/bdev/raid/raid0.o 00:02:21.372 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:21.372 CC module/bdev/null/bdev_null.o 00:02:21.372 CC module/bdev/ftl/bdev_ftl.o 00:02:21.372 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:21.372 CC module/bdev/split/vbdev_split.o 00:02:21.372 CC module/bdev/null/bdev_null_rpc.o 00:02:21.372 CC module/bdev/raid/concat.o 00:02:21.372 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:21.372 CC module/bdev/split/vbdev_split_rpc.o 00:02:21.372 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:21.372 CC module/bdev/iscsi/bdev_iscsi.o 00:02:21.372 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:21.372 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:21.372 CC module/bdev/aio/bdev_aio.o 00:02:21.372 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:21.372 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:21.372 CC module/bdev/aio/bdev_aio_rpc.o 00:02:21.372 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:21.372 CC module/blobfs/bdev/blobfs_bdev.o 00:02:21.372 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:21.939 LIB libspdk_bdev_error.a 00:02:21.939 LIB libspdk_blobfs_bdev.a 00:02:21.939 SO libspdk_bdev_error.so.5.0 00:02:21.939 LIB libspdk_bdev_split.a 00:02:21.939 SO libspdk_blobfs_bdev.so.5.0 00:02:21.939 LIB libspdk_bdev_passthru.a 00:02:21.939 SO libspdk_bdev_split.so.5.0 00:02:21.939 SO libspdk_bdev_passthru.so.5.0 00:02:21.939 SYMLINK libspdk_bdev_error.so 00:02:21.939 LIB libspdk_sock_posix.a 00:02:21.939 SYMLINK libspdk_blobfs_bdev.so 00:02:21.939 LIB libspdk_bdev_iscsi.a 00:02:21.939 LIB libspdk_bdev_null.a 00:02:21.939 SO libspdk_sock_posix.so.5.0 00:02:21.939 SYMLINK libspdk_bdev_split.so 00:02:21.939 LIB libspdk_bdev_ftl.a 00:02:21.939 SYMLINK libspdk_bdev_passthru.so 00:02:21.939 SO libspdk_bdev_null.so.5.0 00:02:21.939 SO libspdk_bdev_iscsi.so.5.0 00:02:21.939 LIB libspdk_bdev_gpt.a 00:02:21.939 SO libspdk_bdev_ftl.so.5.0 00:02:21.939 LIB libspdk_bdev_zone_block.a 00:02:21.939 SO libspdk_bdev_gpt.so.5.0 00:02:21.939 LIB libspdk_bdev_aio.a 00:02:21.939 LIB libspdk_bdev_malloc.a 00:02:21.939 SYMLINK libspdk_sock_posix.so 00:02:21.939 SYMLINK libspdk_bdev_iscsi.so 00:02:21.939 SO libspdk_bdev_zone_block.so.5.0 00:02:21.939 SYMLINK libspdk_bdev_null.so 00:02:21.939 LIB libspdk_bdev_delay.a 00:02:21.939 SYMLINK libspdk_bdev_ftl.so 00:02:21.939 SO libspdk_bdev_aio.so.5.0 00:02:21.939 SO libspdk_bdev_malloc.so.5.0 00:02:21.939 SYMLINK libspdk_bdev_gpt.so 00:02:21.939 SO libspdk_bdev_delay.so.5.0 00:02:21.939 SYMLINK libspdk_bdev_zone_block.so 00:02:22.197 SYMLINK libspdk_bdev_aio.so 00:02:22.197 SYMLINK libspdk_bdev_malloc.so 00:02:22.197 SYMLINK libspdk_bdev_delay.so 00:02:22.197 LIB libspdk_bdev_lvol.a 00:02:22.197 LIB libspdk_bdev_virtio.a 00:02:22.197 SO libspdk_bdev_lvol.so.5.0 00:02:22.197 SO libspdk_bdev_virtio.so.5.0 00:02:22.197 SYMLINK libspdk_bdev_lvol.so 00:02:22.197 SYMLINK libspdk_bdev_virtio.so 00:02:22.455 LIB libspdk_bdev_raid.a 00:02:22.455 SO libspdk_bdev_raid.so.5.0 00:02:22.712 SYMLINK libspdk_bdev_raid.so 00:02:23.646 LIB libspdk_bdev_nvme.a 00:02:23.646 SO libspdk_bdev_nvme.so.6.0 00:02:23.905 SYMLINK libspdk_bdev_nvme.so 00:02:23.905 CC module/event/subsystems/vmd/vmd.o 00:02:23.905 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:23.905 CC module/event/subsystems/iobuf/iobuf.o 00:02:23.905 CC module/event/subsystems/scheduler/scheduler.o 00:02:23.905 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:23.905 CC module/event/subsystems/sock/sock.o 00:02:23.905 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:24.163 LIB libspdk_event_sock.a 00:02:24.164 LIB libspdk_event_vmd.a 00:02:24.164 LIB libspdk_event_vhost_blk.a 00:02:24.164 LIB libspdk_event_scheduler.a 00:02:24.164 SO libspdk_event_sock.so.4.0 00:02:24.164 SO libspdk_event_vmd.so.5.0 00:02:24.164 LIB libspdk_event_iobuf.a 00:02:24.164 SO libspdk_event_scheduler.so.3.0 00:02:24.164 SO libspdk_event_vhost_blk.so.2.0 00:02:24.164 SO libspdk_event_iobuf.so.2.0 00:02:24.164 SYMLINK libspdk_event_sock.so 00:02:24.164 SYMLINK libspdk_event_vhost_blk.so 00:02:24.164 SYMLINK libspdk_event_scheduler.so 00:02:24.164 SYMLINK libspdk_event_vmd.so 00:02:24.164 SYMLINK libspdk_event_iobuf.so 00:02:24.421 CC module/event/subsystems/accel/accel.o 00:02:24.421 LIB libspdk_event_accel.a 00:02:24.679 SO libspdk_event_accel.so.5.0 00:02:24.679 SYMLINK libspdk_event_accel.so 00:02:24.679 CC module/event/subsystems/bdev/bdev.o 00:02:24.938 LIB libspdk_event_bdev.a 00:02:24.938 SO libspdk_event_bdev.so.5.0 00:02:24.938 SYMLINK libspdk_event_bdev.so 00:02:24.938 CC module/event/subsystems/scsi/scsi.o 00:02:24.938 CC module/event/subsystems/nbd/nbd.o 00:02:24.938 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:24.938 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:24.938 CC module/event/subsystems/ublk/ublk.o 00:02:25.196 LIB libspdk_event_nbd.a 00:02:25.196 LIB libspdk_event_ublk.a 00:02:25.196 LIB libspdk_event_scsi.a 00:02:25.196 SO libspdk_event_nbd.so.5.0 00:02:25.196 SO libspdk_event_ublk.so.2.0 00:02:25.196 SO libspdk_event_scsi.so.5.0 00:02:25.196 SYMLINK libspdk_event_nbd.so 00:02:25.196 SYMLINK libspdk_event_ublk.so 00:02:25.196 SYMLINK libspdk_event_scsi.so 00:02:25.196 LIB libspdk_event_nvmf.a 00:02:25.196 SO libspdk_event_nvmf.so.5.0 00:02:25.455 SYMLINK libspdk_event_nvmf.so 00:02:25.455 CC module/event/subsystems/iscsi/iscsi.o 00:02:25.455 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:25.455 LIB libspdk_event_vhost_scsi.a 00:02:25.455 LIB libspdk_event_iscsi.a 00:02:25.455 SO libspdk_event_vhost_scsi.so.2.0 00:02:25.455 SO libspdk_event_iscsi.so.5.0 00:02:25.720 SYMLINK libspdk_event_vhost_scsi.so 00:02:25.720 SYMLINK libspdk_event_iscsi.so 00:02:25.720 SO libspdk.so.5.0 00:02:25.720 SYMLINK libspdk.so 00:02:25.720 CC app/trace_record/trace_record.o 00:02:25.985 CC app/spdk_nvme_perf/perf.o 00:02:25.985 CXX app/trace/trace.o 00:02:25.985 CC app/spdk_nvme_discover/discovery_aer.o 00:02:25.985 CC app/spdk_lspci/spdk_lspci.o 00:02:25.985 TEST_HEADER include/spdk/accel.h 00:02:25.985 CC app/spdk_top/spdk_top.o 00:02:25.985 TEST_HEADER include/spdk/accel_module.h 00:02:25.985 CC test/rpc_client/rpc_client_test.o 00:02:25.985 CC app/spdk_nvme_identify/identify.o 00:02:25.985 TEST_HEADER include/spdk/assert.h 00:02:25.985 TEST_HEADER include/spdk/barrier.h 00:02:25.985 TEST_HEADER include/spdk/base64.h 00:02:25.985 TEST_HEADER include/spdk/bdev.h 00:02:25.985 TEST_HEADER include/spdk/bdev_module.h 00:02:25.985 TEST_HEADER include/spdk/bdev_zone.h 00:02:25.985 TEST_HEADER include/spdk/bit_array.h 00:02:25.985 TEST_HEADER include/spdk/bit_pool.h 00:02:25.985 TEST_HEADER include/spdk/blob_bdev.h 00:02:25.985 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:25.985 TEST_HEADER include/spdk/blobfs.h 00:02:25.985 TEST_HEADER include/spdk/blob.h 00:02:25.985 TEST_HEADER include/spdk/conf.h 00:02:25.985 TEST_HEADER include/spdk/config.h 00:02:25.985 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:25.985 TEST_HEADER include/spdk/cpuset.h 00:02:25.985 CC app/spdk_dd/spdk_dd.o 00:02:25.985 TEST_HEADER include/spdk/crc16.h 00:02:25.985 TEST_HEADER include/spdk/crc32.h 00:02:25.985 TEST_HEADER include/spdk/crc64.h 00:02:25.985 TEST_HEADER include/spdk/dif.h 00:02:25.985 CC app/nvmf_tgt/nvmf_main.o 00:02:25.985 TEST_HEADER include/spdk/dma.h 00:02:25.985 CC app/vhost/vhost.o 00:02:25.985 TEST_HEADER include/spdk/endian.h 00:02:25.985 TEST_HEADER include/spdk/env_dpdk.h 00:02:25.985 CC examples/ioat/perf/perf.o 00:02:25.985 CC examples/nvme/abort/abort.o 00:02:25.985 TEST_HEADER include/spdk/env.h 00:02:25.985 CC examples/nvme/reconnect/reconnect.o 00:02:25.985 CC app/iscsi_tgt/iscsi_tgt.o 00:02:25.985 CC examples/ioat/verify/verify.o 00:02:25.985 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:25.985 CC app/fio/nvme/fio_plugin.o 00:02:25.985 CC examples/nvme/hotplug/hotplug.o 00:02:25.985 TEST_HEADER include/spdk/event.h 00:02:25.985 CC examples/nvme/hello_world/hello_world.o 00:02:25.985 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:25.985 CC examples/nvme/arbitration/arbitration.o 00:02:25.985 TEST_HEADER include/spdk/fd_group.h 00:02:25.985 CC examples/vmd/lsvmd/lsvmd.o 00:02:25.985 TEST_HEADER include/spdk/fd.h 00:02:25.985 CC examples/idxd/perf/perf.o 00:02:25.985 CC examples/util/zipf/zipf.o 00:02:25.985 CC test/nvme/aer/aer.o 00:02:25.985 CC test/env/vtophys/vtophys.o 00:02:25.985 TEST_HEADER include/spdk/file.h 00:02:25.985 CC examples/sock/hello_world/hello_sock.o 00:02:25.985 CC examples/accel/perf/accel_perf.o 00:02:25.985 TEST_HEADER include/spdk/ftl.h 00:02:25.985 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:25.985 TEST_HEADER include/spdk/gpt_spec.h 00:02:25.985 CC test/thread/poller_perf/poller_perf.o 00:02:25.985 TEST_HEADER include/spdk/hexlify.h 00:02:25.985 CC test/event/event_perf/event_perf.o 00:02:25.985 TEST_HEADER include/spdk/histogram_data.h 00:02:25.985 CC app/spdk_tgt/spdk_tgt.o 00:02:25.985 TEST_HEADER include/spdk/idxd.h 00:02:25.985 TEST_HEADER include/spdk/idxd_spec.h 00:02:25.985 TEST_HEADER include/spdk/init.h 00:02:25.985 TEST_HEADER include/spdk/ioat.h 00:02:25.985 TEST_HEADER include/spdk/ioat_spec.h 00:02:25.985 TEST_HEADER include/spdk/iscsi_spec.h 00:02:25.985 CC examples/blob/hello_world/hello_blob.o 00:02:25.985 TEST_HEADER include/spdk/json.h 00:02:25.985 CC examples/blob/cli/blobcli.o 00:02:25.985 TEST_HEADER include/spdk/jsonrpc.h 00:02:25.986 CC examples/bdev/hello_world/hello_bdev.o 00:02:25.986 TEST_HEADER include/spdk/likely.h 00:02:25.986 CC test/blobfs/mkfs/mkfs.o 00:02:25.986 TEST_HEADER include/spdk/log.h 00:02:25.986 CC test/bdev/bdevio/bdevio.o 00:02:25.986 CC test/dma/test_dma/test_dma.o 00:02:25.986 CC examples/thread/thread/thread_ex.o 00:02:25.986 CC test/app/bdev_svc/bdev_svc.o 00:02:25.986 TEST_HEADER include/spdk/lvol.h 00:02:25.986 CC examples/bdev/bdevperf/bdevperf.o 00:02:25.986 CC test/accel/dif/dif.o 00:02:25.986 TEST_HEADER include/spdk/memory.h 00:02:25.986 TEST_HEADER include/spdk/mmio.h 00:02:25.986 TEST_HEADER include/spdk/nbd.h 00:02:25.986 TEST_HEADER include/spdk/notify.h 00:02:25.986 CC examples/nvmf/nvmf/nvmf.o 00:02:25.986 TEST_HEADER include/spdk/nvme.h 00:02:25.986 TEST_HEADER include/spdk/nvme_intel.h 00:02:25.986 CC test/env/mem_callbacks/mem_callbacks.o 00:02:25.986 CC test/lvol/esnap/esnap.o 00:02:25.986 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:25.986 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:25.986 TEST_HEADER include/spdk/nvme_spec.h 00:02:25.986 TEST_HEADER include/spdk/nvme_zns.h 00:02:25.986 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:25.986 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:25.986 TEST_HEADER include/spdk/nvmf.h 00:02:25.986 TEST_HEADER include/spdk/nvmf_spec.h 00:02:25.986 TEST_HEADER include/spdk/nvmf_transport.h 00:02:25.986 TEST_HEADER include/spdk/opal.h 00:02:25.986 TEST_HEADER include/spdk/opal_spec.h 00:02:25.986 TEST_HEADER include/spdk/pci_ids.h 00:02:25.986 TEST_HEADER include/spdk/pipe.h 00:02:25.986 TEST_HEADER include/spdk/queue.h 00:02:25.986 TEST_HEADER include/spdk/reduce.h 00:02:26.248 TEST_HEADER include/spdk/rpc.h 00:02:26.248 TEST_HEADER include/spdk/scheduler.h 00:02:26.248 TEST_HEADER include/spdk/scsi.h 00:02:26.248 LINK spdk_lspci 00:02:26.248 TEST_HEADER include/spdk/scsi_spec.h 00:02:26.248 TEST_HEADER include/spdk/sock.h 00:02:26.248 TEST_HEADER include/spdk/stdinc.h 00:02:26.248 TEST_HEADER include/spdk/string.h 00:02:26.248 TEST_HEADER include/spdk/thread.h 00:02:26.248 TEST_HEADER include/spdk/trace.h 00:02:26.248 TEST_HEADER include/spdk/trace_parser.h 00:02:26.248 TEST_HEADER include/spdk/tree.h 00:02:26.248 TEST_HEADER include/spdk/ublk.h 00:02:26.248 TEST_HEADER include/spdk/util.h 00:02:26.248 TEST_HEADER include/spdk/uuid.h 00:02:26.248 TEST_HEADER include/spdk/version.h 00:02:26.248 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:26.248 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:26.248 TEST_HEADER include/spdk/vhost.h 00:02:26.248 TEST_HEADER include/spdk/vmd.h 00:02:26.248 TEST_HEADER include/spdk/xor.h 00:02:26.248 TEST_HEADER include/spdk/zipf.h 00:02:26.248 CXX test/cpp_headers/accel.o 00:02:26.248 LINK lsvmd 00:02:26.248 LINK rpc_client_test 00:02:26.248 LINK spdk_nvme_discover 00:02:26.248 LINK vtophys 00:02:26.248 LINK event_perf 00:02:26.248 LINK zipf 00:02:26.248 LINK poller_perf 00:02:26.248 LINK interrupt_tgt 00:02:26.248 LINK nvmf_tgt 00:02:26.248 LINK vhost 00:02:26.248 LINK pmr_persistence 00:02:26.248 LINK cmb_copy 00:02:26.248 LINK spdk_trace_record 00:02:26.248 LINK iscsi_tgt 00:02:26.248 LINK verify 00:02:26.514 LINK ioat_perf 00:02:26.514 LINK hello_world 00:02:26.514 LINK spdk_tgt 00:02:26.514 LINK bdev_svc 00:02:26.514 LINK mkfs 00:02:26.514 LINK hotplug 00:02:26.514 LINK hello_sock 00:02:26.514 LINK hello_blob 00:02:26.514 LINK hello_bdev 00:02:26.514 LINK aer 00:02:26.514 LINK thread 00:02:26.514 CXX test/cpp_headers/accel_module.o 00:02:26.514 CXX test/cpp_headers/assert.o 00:02:26.514 LINK arbitration 00:02:26.514 LINK idxd_perf 00:02:26.514 LINK reconnect 00:02:26.515 LINK nvmf 00:02:26.515 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:26.515 LINK spdk_dd 00:02:26.515 CC test/event/reactor/reactor.o 00:02:26.776 CC examples/vmd/led/led.o 00:02:26.776 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:26.776 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:26.776 CC test/nvme/reset/reset.o 00:02:26.776 LINK abort 00:02:26.776 CXX test/cpp_headers/barrier.o 00:02:26.776 LINK spdk_trace 00:02:26.776 CC app/fio/bdev/fio_plugin.o 00:02:26.776 CC test/nvme/sgl/sgl.o 00:02:26.776 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:26.776 LINK dif 00:02:26.776 CC test/nvme/e2edp/nvme_dp.o 00:02:26.776 CC test/app/histogram_perf/histogram_perf.o 00:02:26.776 LINK bdevio 00:02:26.776 LINK test_dma 00:02:26.776 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:26.776 CC test/env/memory/memory_ut.o 00:02:26.776 CC test/event/reactor_perf/reactor_perf.o 00:02:26.776 CXX test/cpp_headers/base64.o 00:02:26.776 CC test/app/jsoncat/jsoncat.o 00:02:26.776 CC test/event/app_repeat/app_repeat.o 00:02:26.776 CXX test/cpp_headers/bdev.o 00:02:26.776 CC test/nvme/overhead/overhead.o 00:02:26.776 CC test/env/pci/pci_ut.o 00:02:26.776 CC test/app/stub/stub.o 00:02:26.776 LINK accel_perf 00:02:26.776 CXX test/cpp_headers/bdev_module.o 00:02:26.776 CXX test/cpp_headers/bdev_zone.o 00:02:26.776 CC test/event/scheduler/scheduler.o 00:02:27.041 LINK nvme_manage 00:02:27.041 CXX test/cpp_headers/bit_array.o 00:02:27.041 CXX test/cpp_headers/bit_pool.o 00:02:27.041 LINK reactor 00:02:27.041 LINK led 00:02:27.041 CC test/nvme/err_injection/err_injection.o 00:02:27.041 LINK blobcli 00:02:27.041 CC test/nvme/startup/startup.o 00:02:27.041 CC test/nvme/reserve/reserve.o 00:02:27.041 LINK spdk_nvme 00:02:27.041 CC test/nvme/simple_copy/simple_copy.o 00:02:27.041 CXX test/cpp_headers/blob_bdev.o 00:02:27.041 LINK histogram_perf 00:02:27.041 CXX test/cpp_headers/blobfs_bdev.o 00:02:27.041 CXX test/cpp_headers/blobfs.o 00:02:27.041 CC test/nvme/connect_stress/connect_stress.o 00:02:27.041 LINK reactor_perf 00:02:27.041 LINK env_dpdk_post_init 00:02:27.041 LINK jsoncat 00:02:27.041 CC test/nvme/boot_partition/boot_partition.o 00:02:27.041 CC test/nvme/compliance/nvme_compliance.o 00:02:27.041 CXX test/cpp_headers/blob.o 00:02:27.041 LINK app_repeat 00:02:27.041 LINK reset 00:02:27.303 CXX test/cpp_headers/conf.o 00:02:27.303 LINK sgl 00:02:27.303 CXX test/cpp_headers/config.o 00:02:27.303 CXX test/cpp_headers/cpuset.o 00:02:27.303 CC test/nvme/fused_ordering/fused_ordering.o 00:02:27.303 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:27.303 LINK stub 00:02:27.303 CXX test/cpp_headers/crc16.o 00:02:27.303 CC test/nvme/fdp/fdp.o 00:02:27.303 LINK nvme_dp 00:02:27.303 CXX test/cpp_headers/crc32.o 00:02:27.303 CC test/nvme/cuse/cuse.o 00:02:27.303 CXX test/cpp_headers/crc64.o 00:02:27.303 CXX test/cpp_headers/dif.o 00:02:27.303 CXX test/cpp_headers/dma.o 00:02:27.303 LINK mem_callbacks 00:02:27.303 CXX test/cpp_headers/endian.o 00:02:27.303 LINK err_injection 00:02:27.303 CXX test/cpp_headers/env_dpdk.o 00:02:27.303 CXX test/cpp_headers/env.o 00:02:27.303 LINK scheduler 00:02:27.303 LINK spdk_nvme_perf 00:02:27.303 LINK startup 00:02:27.303 CXX test/cpp_headers/event.o 00:02:27.303 CXX test/cpp_headers/fd_group.o 00:02:27.303 CXX test/cpp_headers/fd.o 00:02:27.303 CXX test/cpp_headers/file.o 00:02:27.303 CXX test/cpp_headers/ftl.o 00:02:27.303 LINK overhead 00:02:27.303 LINK connect_stress 00:02:27.303 LINK reserve 00:02:27.303 LINK nvme_fuzz 00:02:27.303 CXX test/cpp_headers/gpt_spec.o 00:02:27.569 LINK boot_partition 00:02:27.569 CXX test/cpp_headers/hexlify.o 00:02:27.569 LINK bdevperf 00:02:27.569 CXX test/cpp_headers/histogram_data.o 00:02:27.569 CXX test/cpp_headers/idxd.o 00:02:27.569 LINK simple_copy 00:02:27.569 CXX test/cpp_headers/idxd_spec.o 00:02:27.569 LINK vhost_fuzz 00:02:27.569 CXX test/cpp_headers/init.o 00:02:27.569 LINK spdk_nvme_identify 00:02:27.569 CXX test/cpp_headers/ioat.o 00:02:27.569 CXX test/cpp_headers/ioat_spec.o 00:02:27.569 LINK spdk_top 00:02:27.569 CXX test/cpp_headers/iscsi_spec.o 00:02:27.569 CXX test/cpp_headers/json.o 00:02:27.569 LINK pci_ut 00:02:27.569 CXX test/cpp_headers/jsonrpc.o 00:02:27.569 CXX test/cpp_headers/likely.o 00:02:27.569 CXX test/cpp_headers/log.o 00:02:27.569 CXX test/cpp_headers/lvol.o 00:02:27.569 LINK doorbell_aers 00:02:27.569 CXX test/cpp_headers/memory.o 00:02:27.569 LINK spdk_bdev 00:02:27.569 LINK fused_ordering 00:02:27.569 CXX test/cpp_headers/mmio.o 00:02:27.569 CXX test/cpp_headers/nbd.o 00:02:27.569 CXX test/cpp_headers/notify.o 00:02:27.569 CXX test/cpp_headers/nvme.o 00:02:27.569 CXX test/cpp_headers/nvme_intel.o 00:02:27.569 CXX test/cpp_headers/nvme_ocssd.o 00:02:27.849 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:27.849 CXX test/cpp_headers/nvme_spec.o 00:02:27.849 CXX test/cpp_headers/nvme_zns.o 00:02:27.849 CXX test/cpp_headers/nvmf_cmd.o 00:02:27.849 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:27.849 CXX test/cpp_headers/nvmf.o 00:02:27.849 CXX test/cpp_headers/nvmf_spec.o 00:02:27.849 CXX test/cpp_headers/nvmf_transport.o 00:02:27.849 CXX test/cpp_headers/opal.o 00:02:27.849 CXX test/cpp_headers/opal_spec.o 00:02:27.849 CXX test/cpp_headers/pci_ids.o 00:02:27.849 CXX test/cpp_headers/pipe.o 00:02:27.849 LINK nvme_compliance 00:02:27.849 CXX test/cpp_headers/queue.o 00:02:27.849 CXX test/cpp_headers/reduce.o 00:02:27.849 CXX test/cpp_headers/rpc.o 00:02:27.849 CXX test/cpp_headers/scheduler.o 00:02:27.849 CXX test/cpp_headers/scsi.o 00:02:27.849 CXX test/cpp_headers/scsi_spec.o 00:02:27.849 CXX test/cpp_headers/sock.o 00:02:27.849 CXX test/cpp_headers/stdinc.o 00:02:27.849 CXX test/cpp_headers/string.o 00:02:27.849 LINK fdp 00:02:27.849 CXX test/cpp_headers/thread.o 00:02:27.849 CXX test/cpp_headers/trace.o 00:02:27.849 CXX test/cpp_headers/trace_parser.o 00:02:27.849 CXX test/cpp_headers/tree.o 00:02:27.849 CXX test/cpp_headers/ublk.o 00:02:27.849 CXX test/cpp_headers/util.o 00:02:27.849 CXX test/cpp_headers/uuid.o 00:02:27.849 CXX test/cpp_headers/version.o 00:02:27.849 CXX test/cpp_headers/vfio_user_pci.o 00:02:27.849 CXX test/cpp_headers/vfio_user_spec.o 00:02:27.849 CXX test/cpp_headers/vhost.o 00:02:27.849 CXX test/cpp_headers/vmd.o 00:02:27.849 CXX test/cpp_headers/xor.o 00:02:28.142 CXX test/cpp_headers/zipf.o 00:02:28.408 LINK memory_ut 00:02:28.666 LINK cuse 00:02:28.924 LINK iscsi_fuzz 00:02:31.467 LINK esnap 00:02:31.726 00:02:31.726 real 0m46.390s 00:02:31.726 user 9m39.574s 00:02:31.726 sys 2m10.754s 00:02:31.726 15:03:30 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:31.726 15:03:30 -- common/autotest_common.sh@10 -- $ set +x 00:02:31.726 ************************************ 00:02:31.726 END TEST make 00:02:31.726 ************************************ 00:02:31.726 15:03:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:31.726 15:03:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:31.726 15:03:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:31.985 15:03:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:31.985 15:03:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:31.985 15:03:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:31.985 15:03:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:31.985 15:03:30 -- scripts/common.sh@335 -- # IFS=.-: 00:02:31.985 15:03:30 -- scripts/common.sh@335 -- # read -ra ver1 00:02:31.985 15:03:30 -- scripts/common.sh@336 -- # IFS=.-: 00:02:31.985 15:03:30 -- scripts/common.sh@336 -- # read -ra ver2 00:02:31.985 15:03:30 -- scripts/common.sh@337 -- # local 'op=<' 00:02:31.985 15:03:30 -- scripts/common.sh@339 -- # ver1_l=2 00:02:31.985 15:03:30 -- scripts/common.sh@340 -- # ver2_l=1 00:02:31.985 15:03:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:31.985 15:03:30 -- scripts/common.sh@343 -- # case "$op" in 00:02:31.985 15:03:30 -- scripts/common.sh@344 -- # : 1 00:02:31.985 15:03:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:31.985 15:03:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:31.985 15:03:30 -- scripts/common.sh@364 -- # decimal 1 00:02:31.985 15:03:30 -- scripts/common.sh@352 -- # local d=1 00:02:31.985 15:03:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:31.985 15:03:30 -- scripts/common.sh@354 -- # echo 1 00:02:31.985 15:03:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:31.985 15:03:30 -- scripts/common.sh@365 -- # decimal 2 00:02:31.985 15:03:30 -- scripts/common.sh@352 -- # local d=2 00:02:31.985 15:03:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:31.985 15:03:30 -- scripts/common.sh@354 -- # echo 2 00:02:31.985 15:03:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:31.985 15:03:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:31.985 15:03:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:31.985 15:03:30 -- scripts/common.sh@367 -- # return 0 00:02:31.985 15:03:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:31.985 15:03:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:31.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.985 --rc genhtml_branch_coverage=1 00:02:31.985 --rc genhtml_function_coverage=1 00:02:31.985 --rc genhtml_legend=1 00:02:31.985 --rc geninfo_all_blocks=1 00:02:31.985 --rc geninfo_unexecuted_blocks=1 00:02:31.985 00:02:31.985 ' 00:02:31.985 15:03:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:31.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.985 --rc genhtml_branch_coverage=1 00:02:31.985 --rc genhtml_function_coverage=1 00:02:31.985 --rc genhtml_legend=1 00:02:31.985 --rc geninfo_all_blocks=1 00:02:31.985 --rc geninfo_unexecuted_blocks=1 00:02:31.985 00:02:31.985 ' 00:02:31.985 15:03:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:31.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.985 --rc genhtml_branch_coverage=1 00:02:31.985 --rc genhtml_function_coverage=1 00:02:31.985 --rc genhtml_legend=1 00:02:31.985 --rc geninfo_all_blocks=1 00:02:31.985 --rc geninfo_unexecuted_blocks=1 00:02:31.985 00:02:31.985 ' 00:02:31.985 15:03:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:31.985 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.985 --rc genhtml_branch_coverage=1 00:02:31.985 --rc genhtml_function_coverage=1 00:02:31.985 --rc genhtml_legend=1 00:02:31.985 --rc geninfo_all_blocks=1 00:02:31.985 --rc geninfo_unexecuted_blocks=1 00:02:31.985 00:02:31.985 ' 00:02:31.985 15:03:30 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:31.985 15:03:30 -- nvmf/common.sh@7 -- # uname -s 00:02:31.985 15:03:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:31.985 15:03:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:31.985 15:03:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:31.985 15:03:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:31.985 15:03:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:31.985 15:03:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:31.985 15:03:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:31.985 15:03:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:31.985 15:03:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:31.985 15:03:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:31.985 15:03:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:31.985 15:03:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:31.986 15:03:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:31.986 15:03:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:31.986 15:03:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:31.986 15:03:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:31.986 15:03:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:31.986 15:03:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:31.986 15:03:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:31.986 15:03:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.986 15:03:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.986 15:03:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.986 15:03:30 -- paths/export.sh@5 -- # export PATH 00:02:31.986 15:03:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.986 15:03:30 -- nvmf/common.sh@46 -- # : 0 00:02:31.986 15:03:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:31.986 15:03:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:31.986 15:03:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:31.986 15:03:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:31.986 15:03:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:31.986 15:03:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:31.986 15:03:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:31.986 15:03:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:31.986 15:03:30 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:31.986 15:03:30 -- spdk/autotest.sh@32 -- # uname -s 00:02:31.986 15:03:30 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:31.986 15:03:30 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:31.986 15:03:30 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:31.986 15:03:30 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:31.986 15:03:30 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:31.986 15:03:30 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:31.986 15:03:30 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:31.986 15:03:30 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:31.986 15:03:30 -- spdk/autotest.sh@48 -- # udevadm_pid=2610728 00:02:31.986 15:03:30 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.986 15:03:30 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:31.986 15:03:30 -- spdk/autotest.sh@54 -- # echo 2610730 00:02:31.986 15:03:30 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.986 15:03:30 -- spdk/autotest.sh@56 -- # echo 2610731 00:02:31.986 15:03:30 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:31.986 15:03:30 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.986 15:03:30 -- spdk/autotest.sh@60 -- # echo 2610732 00:02:31.986 15:03:30 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:31.986 15:03:30 -- spdk/autotest.sh@62 -- # echo 2610733 00:02:31.986 15:03:30 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:31.986 15:03:30 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:31.986 15:03:30 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:31.986 15:03:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:31.986 15:03:30 -- common/autotest_common.sh@10 -- # set +x 00:02:31.986 15:03:30 -- spdk/autotest.sh@70 -- # create_test_list 00:02:31.986 15:03:30 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:31.986 15:03:30 -- common/autotest_common.sh@10 -- # set +x 00:02:31.986 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:31.986 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:31.986 15:03:30 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:31.986 15:03:30 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.986 15:03:30 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.986 15:03:30 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:31.986 15:03:30 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.986 15:03:30 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:31.986 15:03:30 -- common/autotest_common.sh@1450 -- # uname 00:02:31.986 15:03:30 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:31.986 15:03:30 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:31.986 15:03:30 -- common/autotest_common.sh@1470 -- # uname 00:02:31.986 15:03:30 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:31.986 15:03:30 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:31.986 15:03:30 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:31.986 lcov: LCOV version 1.15 00:02:31.986 15:03:30 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:36.179 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:36.179 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:36.179 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:36.179 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:36.179 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:36.179 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:08.259 15:04:02 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:08.259 15:04:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:08.259 15:04:02 -- common/autotest_common.sh@10 -- # set +x 00:03:08.259 15:04:02 -- spdk/autotest.sh@89 -- # rm -f 00:03:08.259 15:04:02 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:08.259 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:08.259 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:08.259 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:08.259 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:08.259 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:08.259 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:08.259 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:08.259 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:08.259 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:08.259 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:08.259 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:08.259 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:08.259 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:08.259 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:08.259 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:08.259 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:08.259 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:08.259 15:04:04 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:08.259 15:04:04 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:08.259 15:04:04 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:08.259 15:04:04 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:08.259 15:04:04 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:08.259 15:04:04 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:08.259 15:04:04 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:08.259 15:04:04 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:08.259 15:04:04 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:08.259 15:04:04 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:08.259 15:04:04 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:08.259 15:04:04 -- spdk/autotest.sh@108 -- # grep -v p 00:03:08.259 15:04:04 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:08.259 15:04:04 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:08.259 15:04:04 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:08.259 15:04:04 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:08.259 15:04:04 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:08.259 No valid GPT data, bailing 00:03:08.259 15:04:04 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:08.259 15:04:04 -- scripts/common.sh@393 -- # pt= 00:03:08.259 15:04:04 -- scripts/common.sh@394 -- # return 1 00:03:08.259 15:04:04 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:08.259 1+0 records in 00:03:08.259 1+0 records out 00:03:08.259 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00230027 s, 456 MB/s 00:03:08.259 15:04:04 -- spdk/autotest.sh@116 -- # sync 00:03:08.259 15:04:04 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:08.259 15:04:04 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:08.259 15:04:04 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:08.259 15:04:06 -- spdk/autotest.sh@122 -- # uname -s 00:03:08.259 15:04:06 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:08.259 15:04:06 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.259 15:04:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.259 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:03:08.259 ************************************ 00:03:08.259 START TEST setup.sh 00:03:08.259 ************************************ 00:03:08.259 15:04:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.259 * Looking for test storage... 00:03:08.259 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.259 15:04:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.259 15:04:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.259 15:04:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.259 15:04:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.259 15:04:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.259 15:04:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.259 15:04:06 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.259 15:04:06 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.259 15:04:06 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.259 15:04:06 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.259 15:04:06 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.259 15:04:06 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.259 15:04:06 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.259 15:04:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.259 15:04:06 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.259 15:04:06 -- scripts/common.sh@344 -- # : 1 00:03:08.259 15:04:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.259 15:04:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.259 15:04:06 -- scripts/common.sh@364 -- # decimal 1 00:03:08.259 15:04:06 -- scripts/common.sh@352 -- # local d=1 00:03:08.259 15:04:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.259 15:04:06 -- scripts/common.sh@354 -- # echo 1 00:03:08.259 15:04:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.259 15:04:06 -- scripts/common.sh@365 -- # decimal 2 00:03:08.259 15:04:06 -- scripts/common.sh@352 -- # local d=2 00:03:08.259 15:04:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.259 15:04:06 -- scripts/common.sh@354 -- # echo 2 00:03:08.259 15:04:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.259 15:04:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.259 15:04:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.259 15:04:06 -- scripts/common.sh@367 -- # return 0 00:03:08.259 15:04:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.259 --rc genhtml_branch_coverage=1 00:03:08.259 --rc genhtml_function_coverage=1 00:03:08.259 --rc genhtml_legend=1 00:03:08.259 --rc geninfo_all_blocks=1 00:03:08.259 --rc geninfo_unexecuted_blocks=1 00:03:08.259 00:03:08.259 ' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.259 --rc genhtml_branch_coverage=1 00:03:08.259 --rc genhtml_function_coverage=1 00:03:08.259 --rc genhtml_legend=1 00:03:08.259 --rc geninfo_all_blocks=1 00:03:08.259 --rc geninfo_unexecuted_blocks=1 00:03:08.259 00:03:08.259 ' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.259 --rc genhtml_branch_coverage=1 00:03:08.259 --rc genhtml_function_coverage=1 00:03:08.259 --rc genhtml_legend=1 00:03:08.259 --rc geninfo_all_blocks=1 00:03:08.259 --rc geninfo_unexecuted_blocks=1 00:03:08.259 00:03:08.259 ' 00:03:08.259 15:04:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.259 --rc genhtml_branch_coverage=1 00:03:08.259 --rc genhtml_function_coverage=1 00:03:08.259 --rc genhtml_legend=1 00:03:08.259 --rc geninfo_all_blocks=1 00:03:08.259 --rc geninfo_unexecuted_blocks=1 00:03:08.259 00:03:08.260 ' 00:03:08.260 15:04:06 -- setup/test-setup.sh@10 -- # uname -s 00:03:08.260 15:04:06 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:08.260 15:04:06 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.260 15:04:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.260 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:03:08.260 ************************************ 00:03:08.260 START TEST acl 00:03:08.260 ************************************ 00:03:08.260 15:04:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.260 * Looking for test storage... 00:03:08.260 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.260 15:04:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.260 15:04:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.260 15:04:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.260 15:04:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.260 15:04:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.260 15:04:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.260 15:04:06 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.260 15:04:06 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.260 15:04:06 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.260 15:04:06 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.260 15:04:06 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.260 15:04:06 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.260 15:04:06 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.260 15:04:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.260 15:04:06 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.260 15:04:06 -- scripts/common.sh@344 -- # : 1 00:03:08.260 15:04:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.260 15:04:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.260 15:04:06 -- scripts/common.sh@364 -- # decimal 1 00:03:08.260 15:04:06 -- scripts/common.sh@352 -- # local d=1 00:03:08.260 15:04:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.260 15:04:06 -- scripts/common.sh@354 -- # echo 1 00:03:08.260 15:04:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.260 15:04:06 -- scripts/common.sh@365 -- # decimal 2 00:03:08.260 15:04:06 -- scripts/common.sh@352 -- # local d=2 00:03:08.260 15:04:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.260 15:04:06 -- scripts/common.sh@354 -- # echo 2 00:03:08.260 15:04:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.260 15:04:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.260 15:04:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.260 15:04:06 -- scripts/common.sh@367 -- # return 0 00:03:08.260 15:04:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.260 --rc genhtml_branch_coverage=1 00:03:08.260 --rc genhtml_function_coverage=1 00:03:08.260 --rc genhtml_legend=1 00:03:08.260 --rc geninfo_all_blocks=1 00:03:08.260 --rc geninfo_unexecuted_blocks=1 00:03:08.260 00:03:08.260 ' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.260 --rc genhtml_branch_coverage=1 00:03:08.260 --rc genhtml_function_coverage=1 00:03:08.260 --rc genhtml_legend=1 00:03:08.260 --rc geninfo_all_blocks=1 00:03:08.260 --rc geninfo_unexecuted_blocks=1 00:03:08.260 00:03:08.260 ' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.260 --rc genhtml_branch_coverage=1 00:03:08.260 --rc genhtml_function_coverage=1 00:03:08.260 --rc genhtml_legend=1 00:03:08.260 --rc geninfo_all_blocks=1 00:03:08.260 --rc geninfo_unexecuted_blocks=1 00:03:08.260 00:03:08.260 ' 00:03:08.260 15:04:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.260 --rc genhtml_branch_coverage=1 00:03:08.260 --rc genhtml_function_coverage=1 00:03:08.260 --rc genhtml_legend=1 00:03:08.260 --rc geninfo_all_blocks=1 00:03:08.260 --rc geninfo_unexecuted_blocks=1 00:03:08.260 00:03:08.260 ' 00:03:08.260 15:04:06 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:08.260 15:04:06 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:08.260 15:04:06 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:08.260 15:04:06 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:08.260 15:04:06 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:08.260 15:04:06 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:08.260 15:04:06 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:08.260 15:04:06 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:08.260 15:04:06 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:08.260 15:04:06 -- setup/acl.sh@12 -- # devs=() 00:03:08.260 15:04:06 -- setup/acl.sh@12 -- # declare -a devs 00:03:08.260 15:04:06 -- setup/acl.sh@13 -- # drivers=() 00:03:08.260 15:04:06 -- setup/acl.sh@13 -- # declare -A drivers 00:03:08.260 15:04:06 -- setup/acl.sh@51 -- # setup reset 00:03:08.260 15:04:06 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:08.260 15:04:06 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.634 15:04:08 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:09.634 15:04:08 -- setup/acl.sh@16 -- # local dev driver 00:03:09.634 15:04:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:09.634 15:04:08 -- setup/acl.sh@15 -- # setup output status 00:03:09.634 15:04:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:09.634 15:04:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:10.568 Hugepages 00:03:10.568 node hugesize free / total 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 00:03:10.568 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.568 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.568 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.568 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # continue 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:10.828 15:04:09 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:10.828 15:04:09 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:10.828 15:04:09 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:10.828 15:04:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.828 15:04:09 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:10.828 15:04:09 -- setup/acl.sh@54 -- # run_test denied denied 00:03:10.828 15:04:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.828 15:04:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.828 15:04:09 -- common/autotest_common.sh@10 -- # set +x 00:03:10.828 ************************************ 00:03:10.828 START TEST denied 00:03:10.828 ************************************ 00:03:10.828 15:04:09 -- common/autotest_common.sh@1114 -- # denied 00:03:10.828 15:04:09 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:10.828 15:04:09 -- setup/acl.sh@38 -- # setup output config 00:03:10.828 15:04:09 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:10.828 15:04:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.828 15:04:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:12.207 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:12.207 15:04:10 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:12.207 15:04:10 -- setup/acl.sh@28 -- # local dev driver 00:03:12.207 15:04:10 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:12.207 15:04:10 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:12.207 15:04:10 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:12.207 15:04:10 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:12.207 15:04:10 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:12.207 15:04:10 -- setup/acl.sh@41 -- # setup reset 00:03:12.207 15:04:10 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.207 15:04:10 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.742 00:03:14.742 real 0m3.842s 00:03:14.742 user 0m1.158s 00:03:14.742 sys 0m1.801s 00:03:14.742 15:04:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.742 15:04:13 -- common/autotest_common.sh@10 -- # set +x 00:03:14.742 ************************************ 00:03:14.742 END TEST denied 00:03:14.742 ************************************ 00:03:14.742 15:04:13 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:14.742 15:04:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.742 15:04:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.742 15:04:13 -- common/autotest_common.sh@10 -- # set +x 00:03:14.742 ************************************ 00:03:14.742 START TEST allowed 00:03:14.742 ************************************ 00:03:14.742 15:04:13 -- common/autotest_common.sh@1114 -- # allowed 00:03:14.742 15:04:13 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:14.742 15:04:13 -- setup/acl.sh@45 -- # setup output config 00:03:14.742 15:04:13 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:14.742 15:04:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.742 15:04:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:17.278 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:17.278 15:04:15 -- setup/acl.sh@47 -- # verify 00:03:17.278 15:04:15 -- setup/acl.sh@28 -- # local dev driver 00:03:17.278 15:04:15 -- setup/acl.sh@48 -- # setup reset 00:03:17.278 15:04:15 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:17.278 15:04:15 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:18.656 00:03:18.656 real 0m3.871s 00:03:18.656 user 0m0.979s 00:03:18.656 sys 0m1.764s 00:03:18.656 15:04:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:18.656 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:03:18.656 ************************************ 00:03:18.656 END TEST allowed 00:03:18.656 ************************************ 00:03:18.656 00:03:18.656 real 0m10.545s 00:03:18.656 user 0m3.264s 00:03:18.656 sys 0m5.363s 00:03:18.656 15:04:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:18.656 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:03:18.656 ************************************ 00:03:18.656 END TEST acl 00:03:18.656 ************************************ 00:03:18.656 15:04:16 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:18.656 15:04:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.656 15:04:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.656 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:03:18.656 ************************************ 00:03:18.656 START TEST hugepages 00:03:18.656 ************************************ 00:03:18.656 15:04:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:18.656 * Looking for test storage... 00:03:18.656 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:18.656 15:04:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:18.656 15:04:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:18.656 15:04:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:18.656 15:04:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:18.656 15:04:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:18.656 15:04:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:18.656 15:04:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:18.656 15:04:17 -- scripts/common.sh@335 -- # IFS=.-: 00:03:18.656 15:04:17 -- scripts/common.sh@335 -- # read -ra ver1 00:03:18.656 15:04:17 -- scripts/common.sh@336 -- # IFS=.-: 00:03:18.656 15:04:17 -- scripts/common.sh@336 -- # read -ra ver2 00:03:18.656 15:04:17 -- scripts/common.sh@337 -- # local 'op=<' 00:03:18.656 15:04:17 -- scripts/common.sh@339 -- # ver1_l=2 00:03:18.656 15:04:17 -- scripts/common.sh@340 -- # ver2_l=1 00:03:18.656 15:04:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:18.656 15:04:17 -- scripts/common.sh@343 -- # case "$op" in 00:03:18.656 15:04:17 -- scripts/common.sh@344 -- # : 1 00:03:18.656 15:04:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:18.656 15:04:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:18.656 15:04:17 -- scripts/common.sh@364 -- # decimal 1 00:03:18.656 15:04:17 -- scripts/common.sh@352 -- # local d=1 00:03:18.656 15:04:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:18.656 15:04:17 -- scripts/common.sh@354 -- # echo 1 00:03:18.656 15:04:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:18.656 15:04:17 -- scripts/common.sh@365 -- # decimal 2 00:03:18.656 15:04:17 -- scripts/common.sh@352 -- # local d=2 00:03:18.656 15:04:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:18.656 15:04:17 -- scripts/common.sh@354 -- # echo 2 00:03:18.656 15:04:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:18.656 15:04:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:18.656 15:04:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:18.656 15:04:17 -- scripts/common.sh@367 -- # return 0 00:03:18.656 15:04:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:18.656 15:04:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:18.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:18.656 --rc genhtml_branch_coverage=1 00:03:18.656 --rc genhtml_function_coverage=1 00:03:18.656 --rc genhtml_legend=1 00:03:18.656 --rc geninfo_all_blocks=1 00:03:18.656 --rc geninfo_unexecuted_blocks=1 00:03:18.656 00:03:18.656 ' 00:03:18.656 15:04:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:18.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:18.656 --rc genhtml_branch_coverage=1 00:03:18.656 --rc genhtml_function_coverage=1 00:03:18.656 --rc genhtml_legend=1 00:03:18.656 --rc geninfo_all_blocks=1 00:03:18.656 --rc geninfo_unexecuted_blocks=1 00:03:18.656 00:03:18.656 ' 00:03:18.656 15:04:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:18.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:18.656 --rc genhtml_branch_coverage=1 00:03:18.656 --rc genhtml_function_coverage=1 00:03:18.656 --rc genhtml_legend=1 00:03:18.656 --rc geninfo_all_blocks=1 00:03:18.656 --rc geninfo_unexecuted_blocks=1 00:03:18.656 00:03:18.656 ' 00:03:18.656 15:04:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:18.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:18.656 --rc genhtml_branch_coverage=1 00:03:18.656 --rc genhtml_function_coverage=1 00:03:18.656 --rc genhtml_legend=1 00:03:18.656 --rc geninfo_all_blocks=1 00:03:18.656 --rc geninfo_unexecuted_blocks=1 00:03:18.656 00:03:18.656 ' 00:03:18.656 15:04:17 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:18.657 15:04:17 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:18.657 15:04:17 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:18.657 15:04:17 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:18.657 15:04:17 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:18.657 15:04:17 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:18.657 15:04:17 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:18.657 15:04:17 -- setup/common.sh@18 -- # local node= 00:03:18.657 15:04:17 -- setup/common.sh@19 -- # local var val 00:03:18.657 15:04:17 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.657 15:04:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.657 15:04:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.657 15:04:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.657 15:04:17 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.657 15:04:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43089940 kB' 'MemAvailable: 46848328 kB' 'Buffers: 2708 kB' 'Cached: 10714252 kB' 'SwapCached: 0 kB' 'Active: 7462188 kB' 'Inactive: 3759596 kB' 'Active(anon): 7064008 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 508288 kB' 'Mapped: 205760 kB' 'Shmem: 6559184 kB' 'KReclaimable: 188384 kB' 'Slab: 717508 kB' 'SReclaimable: 188384 kB' 'SUnreclaim: 529124 kB' 'KernelStack: 12752 kB' 'PageTables: 8452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 8128092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198188 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.657 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.657 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # continue 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.658 15:04:17 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.658 15:04:17 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:18.658 15:04:17 -- setup/common.sh@33 -- # echo 2048 00:03:18.658 15:04:17 -- setup/common.sh@33 -- # return 0 00:03:18.658 15:04:17 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:18.658 15:04:17 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:18.658 15:04:17 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:18.658 15:04:17 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:18.658 15:04:17 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:18.658 15:04:17 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:18.658 15:04:17 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:18.658 15:04:17 -- setup/hugepages.sh@207 -- # get_nodes 00:03:18.658 15:04:17 -- setup/hugepages.sh@27 -- # local node 00:03:18.658 15:04:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.658 15:04:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:18.658 15:04:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.658 15:04:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:18.658 15:04:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.658 15:04:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.658 15:04:17 -- setup/hugepages.sh@208 -- # clear_hp 00:03:18.658 15:04:17 -- setup/hugepages.sh@37 -- # local node hp 00:03:18.659 15:04:17 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:18.659 15:04:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:18.659 15:04:17 -- setup/hugepages.sh@41 -- # echo 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:18.659 15:04:17 -- setup/hugepages.sh@41 -- # echo 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:18.659 15:04:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:18.659 15:04:17 -- setup/hugepages.sh@41 -- # echo 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:18.659 15:04:17 -- setup/hugepages.sh@41 -- # echo 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:18.659 15:04:17 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:18.659 15:04:17 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:18.659 15:04:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.659 15:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.659 15:04:17 -- common/autotest_common.sh@10 -- # set +x 00:03:18.659 ************************************ 00:03:18.659 START TEST default_setup 00:03:18.659 ************************************ 00:03:18.659 15:04:17 -- common/autotest_common.sh@1114 -- # default_setup 00:03:18.659 15:04:17 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:18.659 15:04:17 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:18.659 15:04:17 -- setup/hugepages.sh@51 -- # shift 00:03:18.659 15:04:17 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:18.659 15:04:17 -- setup/hugepages.sh@52 -- # local node_ids 00:03:18.659 15:04:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.659 15:04:17 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:18.659 15:04:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:18.659 15:04:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.659 15:04:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.659 15:04:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.659 15:04:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.659 15:04:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.659 15:04:17 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:18.659 15:04:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:18.659 15:04:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:18.659 15:04:17 -- setup/hugepages.sh@73 -- # return 0 00:03:18.659 15:04:17 -- setup/hugepages.sh@137 -- # setup output 00:03:18.659 15:04:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.659 15:04:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.035 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.035 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.035 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:20.974 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:20.974 15:04:19 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:20.974 15:04:19 -- setup/hugepages.sh@89 -- # local node 00:03:20.974 15:04:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.974 15:04:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.974 15:04:19 -- setup/hugepages.sh@92 -- # local surp 00:03:20.974 15:04:19 -- setup/hugepages.sh@93 -- # local resv 00:03:20.974 15:04:19 -- setup/hugepages.sh@94 -- # local anon 00:03:20.974 15:04:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.974 15:04:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.975 15:04:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.975 15:04:19 -- setup/common.sh@18 -- # local node= 00:03:20.975 15:04:19 -- setup/common.sh@19 -- # local var val 00:03:20.975 15:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.975 15:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.975 15:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.975 15:04:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.975 15:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.975 15:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45210204 kB' 'MemAvailable: 48968560 kB' 'Buffers: 2708 kB' 'Cached: 10714344 kB' 'SwapCached: 0 kB' 'Active: 7461112 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062932 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506444 kB' 'Mapped: 204988 kB' 'Shmem: 6559276 kB' 'KReclaimable: 188320 kB' 'Slab: 717236 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528916 kB' 'KernelStack: 12784 kB' 'PageTables: 8260 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.975 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.975 15:04:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.976 15:04:19 -- setup/common.sh@33 -- # echo 0 00:03:20.976 15:04:19 -- setup/common.sh@33 -- # return 0 00:03:20.976 15:04:19 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.976 15:04:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.976 15:04:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.976 15:04:19 -- setup/common.sh@18 -- # local node= 00:03:20.976 15:04:19 -- setup/common.sh@19 -- # local var val 00:03:20.976 15:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.976 15:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.976 15:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.976 15:04:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.976 15:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.976 15:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45214172 kB' 'MemAvailable: 48972528 kB' 'Buffers: 2708 kB' 'Cached: 10714348 kB' 'SwapCached: 0 kB' 'Active: 7460984 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062804 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506372 kB' 'Mapped: 204504 kB' 'Shmem: 6559280 kB' 'KReclaimable: 188320 kB' 'Slab: 717312 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528992 kB' 'KernelStack: 12784 kB' 'PageTables: 8284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.976 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.976 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.977 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.977 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.978 15:04:19 -- setup/common.sh@33 -- # echo 0 00:03:20.978 15:04:19 -- setup/common.sh@33 -- # return 0 00:03:20.978 15:04:19 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.978 15:04:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.978 15:04:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.978 15:04:19 -- setup/common.sh@18 -- # local node= 00:03:20.978 15:04:19 -- setup/common.sh@19 -- # local var val 00:03:20.978 15:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.978 15:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.978 15:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.978 15:04:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.978 15:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.978 15:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45214468 kB' 'MemAvailable: 48972824 kB' 'Buffers: 2708 kB' 'Cached: 10714360 kB' 'SwapCached: 0 kB' 'Active: 7460108 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061928 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505892 kB' 'Mapped: 204432 kB' 'Shmem: 6559292 kB' 'KReclaimable: 188320 kB' 'Slab: 717316 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528996 kB' 'KernelStack: 12848 kB' 'PageTables: 8384 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129200 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.978 15:04:19 -- setup/common.sh@32 -- # continue 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.978 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.239 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.239 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.240 15:04:19 -- setup/common.sh@33 -- # echo 0 00:03:21.240 15:04:19 -- setup/common.sh@33 -- # return 0 00:03:21.240 15:04:19 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.240 15:04:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:21.240 nr_hugepages=1024 00:03:21.240 15:04:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.240 resv_hugepages=0 00:03:21.240 15:04:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.240 surplus_hugepages=0 00:03:21.240 15:04:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.240 anon_hugepages=0 00:03:21.240 15:04:19 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.240 15:04:19 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:21.240 15:04:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.240 15:04:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.240 15:04:19 -- setup/common.sh@18 -- # local node= 00:03:21.240 15:04:19 -- setup/common.sh@19 -- # local var val 00:03:21.240 15:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.240 15:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.240 15:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.240 15:04:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.240 15:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.240 15:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.240 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.240 15:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45214300 kB' 'MemAvailable: 48972656 kB' 'Buffers: 2708 kB' 'Cached: 10714372 kB' 'SwapCached: 0 kB' 'Active: 7460236 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062056 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506040 kB' 'Mapped: 204432 kB' 'Shmem: 6559304 kB' 'KReclaimable: 188320 kB' 'Slab: 717372 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529052 kB' 'KernelStack: 12800 kB' 'PageTables: 8292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129216 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.241 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.241 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.242 15:04:19 -- setup/common.sh@33 -- # echo 1024 00:03:21.242 15:04:19 -- setup/common.sh@33 -- # return 0 00:03:21.242 15:04:19 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.242 15:04:19 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.242 15:04:19 -- setup/hugepages.sh@27 -- # local node 00:03:21.242 15:04:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.242 15:04:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.242 15:04:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.242 15:04:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.242 15:04:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.242 15:04:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.242 15:04:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.242 15:04:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.242 15:04:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.242 15:04:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.242 15:04:19 -- setup/common.sh@18 -- # local node=0 00:03:21.242 15:04:19 -- setup/common.sh@19 -- # local var val 00:03:21.242 15:04:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.242 15:04:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.242 15:04:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.242 15:04:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.242 15:04:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.242 15:04:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21226644 kB' 'MemUsed: 11599212 kB' 'SwapCached: 0 kB' 'Active: 4894884 kB' 'Inactive: 3581012 kB' 'Active(anon): 4736544 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8286832 kB' 'Mapped: 37216 kB' 'AnonPages: 192232 kB' 'Shmem: 4547480 kB' 'KernelStack: 6520 kB' 'PageTables: 3424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376136 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287308 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.242 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.242 15:04:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # continue 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.243 15:04:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.243 15:04:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.243 15:04:19 -- setup/common.sh@33 -- # echo 0 00:03:21.243 15:04:19 -- setup/common.sh@33 -- # return 0 00:03:21.243 15:04:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.243 15:04:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.243 15:04:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.243 15:04:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.243 15:04:19 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:21.243 node0=1024 expecting 1024 00:03:21.243 15:04:19 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:21.243 00:03:21.243 real 0m2.415s 00:03:21.243 user 0m0.631s 00:03:21.243 sys 0m0.909s 00:03:21.243 15:04:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.243 15:04:19 -- common/autotest_common.sh@10 -- # set +x 00:03:21.243 ************************************ 00:03:21.243 END TEST default_setup 00:03:21.243 ************************************ 00:03:21.243 15:04:19 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:21.243 15:04:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.243 15:04:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.243 15:04:19 -- common/autotest_common.sh@10 -- # set +x 00:03:21.243 ************************************ 00:03:21.243 START TEST per_node_1G_alloc 00:03:21.243 ************************************ 00:03:21.243 15:04:19 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:21.243 15:04:19 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:21.243 15:04:19 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:21.243 15:04:19 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:21.243 15:04:19 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:21.243 15:04:19 -- setup/hugepages.sh@51 -- # shift 00:03:21.243 15:04:19 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:21.243 15:04:19 -- setup/hugepages.sh@52 -- # local node_ids 00:03:21.243 15:04:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.243 15:04:19 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:21.243 15:04:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:21.243 15:04:19 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:21.243 15:04:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.243 15:04:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:21.243 15:04:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.243 15:04:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.243 15:04:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.243 15:04:19 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:21.243 15:04:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:21.243 15:04:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:21.243 15:04:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:21.243 15:04:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:21.243 15:04:19 -- setup/hugepages.sh@73 -- # return 0 00:03:21.243 15:04:19 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:21.243 15:04:19 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:21.243 15:04:19 -- setup/hugepages.sh@146 -- # setup output 00:03:21.243 15:04:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.243 15:04:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.178 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.178 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.178 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.178 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.178 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.178 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.178 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.178 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.178 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.178 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.178 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.178 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.178 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.178 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.178 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.178 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.178 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.442 15:04:20 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:22.442 15:04:20 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:22.442 15:04:20 -- setup/hugepages.sh@89 -- # local node 00:03:22.442 15:04:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.442 15:04:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.442 15:04:20 -- setup/hugepages.sh@92 -- # local surp 00:03:22.442 15:04:20 -- setup/hugepages.sh@93 -- # local resv 00:03:22.442 15:04:20 -- setup/hugepages.sh@94 -- # local anon 00:03:22.442 15:04:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.442 15:04:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.442 15:04:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.442 15:04:20 -- setup/common.sh@18 -- # local node= 00:03:22.442 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.442 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.442 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.442 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.442 15:04:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.442 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.442 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.442 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45205752 kB' 'MemAvailable: 48964108 kB' 'Buffers: 2708 kB' 'Cached: 10714432 kB' 'SwapCached: 0 kB' 'Active: 7460544 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062364 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506252 kB' 'Mapped: 204448 kB' 'Shmem: 6559364 kB' 'KReclaimable: 188320 kB' 'Slab: 717788 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529468 kB' 'KernelStack: 12800 kB' 'PageTables: 8220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.442 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.442 15:04:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.443 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.443 15:04:20 -- setup/common.sh@33 -- # echo 0 00:03:22.443 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.443 15:04:20 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.443 15:04:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.443 15:04:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.443 15:04:20 -- setup/common.sh@18 -- # local node= 00:03:22.443 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.443 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.443 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.443 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.443 15:04:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.443 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.443 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.443 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45206656 kB' 'MemAvailable: 48965012 kB' 'Buffers: 2708 kB' 'Cached: 10714436 kB' 'SwapCached: 0 kB' 'Active: 7460436 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062256 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506132 kB' 'Mapped: 204440 kB' 'Shmem: 6559368 kB' 'KReclaimable: 188320 kB' 'Slab: 717776 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529456 kB' 'KernelStack: 12816 kB' 'PageTables: 8224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.444 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.444 15:04:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.445 15:04:20 -- setup/common.sh@33 -- # echo 0 00:03:22.445 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.445 15:04:20 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.445 15:04:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.445 15:04:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.445 15:04:20 -- setup/common.sh@18 -- # local node= 00:03:22.445 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.445 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.445 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.445 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.445 15:04:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.445 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.445 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45207408 kB' 'MemAvailable: 48965764 kB' 'Buffers: 2708 kB' 'Cached: 10714444 kB' 'SwapCached: 0 kB' 'Active: 7460056 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061876 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505704 kB' 'Mapped: 204440 kB' 'Shmem: 6559376 kB' 'KReclaimable: 188320 kB' 'Slab: 717832 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529512 kB' 'KernelStack: 12784 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.445 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.445 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.446 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.446 15:04:20 -- setup/common.sh@33 -- # echo 0 00:03:22.446 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.446 15:04:20 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.446 15:04:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.446 nr_hugepages=1024 00:03:22.446 15:04:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.446 resv_hugepages=0 00:03:22.446 15:04:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.446 surplus_hugepages=0 00:03:22.446 15:04:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.446 anon_hugepages=0 00:03:22.446 15:04:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.446 15:04:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.446 15:04:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.446 15:04:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.446 15:04:20 -- setup/common.sh@18 -- # local node= 00:03:22.446 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.446 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.446 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.446 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.446 15:04:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.446 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.446 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.446 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45207408 kB' 'MemAvailable: 48965764 kB' 'Buffers: 2708 kB' 'Cached: 10714448 kB' 'SwapCached: 0 kB' 'Active: 7460196 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062016 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505848 kB' 'Mapped: 204440 kB' 'Shmem: 6559380 kB' 'KReclaimable: 188320 kB' 'Slab: 717832 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529512 kB' 'KernelStack: 12784 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.447 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.447 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.448 15:04:20 -- setup/common.sh@33 -- # echo 1024 00:03:22.448 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.448 15:04:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.448 15:04:20 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.448 15:04:20 -- setup/hugepages.sh@27 -- # local node 00:03:22.448 15:04:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.448 15:04:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:22.448 15:04:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.448 15:04:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:22.448 15:04:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.448 15:04:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.448 15:04:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.448 15:04:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.448 15:04:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.448 15:04:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.448 15:04:20 -- setup/common.sh@18 -- # local node=0 00:03:22.448 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.448 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.448 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.448 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.448 15:04:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.448 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.448 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 22268384 kB' 'MemUsed: 10557472 kB' 'SwapCached: 0 kB' 'Active: 4895128 kB' 'Inactive: 3581012 kB' 'Active(anon): 4736788 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8286844 kB' 'Mapped: 37216 kB' 'AnonPages: 192436 kB' 'Shmem: 4547492 kB' 'KernelStack: 6520 kB' 'PageTables: 3412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376480 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287652 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.448 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.448 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@33 -- # echo 0 00:03:22.449 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.449 15:04:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.449 15:04:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.449 15:04:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.449 15:04:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:22.449 15:04:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.449 15:04:20 -- setup/common.sh@18 -- # local node=1 00:03:22.449 15:04:20 -- setup/common.sh@19 -- # local var val 00:03:22.449 15:04:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.449 15:04:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.449 15:04:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:22.449 15:04:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:22.449 15:04:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.449 15:04:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22939536 kB' 'MemUsed: 4770272 kB' 'SwapCached: 0 kB' 'Active: 2565212 kB' 'Inactive: 178584 kB' 'Active(anon): 2325372 kB' 'Inactive(anon): 0 kB' 'Active(file): 239840 kB' 'Inactive(file): 178584 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2430348 kB' 'Mapped: 167224 kB' 'AnonPages: 313516 kB' 'Shmem: 2011924 kB' 'KernelStack: 6264 kB' 'PageTables: 4760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99492 kB' 'Slab: 341352 kB' 'SReclaimable: 99492 kB' 'SUnreclaim: 241860 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.449 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.449 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # continue 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.450 15:04:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.450 15:04:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.450 15:04:20 -- setup/common.sh@33 -- # echo 0 00:03:22.450 15:04:20 -- setup/common.sh@33 -- # return 0 00:03:22.450 15:04:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.450 15:04:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.450 15:04:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.450 15:04:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.450 15:04:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:22.450 node0=512 expecting 512 00:03:22.450 15:04:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.450 15:04:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.450 15:04:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.450 15:04:20 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:22.450 node1=512 expecting 512 00:03:22.450 15:04:20 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:22.450 00:03:22.450 real 0m1.349s 00:03:22.450 user 0m0.559s 00:03:22.450 sys 0m0.751s 00:03:22.450 15:04:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.450 15:04:20 -- common/autotest_common.sh@10 -- # set +x 00:03:22.450 ************************************ 00:03:22.450 END TEST per_node_1G_alloc 00:03:22.450 ************************************ 00:03:22.709 15:04:21 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:22.709 15:04:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.709 15:04:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.709 15:04:21 -- common/autotest_common.sh@10 -- # set +x 00:03:22.709 ************************************ 00:03:22.709 START TEST even_2G_alloc 00:03:22.709 ************************************ 00:03:22.709 15:04:21 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:22.709 15:04:21 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:22.709 15:04:21 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:22.709 15:04:21 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:22.709 15:04:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:22.709 15:04:21 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:22.709 15:04:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.709 15:04:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:22.709 15:04:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.709 15:04:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.709 15:04:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.709 15:04:21 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:22.709 15:04:21 -- setup/hugepages.sh@83 -- # : 512 00:03:22.709 15:04:21 -- setup/hugepages.sh@84 -- # : 1 00:03:22.709 15:04:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:22.709 15:04:21 -- setup/hugepages.sh@83 -- # : 0 00:03:22.709 15:04:21 -- setup/hugepages.sh@84 -- # : 0 00:03:22.709 15:04:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.709 15:04:21 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:22.709 15:04:21 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:22.709 15:04:21 -- setup/hugepages.sh@153 -- # setup output 00:03:22.709 15:04:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.709 15:04:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.643 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.643 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.643 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.643 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.643 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.643 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.643 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.643 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.643 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.643 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.643 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.643 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.643 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.643 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.643 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.643 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.643 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.905 15:04:22 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:23.905 15:04:22 -- setup/hugepages.sh@89 -- # local node 00:03:23.905 15:04:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.905 15:04:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.905 15:04:22 -- setup/hugepages.sh@92 -- # local surp 00:03:23.905 15:04:22 -- setup/hugepages.sh@93 -- # local resv 00:03:23.905 15:04:22 -- setup/hugepages.sh@94 -- # local anon 00:03:23.905 15:04:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.905 15:04:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.905 15:04:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.905 15:04:22 -- setup/common.sh@18 -- # local node= 00:03:23.905 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:23.905 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.905 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.905 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.905 15:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.905 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.905 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.905 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45190216 kB' 'MemAvailable: 48948572 kB' 'Buffers: 2708 kB' 'Cached: 10714524 kB' 'SwapCached: 0 kB' 'Active: 7460616 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062436 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506176 kB' 'Mapped: 204480 kB' 'Shmem: 6559456 kB' 'KReclaimable: 188320 kB' 'Slab: 717508 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529188 kB' 'KernelStack: 12800 kB' 'PageTables: 8184 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:23.905 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.905 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.905 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.905 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.905 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.906 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.906 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.907 15:04:22 -- setup/common.sh@33 -- # echo 0 00:03:23.907 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:23.907 15:04:22 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.907 15:04:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.907 15:04:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.907 15:04:22 -- setup/common.sh@18 -- # local node= 00:03:23.907 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:23.907 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.907 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.907 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.907 15:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.907 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.907 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45208524 kB' 'MemAvailable: 48966880 kB' 'Buffers: 2708 kB' 'Cached: 10714528 kB' 'SwapCached: 0 kB' 'Active: 7460636 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062456 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506244 kB' 'Mapped: 204520 kB' 'Shmem: 6559460 kB' 'KReclaimable: 188320 kB' 'Slab: 717616 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529296 kB' 'KernelStack: 12832 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.907 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.907 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.908 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.908 15:04:22 -- setup/common.sh@33 -- # echo 0 00:03:23.908 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:23.908 15:04:22 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.908 15:04:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.908 15:04:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.908 15:04:22 -- setup/common.sh@18 -- # local node= 00:03:23.908 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:23.908 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.908 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.908 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.908 15:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.908 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.908 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.908 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45209324 kB' 'MemAvailable: 48967680 kB' 'Buffers: 2708 kB' 'Cached: 10714536 kB' 'SwapCached: 0 kB' 'Active: 7460260 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062080 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505796 kB' 'Mapped: 204444 kB' 'Shmem: 6559468 kB' 'KReclaimable: 188320 kB' 'Slab: 717600 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529280 kB' 'KernelStack: 12816 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.909 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.909 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.910 15:04:22 -- setup/common.sh@33 -- # echo 0 00:03:23.910 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:23.910 15:04:22 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.910 15:04:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.910 nr_hugepages=1024 00:03:23.910 15:04:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.910 resv_hugepages=0 00:03:23.910 15:04:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.910 surplus_hugepages=0 00:03:23.910 15:04:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.910 anon_hugepages=0 00:03:23.910 15:04:22 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.910 15:04:22 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.910 15:04:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.910 15:04:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.910 15:04:22 -- setup/common.sh@18 -- # local node= 00:03:23.910 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:23.910 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.910 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.910 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.910 15:04:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.910 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.910 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45208596 kB' 'MemAvailable: 48966952 kB' 'Buffers: 2708 kB' 'Cached: 10714552 kB' 'SwapCached: 0 kB' 'Active: 7460492 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062312 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506052 kB' 'Mapped: 204444 kB' 'Shmem: 6559484 kB' 'KReclaimable: 188320 kB' 'Slab: 717600 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529280 kB' 'KernelStack: 12816 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8129520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.910 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.910 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.911 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.911 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.912 15:04:22 -- setup/common.sh@33 -- # echo 1024 00:03:23.912 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:23.912 15:04:22 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.912 15:04:22 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.912 15:04:22 -- setup/hugepages.sh@27 -- # local node 00:03:23.912 15:04:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.912 15:04:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.912 15:04:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.912 15:04:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.912 15:04:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.912 15:04:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.912 15:04:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.912 15:04:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.912 15:04:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.912 15:04:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.912 15:04:22 -- setup/common.sh@18 -- # local node=0 00:03:23.912 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:23.912 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.912 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.912 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.912 15:04:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.912 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.912 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 22265960 kB' 'MemUsed: 10559896 kB' 'SwapCached: 0 kB' 'Active: 4895464 kB' 'Inactive: 3581012 kB' 'Active(anon): 4737124 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8286856 kB' 'Mapped: 37216 kB' 'AnonPages: 192748 kB' 'Shmem: 4547504 kB' 'KernelStack: 6520 kB' 'PageTables: 3412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376356 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287528 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.912 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.912 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.913 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.913 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@33 -- # echo 0 00:03:24.173 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:24.173 15:04:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.173 15:04:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.173 15:04:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.173 15:04:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:24.173 15:04:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.173 15:04:22 -- setup/common.sh@18 -- # local node=1 00:03:24.173 15:04:22 -- setup/common.sh@19 -- # local var val 00:03:24.173 15:04:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.173 15:04:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.173 15:04:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:24.173 15:04:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:24.173 15:04:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.173 15:04:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22942132 kB' 'MemUsed: 4767676 kB' 'SwapCached: 0 kB' 'Active: 2565304 kB' 'Inactive: 178584 kB' 'Active(anon): 2325464 kB' 'Inactive(anon): 0 kB' 'Active(file): 239840 kB' 'Inactive(file): 178584 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2430420 kB' 'Mapped: 167228 kB' 'AnonPages: 313528 kB' 'Shmem: 2011996 kB' 'KernelStack: 6312 kB' 'PageTables: 4812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99492 kB' 'Slab: 341244 kB' 'SReclaimable: 99492 kB' 'SUnreclaim: 241752 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.173 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.173 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # continue 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.174 15:04:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.174 15:04:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.174 15:04:22 -- setup/common.sh@33 -- # echo 0 00:03:24.174 15:04:22 -- setup/common.sh@33 -- # return 0 00:03:24.174 15:04:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.174 15:04:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.174 15:04:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.174 15:04:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.174 15:04:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:24.174 node0=512 expecting 512 00:03:24.174 15:04:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.174 15:04:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.174 15:04:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.174 15:04:22 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:24.174 node1=512 expecting 512 00:03:24.174 15:04:22 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:24.174 00:03:24.174 real 0m1.492s 00:03:24.174 user 0m0.618s 00:03:24.174 sys 0m0.843s 00:03:24.174 15:04:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:24.174 15:04:22 -- common/autotest_common.sh@10 -- # set +x 00:03:24.174 ************************************ 00:03:24.174 END TEST even_2G_alloc 00:03:24.174 ************************************ 00:03:24.174 15:04:22 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:24.174 15:04:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:24.174 15:04:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:24.175 15:04:22 -- common/autotest_common.sh@10 -- # set +x 00:03:24.175 ************************************ 00:03:24.175 START TEST odd_alloc 00:03:24.175 ************************************ 00:03:24.175 15:04:22 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:24.175 15:04:22 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:24.175 15:04:22 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:24.175 15:04:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:24.175 15:04:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:24.175 15:04:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:24.175 15:04:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:24.175 15:04:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:24.175 15:04:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:24.175 15:04:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:24.175 15:04:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:24.175 15:04:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:24.175 15:04:22 -- setup/hugepages.sh@83 -- # : 513 00:03:24.175 15:04:22 -- setup/hugepages.sh@84 -- # : 1 00:03:24.175 15:04:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:24.175 15:04:22 -- setup/hugepages.sh@83 -- # : 0 00:03:24.175 15:04:22 -- setup/hugepages.sh@84 -- # : 0 00:03:24.175 15:04:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:24.175 15:04:22 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:24.175 15:04:22 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:24.175 15:04:22 -- setup/hugepages.sh@160 -- # setup output 00:03:24.175 15:04:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:24.175 15:04:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.165 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.165 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:25.165 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.165 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.165 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.165 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.165 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.165 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.165 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.165 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.165 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.165 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.165 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.165 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.165 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.165 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.165 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.443 15:04:23 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:25.443 15:04:23 -- setup/hugepages.sh@89 -- # local node 00:03:25.443 15:04:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:25.443 15:04:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:25.443 15:04:23 -- setup/hugepages.sh@92 -- # local surp 00:03:25.443 15:04:23 -- setup/hugepages.sh@93 -- # local resv 00:03:25.443 15:04:23 -- setup/hugepages.sh@94 -- # local anon 00:03:25.443 15:04:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:25.443 15:04:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:25.443 15:04:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:25.443 15:04:23 -- setup/common.sh@18 -- # local node= 00:03:25.443 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.443 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.443 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.443 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.443 15:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.443 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.443 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45191336 kB' 'MemAvailable: 48949692 kB' 'Buffers: 2708 kB' 'Cached: 10714612 kB' 'SwapCached: 0 kB' 'Active: 7459156 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060976 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504688 kB' 'Mapped: 203368 kB' 'Shmem: 6559544 kB' 'KReclaimable: 188320 kB' 'Slab: 717420 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529100 kB' 'KernelStack: 12768 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8119156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.443 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.443 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.444 15:04:23 -- setup/common.sh@33 -- # echo 0 00:03:25.444 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.444 15:04:23 -- setup/hugepages.sh@97 -- # anon=0 00:03:25.444 15:04:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:25.444 15:04:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.444 15:04:23 -- setup/common.sh@18 -- # local node= 00:03:25.444 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.444 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.444 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.444 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.444 15:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.444 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.444 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45194532 kB' 'MemAvailable: 48952888 kB' 'Buffers: 2708 kB' 'Cached: 10714616 kB' 'SwapCached: 0 kB' 'Active: 7460116 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061936 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505736 kB' 'Mapped: 203496 kB' 'Shmem: 6559548 kB' 'KReclaimable: 188320 kB' 'Slab: 717484 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529164 kB' 'KernelStack: 12928 kB' 'PageTables: 8132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8120916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.444 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.444 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.444 15:04:23 -- setup/common.sh@33 -- # echo 0 00:03:25.444 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.444 15:04:23 -- setup/hugepages.sh@99 -- # surp=0 00:03:25.444 15:04:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:25.445 15:04:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:25.445 15:04:23 -- setup/common.sh@18 -- # local node= 00:03:25.445 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.445 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.445 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.445 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.445 15:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.445 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.445 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45196004 kB' 'MemAvailable: 48954360 kB' 'Buffers: 2708 kB' 'Cached: 10714620 kB' 'SwapCached: 0 kB' 'Active: 7460064 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061884 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505688 kB' 'Mapped: 203440 kB' 'Shmem: 6559552 kB' 'KReclaimable: 188320 kB' 'Slab: 717484 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529164 kB' 'KernelStack: 13088 kB' 'PageTables: 8760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8120948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198648 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.445 15:04:23 -- setup/common.sh@33 -- # echo 0 00:03:25.445 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.445 15:04:23 -- setup/hugepages.sh@100 -- # resv=0 00:03:25.445 15:04:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:25.445 nr_hugepages=1025 00:03:25.445 15:04:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:25.445 resv_hugepages=0 00:03:25.445 15:04:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:25.445 surplus_hugepages=0 00:03:25.445 15:04:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:25.445 anon_hugepages=0 00:03:25.445 15:04:23 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:25.445 15:04:23 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:25.445 15:04:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:25.445 15:04:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:25.445 15:04:23 -- setup/common.sh@18 -- # local node= 00:03:25.445 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.445 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.445 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.445 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.445 15:04:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.445 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.445 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45194824 kB' 'MemAvailable: 48953180 kB' 'Buffers: 2708 kB' 'Cached: 10714652 kB' 'SwapCached: 0 kB' 'Active: 7460568 kB' 'Inactive: 3759596 kB' 'Active(anon): 7062388 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506104 kB' 'Mapped: 203800 kB' 'Shmem: 6559584 kB' 'KReclaimable: 188320 kB' 'Slab: 717460 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 529140 kB' 'KernelStack: 13040 kB' 'PageTables: 9020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8123816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198584 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.445 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.445 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.446 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.446 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.446 15:04:23 -- setup/common.sh@33 -- # echo 1025 00:03:25.446 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.446 15:04:23 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:25.446 15:04:23 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.446 15:04:23 -- setup/hugepages.sh@27 -- # local node 00:03:25.446 15:04:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.446 15:04:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.446 15:04:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.446 15:04:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:25.447 15:04:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.447 15:04:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.447 15:04:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.447 15:04:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.447 15:04:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.447 15:04:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.447 15:04:23 -- setup/common.sh@18 -- # local node=0 00:03:25.447 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.447 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.447 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.447 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.447 15:04:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.447 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.447 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 22257320 kB' 'MemUsed: 10568536 kB' 'SwapCached: 0 kB' 'Active: 4900496 kB' 'Inactive: 3581012 kB' 'Active(anon): 4742156 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8286860 kB' 'Mapped: 36532 kB' 'AnonPages: 197436 kB' 'Shmem: 4547508 kB' 'KernelStack: 6648 kB' 'PageTables: 5100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376324 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287496 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@33 -- # echo 0 00:03:25.447 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.447 15:04:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.447 15:04:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.447 15:04:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.447 15:04:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:25.447 15:04:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.447 15:04:23 -- setup/common.sh@18 -- # local node=1 00:03:25.447 15:04:23 -- setup/common.sh@19 -- # local var val 00:03:25.447 15:04:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.447 15:04:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.447 15:04:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:25.447 15:04:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:25.447 15:04:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.447 15:04:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22936224 kB' 'MemUsed: 4773584 kB' 'SwapCached: 0 kB' 'Active: 2564412 kB' 'Inactive: 178584 kB' 'Active(anon): 2324572 kB' 'Inactive(anon): 0 kB' 'Active(file): 239840 kB' 'Inactive(file): 178584 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2430508 kB' 'Mapped: 167532 kB' 'AnonPages: 312520 kB' 'Shmem: 2012084 kB' 'KernelStack: 6296 kB' 'PageTables: 4632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99492 kB' 'Slab: 341136 kB' 'SReclaimable: 99492 kB' 'SUnreclaim: 241644 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.447 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.447 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # continue 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.448 15:04:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.448 15:04:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.448 15:04:23 -- setup/common.sh@33 -- # echo 0 00:03:25.448 15:04:23 -- setup/common.sh@33 -- # return 0 00:03:25.448 15:04:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.448 15:04:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.448 15:04:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.448 15:04:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.448 15:04:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:25.448 node0=512 expecting 513 00:03:25.448 15:04:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.448 15:04:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.448 15:04:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.448 15:04:23 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:25.448 node1=513 expecting 512 00:03:25.448 15:04:23 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:25.448 00:03:25.448 real 0m1.472s 00:03:25.448 user 0m0.602s 00:03:25.448 sys 0m0.837s 00:03:25.448 15:04:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.448 15:04:23 -- common/autotest_common.sh@10 -- # set +x 00:03:25.448 ************************************ 00:03:25.448 END TEST odd_alloc 00:03:25.448 ************************************ 00:03:25.706 15:04:24 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:25.706 15:04:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.706 15:04:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.706 15:04:24 -- common/autotest_common.sh@10 -- # set +x 00:03:25.706 ************************************ 00:03:25.706 START TEST custom_alloc 00:03:25.706 ************************************ 00:03:25.706 15:04:24 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:25.706 15:04:24 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:25.706 15:04:24 -- setup/hugepages.sh@169 -- # local node 00:03:25.706 15:04:24 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:25.706 15:04:24 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:25.706 15:04:24 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:25.706 15:04:24 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:25.706 15:04:24 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:25.706 15:04:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.706 15:04:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:25.706 15:04:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.706 15:04:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:25.706 15:04:24 -- setup/hugepages.sh@83 -- # : 256 00:03:25.706 15:04:24 -- setup/hugepages.sh@84 -- # : 1 00:03:25.706 15:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:25.706 15:04:24 -- setup/hugepages.sh@83 -- # : 0 00:03:25.706 15:04:24 -- setup/hugepages.sh@84 -- # : 0 00:03:25.706 15:04:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:25.706 15:04:24 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:25.706 15:04:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:25.706 15:04:24 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:25.706 15:04:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.706 15:04:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:25.706 15:04:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.706 15:04:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:25.706 15:04:24 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:25.706 15:04:24 -- setup/hugepages.sh@78 -- # return 0 00:03:25.706 15:04:24 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:25.706 15:04:24 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:25.706 15:04:24 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:25.706 15:04:24 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:25.706 15:04:24 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:25.706 15:04:24 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.706 15:04:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:25.706 15:04:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.706 15:04:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.706 15:04:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:25.706 15:04:24 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:25.706 15:04:24 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:25.706 15:04:24 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:25.706 15:04:24 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:25.706 15:04:24 -- setup/hugepages.sh@78 -- # return 0 00:03:25.706 15:04:24 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:25.706 15:04:24 -- setup/hugepages.sh@187 -- # setup output 00:03:25.706 15:04:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.706 15:04:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.640 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.640 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.640 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.640 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.640 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.640 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.640 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.640 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.640 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.640 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.640 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.640 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.640 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.640 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.640 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.640 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.640 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.901 15:04:25 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:26.901 15:04:25 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:26.901 15:04:25 -- setup/hugepages.sh@89 -- # local node 00:03:26.901 15:04:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.901 15:04:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.901 15:04:25 -- setup/hugepages.sh@92 -- # local surp 00:03:26.901 15:04:25 -- setup/hugepages.sh@93 -- # local resv 00:03:26.901 15:04:25 -- setup/hugepages.sh@94 -- # local anon 00:03:26.901 15:04:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.901 15:04:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.901 15:04:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.901 15:04:25 -- setup/common.sh@18 -- # local node= 00:03:26.901 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:26.901 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.901 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.901 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.901 15:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.901 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.901 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44145500 kB' 'MemAvailable: 47903856 kB' 'Buffers: 2708 kB' 'Cached: 10714712 kB' 'SwapCached: 0 kB' 'Active: 7459388 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061208 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504348 kB' 'Mapped: 203428 kB' 'Shmem: 6559644 kB' 'KReclaimable: 188320 kB' 'Slab: 717252 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528932 kB' 'KernelStack: 12784 kB' 'PageTables: 7904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8118484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.901 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.901 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.902 15:04:25 -- setup/common.sh@33 -- # echo 0 00:03:26.902 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:26.902 15:04:25 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.902 15:04:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.902 15:04:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.902 15:04:25 -- setup/common.sh@18 -- # local node= 00:03:26.902 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:26.902 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.902 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.902 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.902 15:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.902 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.902 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44147244 kB' 'MemAvailable: 47905600 kB' 'Buffers: 2708 kB' 'Cached: 10714712 kB' 'SwapCached: 0 kB' 'Active: 7459912 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061732 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504936 kB' 'Mapped: 203432 kB' 'Shmem: 6559644 kB' 'KReclaimable: 188320 kB' 'Slab: 717236 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528916 kB' 'KernelStack: 12768 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8118496 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.902 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.902 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.903 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.903 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.904 15:04:25 -- setup/common.sh@33 -- # echo 0 00:03:26.904 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:26.904 15:04:25 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.904 15:04:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.904 15:04:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.904 15:04:25 -- setup/common.sh@18 -- # local node= 00:03:26.904 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:26.904 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.904 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.904 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.904 15:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.904 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.904 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44147288 kB' 'MemAvailable: 47905644 kB' 'Buffers: 2708 kB' 'Cached: 10714728 kB' 'SwapCached: 0 kB' 'Active: 7458804 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060624 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504208 kB' 'Mapped: 203368 kB' 'Shmem: 6559660 kB' 'KReclaimable: 188320 kB' 'Slab: 717244 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528924 kB' 'KernelStack: 12816 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8118512 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.904 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.904 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.905 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.905 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.906 15:04:25 -- setup/common.sh@33 -- # echo 0 00:03:26.906 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:26.906 15:04:25 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.906 15:04:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:26.906 nr_hugepages=1536 00:03:26.906 15:04:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.906 resv_hugepages=0 00:03:26.906 15:04:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.906 surplus_hugepages=0 00:03:26.906 15:04:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.906 anon_hugepages=0 00:03:26.906 15:04:25 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:26.906 15:04:25 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:26.906 15:04:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.906 15:04:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.906 15:04:25 -- setup/common.sh@18 -- # local node= 00:03:26.906 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:26.906 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.906 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.906 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.906 15:04:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.906 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.906 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44153140 kB' 'MemAvailable: 47911496 kB' 'Buffers: 2708 kB' 'Cached: 10714728 kB' 'SwapCached: 0 kB' 'Active: 7458480 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060300 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503884 kB' 'Mapped: 203368 kB' 'Shmem: 6559660 kB' 'KReclaimable: 188320 kB' 'Slab: 717244 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528924 kB' 'KernelStack: 12800 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8118524 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.906 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.906 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.907 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.907 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.908 15:04:25 -- setup/common.sh@33 -- # echo 1536 00:03:26.908 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:26.908 15:04:25 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:26.908 15:04:25 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.908 15:04:25 -- setup/hugepages.sh@27 -- # local node 00:03:26.908 15:04:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.908 15:04:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.908 15:04:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.908 15:04:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:26.908 15:04:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.908 15:04:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.908 15:04:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.908 15:04:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.908 15:04:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.908 15:04:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.908 15:04:25 -- setup/common.sh@18 -- # local node=0 00:03:26.908 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:26.908 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.908 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.908 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.908 15:04:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.908 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.908 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 22258564 kB' 'MemUsed: 10567292 kB' 'SwapCached: 0 kB' 'Active: 4894880 kB' 'Inactive: 3581012 kB' 'Active(anon): 4736540 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8286920 kB' 'Mapped: 36532 kB' 'AnonPages: 192144 kB' 'Shmem: 4547568 kB' 'KernelStack: 6504 kB' 'PageTables: 3340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376136 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287308 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.908 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.908 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.909 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.909 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.909 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.909 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.909 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.909 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.909 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.909 15:04:25 -- setup/common.sh@32 -- # continue 00:03:26.909 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.168 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.168 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@33 -- # echo 0 00:03:27.169 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:27.169 15:04:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.169 15:04:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.169 15:04:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.169 15:04:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:27.169 15:04:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.169 15:04:25 -- setup/common.sh@18 -- # local node=1 00:03:27.169 15:04:25 -- setup/common.sh@19 -- # local var val 00:03:27.169 15:04:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.169 15:04:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.169 15:04:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:27.169 15:04:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:27.169 15:04:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.169 15:04:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 21893068 kB' 'MemUsed: 5816740 kB' 'SwapCached: 0 kB' 'Active: 2563960 kB' 'Inactive: 178584 kB' 'Active(anon): 2324120 kB' 'Inactive(anon): 0 kB' 'Active(file): 239840 kB' 'Inactive(file): 178584 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2430544 kB' 'Mapped: 166836 kB' 'AnonPages: 312060 kB' 'Shmem: 2012120 kB' 'KernelStack: 6312 kB' 'PageTables: 4608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99492 kB' 'Slab: 341108 kB' 'SReclaimable: 99492 kB' 'SUnreclaim: 241616 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.169 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.169 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # continue 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.170 15:04:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.170 15:04:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.170 15:04:25 -- setup/common.sh@33 -- # echo 0 00:03:27.170 15:04:25 -- setup/common.sh@33 -- # return 0 00:03:27.170 15:04:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.170 15:04:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.170 15:04:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.170 15:04:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.170 15:04:25 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:27.170 node0=512 expecting 512 00:03:27.170 15:04:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.170 15:04:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.170 15:04:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.170 15:04:25 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:27.170 node1=1024 expecting 1024 00:03:27.170 15:04:25 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:27.170 00:03:27.170 real 0m1.475s 00:03:27.170 user 0m0.577s 00:03:27.170 sys 0m0.864s 00:03:27.170 15:04:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.170 15:04:25 -- common/autotest_common.sh@10 -- # set +x 00:03:27.170 ************************************ 00:03:27.170 END TEST custom_alloc 00:03:27.170 ************************************ 00:03:27.170 15:04:25 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:27.170 15:04:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.170 15:04:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.170 15:04:25 -- common/autotest_common.sh@10 -- # set +x 00:03:27.170 ************************************ 00:03:27.170 START TEST no_shrink_alloc 00:03:27.170 ************************************ 00:03:27.170 15:04:25 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:27.170 15:04:25 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:27.170 15:04:25 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:27.170 15:04:25 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:27.170 15:04:25 -- setup/hugepages.sh@51 -- # shift 00:03:27.170 15:04:25 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:27.170 15:04:25 -- setup/hugepages.sh@52 -- # local node_ids 00:03:27.170 15:04:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:27.170 15:04:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:27.170 15:04:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:27.170 15:04:25 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:27.170 15:04:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:27.170 15:04:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:27.170 15:04:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:27.170 15:04:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:27.170 15:04:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:27.170 15:04:25 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:27.170 15:04:25 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:27.170 15:04:25 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:27.170 15:04:25 -- setup/hugepages.sh@73 -- # return 0 00:03:27.170 15:04:25 -- setup/hugepages.sh@198 -- # setup output 00:03:27.170 15:04:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.170 15:04:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.107 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.107 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:28.107 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.107 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.107 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.107 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.107 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.107 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.107 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.107 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.107 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.107 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.107 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.107 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.107 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.107 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.107 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.371 15:04:26 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:28.371 15:04:26 -- setup/hugepages.sh@89 -- # local node 00:03:28.371 15:04:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:28.371 15:04:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:28.371 15:04:26 -- setup/hugepages.sh@92 -- # local surp 00:03:28.371 15:04:26 -- setup/hugepages.sh@93 -- # local resv 00:03:28.371 15:04:26 -- setup/hugepages.sh@94 -- # local anon 00:03:28.371 15:04:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:28.371 15:04:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:28.371 15:04:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:28.371 15:04:26 -- setup/common.sh@18 -- # local node= 00:03:28.371 15:04:26 -- setup/common.sh@19 -- # local var val 00:03:28.371 15:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.371 15:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.371 15:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.371 15:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.371 15:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.371 15:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45069392 kB' 'MemAvailable: 48827748 kB' 'Buffers: 2708 kB' 'Cached: 10714808 kB' 'SwapCached: 0 kB' 'Active: 7459308 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061128 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504596 kB' 'Mapped: 203420 kB' 'Shmem: 6559740 kB' 'KReclaimable: 188320 kB' 'Slab: 717144 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528824 kB' 'KernelStack: 12832 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.371 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.371 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.372 15:04:26 -- setup/common.sh@33 -- # echo 0 00:03:28.372 15:04:26 -- setup/common.sh@33 -- # return 0 00:03:28.372 15:04:26 -- setup/hugepages.sh@97 -- # anon=0 00:03:28.372 15:04:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:28.372 15:04:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.372 15:04:26 -- setup/common.sh@18 -- # local node= 00:03:28.372 15:04:26 -- setup/common.sh@19 -- # local var val 00:03:28.372 15:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.372 15:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.372 15:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.372 15:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.372 15:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.372 15:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45082476 kB' 'MemAvailable: 48840832 kB' 'Buffers: 2708 kB' 'Cached: 10714808 kB' 'SwapCached: 0 kB' 'Active: 7459652 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061472 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504940 kB' 'Mapped: 203420 kB' 'Shmem: 6559740 kB' 'KReclaimable: 188320 kB' 'Slab: 717144 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528824 kB' 'KernelStack: 12816 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118720 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.372 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.372 15:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.373 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.373 15:04:26 -- setup/common.sh@33 -- # echo 0 00:03:28.373 15:04:26 -- setup/common.sh@33 -- # return 0 00:03:28.373 15:04:26 -- setup/hugepages.sh@99 -- # surp=0 00:03:28.373 15:04:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:28.373 15:04:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:28.373 15:04:26 -- setup/common.sh@18 -- # local node= 00:03:28.373 15:04:26 -- setup/common.sh@19 -- # local var val 00:03:28.373 15:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.373 15:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.373 15:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.373 15:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.373 15:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.373 15:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.373 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45083312 kB' 'MemAvailable: 48841668 kB' 'Buffers: 2708 kB' 'Cached: 10714824 kB' 'SwapCached: 0 kB' 'Active: 7459028 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060848 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504304 kB' 'Mapped: 203376 kB' 'Shmem: 6559756 kB' 'KReclaimable: 188320 kB' 'Slab: 717156 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528836 kB' 'KernelStack: 12832 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.374 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.374 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.375 15:04:26 -- setup/common.sh@33 -- # echo 0 00:03:28.375 15:04:26 -- setup/common.sh@33 -- # return 0 00:03:28.375 15:04:26 -- setup/hugepages.sh@100 -- # resv=0 00:03:28.375 15:04:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:28.375 nr_hugepages=1024 00:03:28.375 15:04:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:28.375 resv_hugepages=0 00:03:28.375 15:04:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:28.375 surplus_hugepages=0 00:03:28.375 15:04:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:28.375 anon_hugepages=0 00:03:28.375 15:04:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:28.375 15:04:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:28.375 15:04:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:28.375 15:04:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:28.375 15:04:26 -- setup/common.sh@18 -- # local node= 00:03:28.375 15:04:26 -- setup/common.sh@19 -- # local var val 00:03:28.375 15:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.375 15:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.375 15:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.375 15:04:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.375 15:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.375 15:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45083604 kB' 'MemAvailable: 48841960 kB' 'Buffers: 2708 kB' 'Cached: 10714836 kB' 'SwapCached: 0 kB' 'Active: 7459040 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060860 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504312 kB' 'Mapped: 203376 kB' 'Shmem: 6559768 kB' 'KReclaimable: 188320 kB' 'Slab: 717156 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528836 kB' 'KernelStack: 12832 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.375 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.375 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.376 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.376 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.376 15:04:26 -- setup/common.sh@33 -- # echo 1024 00:03:28.376 15:04:26 -- setup/common.sh@33 -- # return 0 00:03:28.376 15:04:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:28.376 15:04:26 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.376 15:04:26 -- setup/hugepages.sh@27 -- # local node 00:03:28.376 15:04:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.376 15:04:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:28.376 15:04:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.376 15:04:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:28.376 15:04:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.376 15:04:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.376 15:04:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.376 15:04:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.376 15:04:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.376 15:04:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.377 15:04:26 -- setup/common.sh@18 -- # local node=0 00:03:28.377 15:04:26 -- setup/common.sh@19 -- # local var val 00:03:28.377 15:04:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.377 15:04:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.377 15:04:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.377 15:04:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.377 15:04:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.377 15:04:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21204996 kB' 'MemUsed: 11620860 kB' 'SwapCached: 0 kB' 'Active: 4895356 kB' 'Inactive: 3581012 kB' 'Active(anon): 4737016 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8287016 kB' 'Mapped: 36532 kB' 'AnonPages: 192512 kB' 'Shmem: 4547664 kB' 'KernelStack: 6520 kB' 'PageTables: 3432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376148 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287320 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.377 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.377 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.378 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.378 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.378 15:04:26 -- setup/common.sh@32 -- # continue 00:03:28.378 15:04:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.378 15:04:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.378 15:04:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.378 15:04:26 -- setup/common.sh@33 -- # echo 0 00:03:28.378 15:04:26 -- setup/common.sh@33 -- # return 0 00:03:28.378 15:04:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.378 15:04:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.378 15:04:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.378 15:04:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.378 15:04:26 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:28.378 node0=1024 expecting 1024 00:03:28.378 15:04:26 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:28.378 15:04:26 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:28.378 15:04:26 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:28.378 15:04:26 -- setup/hugepages.sh@202 -- # setup output 00:03:28.378 15:04:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.378 15:04:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.759 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.759 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.759 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.759 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.759 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.759 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.759 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.759 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.759 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.759 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.759 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.759 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.759 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.759 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.759 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.759 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.759 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.759 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:29.759 15:04:28 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:29.759 15:04:28 -- setup/hugepages.sh@89 -- # local node 00:03:29.759 15:04:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.759 15:04:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.759 15:04:28 -- setup/hugepages.sh@92 -- # local surp 00:03:29.759 15:04:28 -- setup/hugepages.sh@93 -- # local resv 00:03:29.759 15:04:28 -- setup/hugepages.sh@94 -- # local anon 00:03:29.759 15:04:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.759 15:04:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.759 15:04:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.759 15:04:28 -- setup/common.sh@18 -- # local node= 00:03:29.759 15:04:28 -- setup/common.sh@19 -- # local var val 00:03:29.759 15:04:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.759 15:04:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.759 15:04:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.759 15:04:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.759 15:04:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.759 15:04:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45094512 kB' 'MemAvailable: 48852868 kB' 'Buffers: 2708 kB' 'Cached: 10714880 kB' 'SwapCached: 0 kB' 'Active: 7459768 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061588 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504960 kB' 'Mapped: 203388 kB' 'Shmem: 6559812 kB' 'KReclaimable: 188320 kB' 'Slab: 717252 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528932 kB' 'KernelStack: 12832 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.759 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.759 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.760 15:04:28 -- setup/common.sh@33 -- # echo 0 00:03:29.760 15:04:28 -- setup/common.sh@33 -- # return 0 00:03:29.760 15:04:28 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.760 15:04:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.760 15:04:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.760 15:04:28 -- setup/common.sh@18 -- # local node= 00:03:29.760 15:04:28 -- setup/common.sh@19 -- # local var val 00:03:29.760 15:04:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.760 15:04:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.760 15:04:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.760 15:04:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.760 15:04:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.760 15:04:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45098108 kB' 'MemAvailable: 48856464 kB' 'Buffers: 2708 kB' 'Cached: 10714884 kB' 'SwapCached: 0 kB' 'Active: 7459488 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061308 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504668 kB' 'Mapped: 203388 kB' 'Shmem: 6559816 kB' 'KReclaimable: 188320 kB' 'Slab: 717252 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528932 kB' 'KernelStack: 12784 kB' 'PageTables: 7796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.760 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.760 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.761 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.761 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.762 15:04:28 -- setup/common.sh@33 -- # echo 0 00:03:29.762 15:04:28 -- setup/common.sh@33 -- # return 0 00:03:29.762 15:04:28 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.762 15:04:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.762 15:04:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.762 15:04:28 -- setup/common.sh@18 -- # local node= 00:03:29.762 15:04:28 -- setup/common.sh@19 -- # local var val 00:03:29.762 15:04:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.762 15:04:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.762 15:04:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.762 15:04:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.762 15:04:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.762 15:04:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45098108 kB' 'MemAvailable: 48856464 kB' 'Buffers: 2708 kB' 'Cached: 10714892 kB' 'SwapCached: 0 kB' 'Active: 7459296 kB' 'Inactive: 3759596 kB' 'Active(anon): 7061116 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504452 kB' 'Mapped: 203376 kB' 'Shmem: 6559824 kB' 'KReclaimable: 188320 kB' 'Slab: 717252 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528932 kB' 'KernelStack: 12816 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118808 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.762 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.762 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.763 15:04:28 -- setup/common.sh@33 -- # echo 0 00:03:29.763 15:04:28 -- setup/common.sh@33 -- # return 0 00:03:29.763 15:04:28 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.763 15:04:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.763 nr_hugepages=1024 00:03:29.763 15:04:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.763 resv_hugepages=0 00:03:29.763 15:04:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.763 surplus_hugepages=0 00:03:29.763 15:04:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.763 anon_hugepages=0 00:03:29.763 15:04:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.763 15:04:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.763 15:04:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.763 15:04:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.763 15:04:28 -- setup/common.sh@18 -- # local node= 00:03:29.763 15:04:28 -- setup/common.sh@19 -- # local var val 00:03:29.763 15:04:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.763 15:04:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.763 15:04:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.763 15:04:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.763 15:04:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.763 15:04:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45098824 kB' 'MemAvailable: 48857180 kB' 'Buffers: 2708 kB' 'Cached: 10714896 kB' 'SwapCached: 0 kB' 'Active: 7459140 kB' 'Inactive: 3759596 kB' 'Active(anon): 7060960 kB' 'Inactive(anon): 0 kB' 'Active(file): 398180 kB' 'Inactive(file): 3759596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504328 kB' 'Mapped: 203380 kB' 'Shmem: 6559828 kB' 'KReclaimable: 188320 kB' 'Slab: 717272 kB' 'SReclaimable: 188320 kB' 'SUnreclaim: 528952 kB' 'KernelStack: 12832 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8118824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1910364 kB' 'DirectMap2M: 14786560 kB' 'DirectMap1G: 53477376 kB' 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.763 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.763 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.764 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.764 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.765 15:04:28 -- setup/common.sh@33 -- # echo 1024 00:03:29.765 15:04:28 -- setup/common.sh@33 -- # return 0 00:03:29.765 15:04:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.765 15:04:28 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.765 15:04:28 -- setup/hugepages.sh@27 -- # local node 00:03:29.765 15:04:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.765 15:04:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.765 15:04:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.765 15:04:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:29.765 15:04:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.765 15:04:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.765 15:04:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.765 15:04:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.765 15:04:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.765 15:04:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.765 15:04:28 -- setup/common.sh@18 -- # local node=0 00:03:29.765 15:04:28 -- setup/common.sh@19 -- # local var val 00:03:29.765 15:04:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.765 15:04:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.765 15:04:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.765 15:04:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.765 15:04:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.765 15:04:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21195456 kB' 'MemUsed: 11630400 kB' 'SwapCached: 0 kB' 'Active: 4894984 kB' 'Inactive: 3581012 kB' 'Active(anon): 4736644 kB' 'Inactive(anon): 0 kB' 'Active(file): 158340 kB' 'Inactive(file): 3581012 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8287084 kB' 'Mapped: 36532 kB' 'AnonPages: 192044 kB' 'Shmem: 4547732 kB' 'KernelStack: 6488 kB' 'PageTables: 3296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 88828 kB' 'Slab: 376292 kB' 'SReclaimable: 88828 kB' 'SUnreclaim: 287464 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.765 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.765 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # continue 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.766 15:04:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.766 15:04:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.766 15:04:28 -- setup/common.sh@33 -- # echo 0 00:03:29.766 15:04:28 -- setup/common.sh@33 -- # return 0 00:03:29.766 15:04:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.766 15:04:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.766 15:04:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.766 15:04:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.766 15:04:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:29.766 node0=1024 expecting 1024 00:03:29.766 15:04:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:29.766 00:03:29.766 real 0m2.790s 00:03:29.766 user 0m1.121s 00:03:29.766 sys 0m1.552s 00:03:29.766 15:04:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.766 15:04:28 -- common/autotest_common.sh@10 -- # set +x 00:03:29.766 ************************************ 00:03:29.766 END TEST no_shrink_alloc 00:03:29.766 ************************************ 00:03:30.025 15:04:28 -- setup/hugepages.sh@217 -- # clear_hp 00:03:30.025 15:04:28 -- setup/hugepages.sh@37 -- # local node hp 00:03:30.025 15:04:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:30.025 15:04:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:30.025 15:04:28 -- setup/hugepages.sh@41 -- # echo 0 00:03:30.025 15:04:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:30.025 15:04:28 -- setup/hugepages.sh@41 -- # echo 0 00:03:30.025 15:04:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:30.025 15:04:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:30.025 15:04:28 -- setup/hugepages.sh@41 -- # echo 0 00:03:30.025 15:04:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:30.025 15:04:28 -- setup/hugepages.sh@41 -- # echo 0 00:03:30.025 15:04:28 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:30.025 15:04:28 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:30.025 00:03:30.025 real 0m11.339s 00:03:30.025 user 0m4.288s 00:03:30.025 sys 0m5.954s 00:03:30.025 15:04:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:30.025 15:04:28 -- common/autotest_common.sh@10 -- # set +x 00:03:30.025 ************************************ 00:03:30.025 END TEST hugepages 00:03:30.025 ************************************ 00:03:30.025 15:04:28 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:30.025 15:04:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.025 15:04:28 -- common/autotest_common.sh@10 -- # set +x 00:03:30.025 ************************************ 00:03:30.025 START TEST driver 00:03:30.025 ************************************ 00:03:30.025 15:04:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:30.025 * Looking for test storage... 00:03:30.025 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:30.025 15:04:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:30.025 15:04:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:30.025 15:04:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:30.025 15:04:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:30.025 15:04:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:30.025 15:04:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:30.025 15:04:28 -- scripts/common.sh@335 -- # IFS=.-: 00:03:30.025 15:04:28 -- scripts/common.sh@335 -- # read -ra ver1 00:03:30.025 15:04:28 -- scripts/common.sh@336 -- # IFS=.-: 00:03:30.025 15:04:28 -- scripts/common.sh@336 -- # read -ra ver2 00:03:30.025 15:04:28 -- scripts/common.sh@337 -- # local 'op=<' 00:03:30.025 15:04:28 -- scripts/common.sh@339 -- # ver1_l=2 00:03:30.025 15:04:28 -- scripts/common.sh@340 -- # ver2_l=1 00:03:30.025 15:04:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:30.025 15:04:28 -- scripts/common.sh@343 -- # case "$op" in 00:03:30.025 15:04:28 -- scripts/common.sh@344 -- # : 1 00:03:30.025 15:04:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:30.025 15:04:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:30.025 15:04:28 -- scripts/common.sh@364 -- # decimal 1 00:03:30.025 15:04:28 -- scripts/common.sh@352 -- # local d=1 00:03:30.025 15:04:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:30.025 15:04:28 -- scripts/common.sh@354 -- # echo 1 00:03:30.025 15:04:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:30.025 15:04:28 -- scripts/common.sh@365 -- # decimal 2 00:03:30.025 15:04:28 -- scripts/common.sh@352 -- # local d=2 00:03:30.025 15:04:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:30.025 15:04:28 -- scripts/common.sh@354 -- # echo 2 00:03:30.025 15:04:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:30.025 15:04:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:30.025 15:04:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:30.025 15:04:28 -- scripts/common.sh@367 -- # return 0 00:03:30.025 15:04:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:30.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.025 --rc genhtml_branch_coverage=1 00:03:30.025 --rc genhtml_function_coverage=1 00:03:30.025 --rc genhtml_legend=1 00:03:30.025 --rc geninfo_all_blocks=1 00:03:30.025 --rc geninfo_unexecuted_blocks=1 00:03:30.025 00:03:30.025 ' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:30.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.025 --rc genhtml_branch_coverage=1 00:03:30.025 --rc genhtml_function_coverage=1 00:03:30.025 --rc genhtml_legend=1 00:03:30.025 --rc geninfo_all_blocks=1 00:03:30.025 --rc geninfo_unexecuted_blocks=1 00:03:30.025 00:03:30.025 ' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:30.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.025 --rc genhtml_branch_coverage=1 00:03:30.025 --rc genhtml_function_coverage=1 00:03:30.025 --rc genhtml_legend=1 00:03:30.025 --rc geninfo_all_blocks=1 00:03:30.025 --rc geninfo_unexecuted_blocks=1 00:03:30.025 00:03:30.025 ' 00:03:30.025 15:04:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:30.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.025 --rc genhtml_branch_coverage=1 00:03:30.025 --rc genhtml_function_coverage=1 00:03:30.025 --rc genhtml_legend=1 00:03:30.025 --rc geninfo_all_blocks=1 00:03:30.025 --rc geninfo_unexecuted_blocks=1 00:03:30.025 00:03:30.025 ' 00:03:30.025 15:04:28 -- setup/driver.sh@68 -- # setup reset 00:03:30.025 15:04:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.025 15:04:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.557 15:04:31 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:32.557 15:04:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.557 15:04:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.557 15:04:31 -- common/autotest_common.sh@10 -- # set +x 00:03:32.557 ************************************ 00:03:32.557 START TEST guess_driver 00:03:32.557 ************************************ 00:03:32.557 15:04:31 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:32.557 15:04:31 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:32.557 15:04:31 -- setup/driver.sh@47 -- # local fail=0 00:03:32.557 15:04:31 -- setup/driver.sh@49 -- # pick_driver 00:03:32.557 15:04:31 -- setup/driver.sh@36 -- # vfio 00:03:32.557 15:04:31 -- setup/driver.sh@21 -- # local iommu_grups 00:03:32.557 15:04:31 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:32.557 15:04:31 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:32.557 15:04:31 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:32.557 15:04:31 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:32.557 15:04:31 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:32.557 15:04:31 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:32.557 15:04:31 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:32.557 15:04:31 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:32.557 15:04:31 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:32.557 15:04:31 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:32.557 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:32.557 15:04:31 -- setup/driver.sh@30 -- # return 0 00:03:32.557 15:04:31 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:32.557 15:04:31 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:32.557 15:04:31 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:32.557 15:04:31 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:32.557 Looking for driver=vfio-pci 00:03:32.557 15:04:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:32.557 15:04:31 -- setup/driver.sh@45 -- # setup output config 00:03:32.557 15:04:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.557 15:04:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:33.934 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.935 15:04:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.935 15:04:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.935 15:04:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:34.871 15:04:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:34.871 15:04:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:34.872 15:04:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:34.872 15:04:33 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:34.872 15:04:33 -- setup/driver.sh@65 -- # setup reset 00:03:34.872 15:04:33 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:34.872 15:04:33 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:37.403 00:03:37.403 real 0m4.705s 00:03:37.403 user 0m1.071s 00:03:37.403 sys 0m1.774s 00:03:37.403 15:04:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.403 15:04:35 -- common/autotest_common.sh@10 -- # set +x 00:03:37.403 ************************************ 00:03:37.403 END TEST guess_driver 00:03:37.403 ************************************ 00:03:37.403 00:03:37.403 real 0m7.406s 00:03:37.403 user 0m1.751s 00:03:37.403 sys 0m2.864s 00:03:37.403 15:04:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.403 15:04:35 -- common/autotest_common.sh@10 -- # set +x 00:03:37.403 ************************************ 00:03:37.403 END TEST driver 00:03:37.403 ************************************ 00:03:37.403 15:04:35 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:37.403 15:04:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.403 15:04:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.403 15:04:35 -- common/autotest_common.sh@10 -- # set +x 00:03:37.403 ************************************ 00:03:37.403 START TEST devices 00:03:37.403 ************************************ 00:03:37.403 15:04:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:37.403 * Looking for test storage... 00:03:37.403 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:37.403 15:04:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:37.403 15:04:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:37.403 15:04:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:37.403 15:04:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:37.403 15:04:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:37.403 15:04:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:37.403 15:04:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:37.403 15:04:35 -- scripts/common.sh@335 -- # IFS=.-: 00:03:37.403 15:04:35 -- scripts/common.sh@335 -- # read -ra ver1 00:03:37.403 15:04:35 -- scripts/common.sh@336 -- # IFS=.-: 00:03:37.403 15:04:35 -- scripts/common.sh@336 -- # read -ra ver2 00:03:37.403 15:04:35 -- scripts/common.sh@337 -- # local 'op=<' 00:03:37.403 15:04:35 -- scripts/common.sh@339 -- # ver1_l=2 00:03:37.403 15:04:35 -- scripts/common.sh@340 -- # ver2_l=1 00:03:37.403 15:04:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:37.403 15:04:35 -- scripts/common.sh@343 -- # case "$op" in 00:03:37.403 15:04:35 -- scripts/common.sh@344 -- # : 1 00:03:37.403 15:04:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:37.403 15:04:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:37.403 15:04:35 -- scripts/common.sh@364 -- # decimal 1 00:03:37.403 15:04:35 -- scripts/common.sh@352 -- # local d=1 00:03:37.403 15:04:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:37.403 15:04:35 -- scripts/common.sh@354 -- # echo 1 00:03:37.403 15:04:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:37.403 15:04:35 -- scripts/common.sh@365 -- # decimal 2 00:03:37.403 15:04:35 -- scripts/common.sh@352 -- # local d=2 00:03:37.403 15:04:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:37.403 15:04:35 -- scripts/common.sh@354 -- # echo 2 00:03:37.403 15:04:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:37.404 15:04:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:37.404 15:04:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:37.404 15:04:35 -- scripts/common.sh@367 -- # return 0 00:03:37.404 15:04:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:37.404 15:04:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:37.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.404 --rc genhtml_branch_coverage=1 00:03:37.404 --rc genhtml_function_coverage=1 00:03:37.404 --rc genhtml_legend=1 00:03:37.404 --rc geninfo_all_blocks=1 00:03:37.404 --rc geninfo_unexecuted_blocks=1 00:03:37.404 00:03:37.404 ' 00:03:37.404 15:04:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:37.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.404 --rc genhtml_branch_coverage=1 00:03:37.404 --rc genhtml_function_coverage=1 00:03:37.404 --rc genhtml_legend=1 00:03:37.404 --rc geninfo_all_blocks=1 00:03:37.404 --rc geninfo_unexecuted_blocks=1 00:03:37.404 00:03:37.404 ' 00:03:37.404 15:04:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:37.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.404 --rc genhtml_branch_coverage=1 00:03:37.404 --rc genhtml_function_coverage=1 00:03:37.404 --rc genhtml_legend=1 00:03:37.404 --rc geninfo_all_blocks=1 00:03:37.404 --rc geninfo_unexecuted_blocks=1 00:03:37.404 00:03:37.404 ' 00:03:37.404 15:04:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:37.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.404 --rc genhtml_branch_coverage=1 00:03:37.404 --rc genhtml_function_coverage=1 00:03:37.404 --rc genhtml_legend=1 00:03:37.404 --rc geninfo_all_blocks=1 00:03:37.404 --rc geninfo_unexecuted_blocks=1 00:03:37.404 00:03:37.404 ' 00:03:37.404 15:04:35 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:37.404 15:04:35 -- setup/devices.sh@192 -- # setup reset 00:03:37.404 15:04:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:37.404 15:04:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:39.307 15:04:37 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:39.307 15:04:37 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:39.307 15:04:37 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:39.307 15:04:37 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:39.307 15:04:37 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:39.307 15:04:37 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:39.307 15:04:37 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:39.307 15:04:37 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:39.307 15:04:37 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:39.307 15:04:37 -- setup/devices.sh@196 -- # blocks=() 00:03:39.307 15:04:37 -- setup/devices.sh@196 -- # declare -a blocks 00:03:39.307 15:04:37 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:39.307 15:04:37 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:39.307 15:04:37 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:39.307 15:04:37 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:39.307 15:04:37 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:39.307 15:04:37 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:39.307 15:04:37 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:39.307 15:04:37 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:39.307 15:04:37 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:39.307 15:04:37 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:39.307 15:04:37 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:39.307 No valid GPT data, bailing 00:03:39.307 15:04:37 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:39.307 15:04:37 -- scripts/common.sh@393 -- # pt= 00:03:39.307 15:04:37 -- scripts/common.sh@394 -- # return 1 00:03:39.307 15:04:37 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:39.307 15:04:37 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:39.307 15:04:37 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:39.307 15:04:37 -- setup/common.sh@80 -- # echo 1000204886016 00:03:39.307 15:04:37 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:39.307 15:04:37 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:39.307 15:04:37 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:39.307 15:04:37 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:39.307 15:04:37 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:39.307 15:04:37 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:39.307 15:04:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.307 15:04:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.307 15:04:37 -- common/autotest_common.sh@10 -- # set +x 00:03:39.307 ************************************ 00:03:39.307 START TEST nvme_mount 00:03:39.307 ************************************ 00:03:39.307 15:04:37 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:39.307 15:04:37 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:39.307 15:04:37 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:39.307 15:04:37 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.307 15:04:37 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.307 15:04:37 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:39.307 15:04:37 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:39.307 15:04:37 -- setup/common.sh@40 -- # local part_no=1 00:03:39.307 15:04:37 -- setup/common.sh@41 -- # local size=1073741824 00:03:39.307 15:04:37 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:39.307 15:04:37 -- setup/common.sh@44 -- # parts=() 00:03:39.307 15:04:37 -- setup/common.sh@44 -- # local parts 00:03:39.307 15:04:37 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:39.307 15:04:37 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:39.307 15:04:37 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:39.307 15:04:37 -- setup/common.sh@46 -- # (( part++ )) 00:03:39.307 15:04:37 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:39.307 15:04:37 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:39.307 15:04:37 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:39.307 15:04:37 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:40.244 Creating new GPT entries in memory. 00:03:40.244 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:40.244 other utilities. 00:03:40.244 15:04:38 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:40.244 15:04:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:40.244 15:04:38 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:40.244 15:04:38 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:40.244 15:04:38 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:41.183 Creating new GPT entries in memory. 00:03:41.183 The operation has completed successfully. 00:03:41.183 15:04:39 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.183 15:04:39 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.183 15:04:39 -- setup/common.sh@62 -- # wait 2630658 00:03:41.184 15:04:39 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.184 15:04:39 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:41.184 15:04:39 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.184 15:04:39 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:41.184 15:04:39 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:41.184 15:04:39 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.184 15:04:39 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:41.184 15:04:39 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:41.184 15:04:39 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:41.184 15:04:39 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.184 15:04:39 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:41.184 15:04:39 -- setup/devices.sh@53 -- # local found=0 00:03:41.184 15:04:39 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:41.184 15:04:39 -- setup/devices.sh@56 -- # : 00:03:41.184 15:04:39 -- setup/devices.sh@59 -- # local pci status 00:03:41.184 15:04:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.184 15:04:39 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:41.184 15:04:39 -- setup/devices.sh@47 -- # setup output config 00:03:41.184 15:04:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.184 15:04:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:42.559 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.559 15:04:40 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:42.559 15:04:40 -- setup/devices.sh@63 -- # found=1 00:03:42.559 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.559 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.560 15:04:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.560 15:04:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:42.560 15:04:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.560 15:04:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.560 15:04:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.560 15:04:40 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:42.560 15:04:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.560 15:04:40 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.560 15:04:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:42.560 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:42.560 15:04:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:42.560 15:04:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:42.819 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:42.819 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:42.819 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:42.819 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:42.819 15:04:41 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:42.819 15:04:41 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:42.819 15:04:41 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.819 15:04:41 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:42.819 15:04:41 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:42.819 15:04:41 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.819 15:04:41 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.819 15:04:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.819 15:04:41 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:42.819 15:04:41 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.819 15:04:41 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.819 15:04:41 -- setup/devices.sh@53 -- # local found=0 00:03:42.819 15:04:41 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.819 15:04:41 -- setup/devices.sh@56 -- # : 00:03:42.819 15:04:41 -- setup/devices.sh@59 -- # local pci status 00:03:42.819 15:04:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.819 15:04:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.819 15:04:41 -- setup/devices.sh@47 -- # setup output config 00:03:42.819 15:04:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.819 15:04:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:43.754 15:04:42 -- setup/devices.sh@63 -- # found=1 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.754 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.754 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.755 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.755 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.755 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.755 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.755 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.755 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.755 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.755 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.755 15:04:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.755 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.013 15:04:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.013 15:04:42 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:44.013 15:04:42 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.013 15:04:42 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:44.013 15:04:42 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.013 15:04:42 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.013 15:04:42 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:44.013 15:04:42 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.013 15:04:42 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:44.013 15:04:42 -- setup/devices.sh@50 -- # local mount_point= 00:03:44.013 15:04:42 -- setup/devices.sh@51 -- # local test_file= 00:03:44.013 15:04:42 -- setup/devices.sh@53 -- # local found=0 00:03:44.013 15:04:42 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:44.013 15:04:42 -- setup/devices.sh@59 -- # local pci status 00:03:44.013 15:04:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.013 15:04:42 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.013 15:04:42 -- setup/devices.sh@47 -- # setup output config 00:03:44.013 15:04:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.013 15:04:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:45.387 15:04:43 -- setup/devices.sh@63 -- # found=1 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.387 15:04:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:45.387 15:04:43 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:45.387 15:04:43 -- setup/devices.sh@68 -- # return 0 00:03:45.387 15:04:43 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:45.387 15:04:43 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.387 15:04:43 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:45.387 15:04:43 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:45.387 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:45.387 00:03:45.387 real 0m6.344s 00:03:45.387 user 0m1.457s 00:03:45.387 sys 0m2.445s 00:03:45.387 15:04:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:45.387 15:04:43 -- common/autotest_common.sh@10 -- # set +x 00:03:45.387 ************************************ 00:03:45.387 END TEST nvme_mount 00:03:45.387 ************************************ 00:03:45.387 15:04:43 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:45.387 15:04:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:45.387 15:04:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:45.387 15:04:43 -- common/autotest_common.sh@10 -- # set +x 00:03:45.387 ************************************ 00:03:45.387 START TEST dm_mount 00:03:45.387 ************************************ 00:03:45.387 15:04:43 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:45.387 15:04:43 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:45.387 15:04:43 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:45.387 15:04:43 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:45.387 15:04:43 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:45.387 15:04:43 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:45.387 15:04:43 -- setup/common.sh@40 -- # local part_no=2 00:03:45.387 15:04:43 -- setup/common.sh@41 -- # local size=1073741824 00:03:45.387 15:04:43 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:45.387 15:04:43 -- setup/common.sh@44 -- # parts=() 00:03:45.387 15:04:43 -- setup/common.sh@44 -- # local parts 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:45.387 15:04:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part++ )) 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:45.387 15:04:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part++ )) 00:03:45.387 15:04:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:45.387 15:04:43 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:45.387 15:04:43 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:45.387 15:04:43 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:46.324 Creating new GPT entries in memory. 00:03:46.324 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:46.324 other utilities. 00:03:46.324 15:04:44 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:46.324 15:04:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:46.324 15:04:44 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:46.324 15:04:44 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:46.324 15:04:44 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:47.701 Creating new GPT entries in memory. 00:03:47.701 The operation has completed successfully. 00:03:47.701 15:04:45 -- setup/common.sh@57 -- # (( part++ )) 00:03:47.701 15:04:45 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:47.701 15:04:45 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:47.701 15:04:45 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:47.701 15:04:45 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:48.637 The operation has completed successfully. 00:03:48.637 15:04:46 -- setup/common.sh@57 -- # (( part++ )) 00:03:48.637 15:04:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:48.637 15:04:46 -- setup/common.sh@62 -- # wait 2633120 00:03:48.637 15:04:46 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:48.637 15:04:46 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.637 15:04:46 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:48.637 15:04:46 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:48.637 15:04:46 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:48.637 15:04:46 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:48.637 15:04:46 -- setup/devices.sh@161 -- # break 00:03:48.637 15:04:46 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:48.637 15:04:46 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:48.637 15:04:46 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:48.637 15:04:46 -- setup/devices.sh@166 -- # dm=dm-0 00:03:48.637 15:04:46 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:48.637 15:04:46 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:48.637 15:04:46 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.637 15:04:46 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:48.637 15:04:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.637 15:04:46 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:48.637 15:04:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:48.637 15:04:47 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.637 15:04:47 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:48.637 15:04:47 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:48.637 15:04:47 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:48.637 15:04:47 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.637 15:04:47 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:48.637 15:04:47 -- setup/devices.sh@53 -- # local found=0 00:03:48.637 15:04:47 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:48.637 15:04:47 -- setup/devices.sh@56 -- # : 00:03:48.637 15:04:47 -- setup/devices.sh@59 -- # local pci status 00:03:48.637 15:04:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.637 15:04:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:48.637 15:04:47 -- setup/devices.sh@47 -- # setup output config 00:03:48.637 15:04:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:48.637 15:04:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:49.571 15:04:48 -- setup/devices.sh@63 -- # found=1 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.571 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.571 15:04:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.572 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.830 15:04:48 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:49.830 15:04:48 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:49.830 15:04:48 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.830 15:04:48 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:49.830 15:04:48 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:49.830 15:04:48 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.830 15:04:48 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:49.830 15:04:48 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:49.830 15:04:48 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:49.830 15:04:48 -- setup/devices.sh@50 -- # local mount_point= 00:03:49.830 15:04:48 -- setup/devices.sh@51 -- # local test_file= 00:03:49.830 15:04:48 -- setup/devices.sh@53 -- # local found=0 00:03:49.830 15:04:48 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:49.830 15:04:48 -- setup/devices.sh@59 -- # local pci status 00:03:49.830 15:04:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.830 15:04:48 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:49.830 15:04:48 -- setup/devices.sh@47 -- # setup output config 00:03:49.830 15:04:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.830 15:04:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:50.764 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.764 15:04:49 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:50.764 15:04:49 -- setup/devices.sh@63 -- # found=1 00:03:50.764 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.022 15:04:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.022 15:04:49 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:51.022 15:04:49 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:51.022 15:04:49 -- setup/devices.sh@68 -- # return 0 00:03:51.022 15:04:49 -- setup/devices.sh@187 -- # cleanup_dm 00:03:51.022 15:04:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.022 15:04:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:51.022 15:04:49 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:51.279 15:04:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:51.279 15:04:49 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:51.279 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:51.279 15:04:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:51.279 15:04:49 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:51.279 00:03:51.279 real 0m5.767s 00:03:51.279 user 0m0.970s 00:03:51.279 sys 0m1.655s 00:03:51.279 15:04:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:51.279 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:51.279 ************************************ 00:03:51.279 END TEST dm_mount 00:03:51.279 ************************************ 00:03:51.279 15:04:49 -- setup/devices.sh@1 -- # cleanup 00:03:51.279 15:04:49 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:51.279 15:04:49 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:51.279 15:04:49 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:51.279 15:04:49 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:51.279 15:04:49 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:51.279 15:04:49 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:51.536 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:51.536 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:51.536 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:51.536 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:51.536 15:04:49 -- setup/devices.sh@12 -- # cleanup_dm 00:03:51.536 15:04:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.536 15:04:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:51.536 15:04:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:51.536 15:04:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:51.536 15:04:49 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:51.536 15:04:49 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:51.536 00:03:51.536 real 0m14.128s 00:03:51.536 user 0m3.147s 00:03:51.536 sys 0m5.163s 00:03:51.536 15:04:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:51.536 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:51.536 ************************************ 00:03:51.536 END TEST devices 00:03:51.536 ************************************ 00:03:51.536 00:03:51.536 real 0m43.665s 00:03:51.536 user 0m12.604s 00:03:51.536 sys 0m19.463s 00:03:51.536 15:04:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:51.536 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:51.536 ************************************ 00:03:51.536 END TEST setup.sh 00:03:51.536 ************************************ 00:03:51.536 15:04:49 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:52.471 Hugepages 00:03:52.471 node hugesize free / total 00:03:52.728 node0 1048576kB 0 / 0 00:03:52.728 node0 2048kB 2048 / 2048 00:03:52.728 node1 1048576kB 0 / 0 00:03:52.728 node1 2048kB 0 / 0 00:03:52.728 00:03:52.728 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:52.728 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:52.728 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:52.728 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:52.728 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:52.728 15:04:51 -- spdk/autotest.sh@128 -- # uname -s 00:03:52.728 15:04:51 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:52.728 15:04:51 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:52.728 15:04:51 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:54.132 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:54.132 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:54.132 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:55.069 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:55.069 15:04:53 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:56.005 15:04:54 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:56.005 15:04:54 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:56.005 15:04:54 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:56.006 15:04:54 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:56.006 15:04:54 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:56.006 15:04:54 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:56.006 15:04:54 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:56.006 15:04:54 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:56.006 15:04:54 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:56.006 15:04:54 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:56.006 15:04:54 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:56.006 15:04:54 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:57.396 Waiting for block devices as requested 00:03:57.396 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:57.396 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:57.396 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:57.655 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:57.655 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:57.655 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:57.655 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:57.914 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:57.914 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:57.914 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:57.914 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:58.172 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:58.172 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:58.172 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:58.172 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:58.432 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:58.432 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:58.432 15:04:56 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:58.432 15:04:56 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:58.432 15:04:56 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:58.432 15:04:56 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:58.432 15:04:56 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:58.432 15:04:56 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:58.432 15:04:56 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:58.432 15:04:56 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:58.432 15:04:56 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:58.432 15:04:56 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:58.432 15:04:56 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:58.432 15:04:56 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:58.432 15:04:56 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:58.432 15:04:56 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:58.432 15:04:56 -- common/autotest_common.sh@1552 -- # continue 00:03:58.432 15:04:56 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:58.432 15:04:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:58.432 15:04:56 -- common/autotest_common.sh@10 -- # set +x 00:03:58.690 15:04:57 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:58.690 15:04:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:58.690 15:04:57 -- common/autotest_common.sh@10 -- # set +x 00:03:58.690 15:04:57 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:59.626 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:59.626 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:59.884 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:59.884 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:00.835 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:00.835 15:04:59 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:00.835 15:04:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:00.835 15:04:59 -- common/autotest_common.sh@10 -- # set +x 00:04:00.835 15:04:59 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:00.835 15:04:59 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:00.835 15:04:59 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:00.835 15:04:59 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:00.835 15:04:59 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:00.835 15:04:59 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:00.835 15:04:59 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:00.836 15:04:59 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:00.836 15:04:59 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:00.836 15:04:59 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:00.836 15:04:59 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:01.099 15:04:59 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:01.099 15:04:59 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:01.099 15:04:59 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:01.099 15:04:59 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:01.099 15:04:59 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:01.099 15:04:59 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:01.099 15:04:59 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:01.099 15:04:59 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:01.099 15:04:59 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:01.099 15:04:59 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2638415 00:04:01.099 15:04:59 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:01.099 15:04:59 -- common/autotest_common.sh@1593 -- # waitforlisten 2638415 00:04:01.099 15:04:59 -- common/autotest_common.sh@829 -- # '[' -z 2638415 ']' 00:04:01.099 15:04:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:01.099 15:04:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:01.099 15:04:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:01.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:01.099 15:04:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:01.099 15:04:59 -- common/autotest_common.sh@10 -- # set +x 00:04:01.099 [2024-11-19 15:04:59.484357] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:01.099 [2024-11-19 15:04:59.484454] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2638415 ] 00:04:01.099 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.099 [2024-11-19 15:04:59.544232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:01.099 [2024-11-19 15:04:59.658947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:01.099 [2024-11-19 15:04:59.659145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:02.035 15:05:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:02.035 15:05:00 -- common/autotest_common.sh@862 -- # return 0 00:04:02.035 15:05:00 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:02.035 15:05:00 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:02.035 15:05:00 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:05.320 nvme0n1 00:04:05.320 15:05:03 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:05.320 [2024-11-19 15:05:03.796257] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:05.320 [2024-11-19 15:05:03.796308] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:05.320 request: 00:04:05.320 { 00:04:05.320 "nvme_ctrlr_name": "nvme0", 00:04:05.320 "password": "test", 00:04:05.320 "method": "bdev_nvme_opal_revert", 00:04:05.320 "req_id": 1 00:04:05.320 } 00:04:05.320 Got JSON-RPC error response 00:04:05.320 response: 00:04:05.320 { 00:04:05.320 "code": -32603, 00:04:05.320 "message": "Internal error" 00:04:05.320 } 00:04:05.320 15:05:03 -- common/autotest_common.sh@1599 -- # true 00:04:05.320 15:05:03 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:05.320 15:05:03 -- common/autotest_common.sh@1603 -- # killprocess 2638415 00:04:05.320 15:05:03 -- common/autotest_common.sh@936 -- # '[' -z 2638415 ']' 00:04:05.320 15:05:03 -- common/autotest_common.sh@940 -- # kill -0 2638415 00:04:05.320 15:05:03 -- common/autotest_common.sh@941 -- # uname 00:04:05.320 15:05:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:05.320 15:05:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2638415 00:04:05.320 15:05:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:05.320 15:05:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:05.320 15:05:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2638415' 00:04:05.320 killing process with pid 2638415 00:04:05.320 15:05:03 -- common/autotest_common.sh@955 -- # kill 2638415 00:04:05.320 15:05:03 -- common/autotest_common.sh@960 -- # wait 2638415 00:04:07.220 15:05:05 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:07.220 15:05:05 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:07.220 15:05:05 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:07.220 15:05:05 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:07.220 15:05:05 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:07.220 15:05:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:07.220 15:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.220 15:05:05 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:07.220 15:05:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.220 15:05:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.220 15:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.220 ************************************ 00:04:07.220 START TEST env 00:04:07.220 ************************************ 00:04:07.220 15:05:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:07.220 * Looking for test storage... 00:04:07.220 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:07.220 15:05:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:07.220 15:05:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:07.220 15:05:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.479 15:05:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.479 15:05:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.479 15:05:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.479 15:05:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.479 15:05:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.479 15:05:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.479 15:05:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.479 15:05:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.479 15:05:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.479 15:05:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.479 15:05:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.479 15:05:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.479 15:05:05 -- scripts/common.sh@344 -- # : 1 00:04:07.479 15:05:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.479 15:05:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.479 15:05:05 -- scripts/common.sh@364 -- # decimal 1 00:04:07.479 15:05:05 -- scripts/common.sh@352 -- # local d=1 00:04:07.479 15:05:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.479 15:05:05 -- scripts/common.sh@354 -- # echo 1 00:04:07.479 15:05:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.479 15:05:05 -- scripts/common.sh@365 -- # decimal 2 00:04:07.479 15:05:05 -- scripts/common.sh@352 -- # local d=2 00:04:07.479 15:05:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.479 15:05:05 -- scripts/common.sh@354 -- # echo 2 00:04:07.479 15:05:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.479 15:05:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.479 15:05:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.479 15:05:05 -- scripts/common.sh@367 -- # return 0 00:04:07.479 15:05:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.479 --rc genhtml_branch_coverage=1 00:04:07.479 --rc genhtml_function_coverage=1 00:04:07.479 --rc genhtml_legend=1 00:04:07.479 --rc geninfo_all_blocks=1 00:04:07.479 --rc geninfo_unexecuted_blocks=1 00:04:07.479 00:04:07.479 ' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.479 --rc genhtml_branch_coverage=1 00:04:07.479 --rc genhtml_function_coverage=1 00:04:07.479 --rc genhtml_legend=1 00:04:07.479 --rc geninfo_all_blocks=1 00:04:07.479 --rc geninfo_unexecuted_blocks=1 00:04:07.479 00:04:07.479 ' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.479 --rc genhtml_branch_coverage=1 00:04:07.479 --rc genhtml_function_coverage=1 00:04:07.479 --rc genhtml_legend=1 00:04:07.479 --rc geninfo_all_blocks=1 00:04:07.479 --rc geninfo_unexecuted_blocks=1 00:04:07.479 00:04:07.479 ' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.479 --rc genhtml_branch_coverage=1 00:04:07.479 --rc genhtml_function_coverage=1 00:04:07.479 --rc genhtml_legend=1 00:04:07.479 --rc geninfo_all_blocks=1 00:04:07.479 --rc geninfo_unexecuted_blocks=1 00:04:07.479 00:04:07.479 ' 00:04:07.479 15:05:05 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:07.479 15:05:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.479 15:05:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.479 15:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.479 ************************************ 00:04:07.479 START TEST env_memory 00:04:07.479 ************************************ 00:04:07.479 15:05:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:07.479 00:04:07.479 00:04:07.479 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.479 http://cunit.sourceforge.net/ 00:04:07.479 00:04:07.479 00:04:07.479 Suite: memory 00:04:07.479 Test: alloc and free memory map ...[2024-11-19 15:05:05.900830] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:07.479 passed 00:04:07.479 Test: mem map translation ...[2024-11-19 15:05:05.920915] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:07.479 [2024-11-19 15:05:05.920936] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:07.479 [2024-11-19 15:05:05.920983] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:07.479 [2024-11-19 15:05:05.920995] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:07.479 passed 00:04:07.479 Test: mem map registration ...[2024-11-19 15:05:05.965179] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:07.479 [2024-11-19 15:05:05.965199] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:07.479 passed 00:04:07.479 Test: mem map adjacent registrations ...passed 00:04:07.479 00:04:07.479 Run Summary: Type Total Ran Passed Failed Inactive 00:04:07.479 suites 1 1 n/a 0 0 00:04:07.479 tests 4 4 4 0 0 00:04:07.479 asserts 152 152 152 0 n/a 00:04:07.479 00:04:07.479 Elapsed time = 0.146 seconds 00:04:07.479 00:04:07.479 real 0m0.153s 00:04:07.479 user 0m0.147s 00:04:07.479 sys 0m0.006s 00:04:07.479 15:05:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:07.479 15:05:06 -- common/autotest_common.sh@10 -- # set +x 00:04:07.479 ************************************ 00:04:07.479 END TEST env_memory 00:04:07.479 ************************************ 00:04:07.738 15:05:06 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:07.738 15:05:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.738 15:05:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.738 15:05:06 -- common/autotest_common.sh@10 -- # set +x 00:04:07.738 ************************************ 00:04:07.738 START TEST env_vtophys 00:04:07.738 ************************************ 00:04:07.738 15:05:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:07.738 EAL: lib.eal log level changed from notice to debug 00:04:07.738 EAL: Detected lcore 0 as core 0 on socket 0 00:04:07.738 EAL: Detected lcore 1 as core 1 on socket 0 00:04:07.738 EAL: Detected lcore 2 as core 2 on socket 0 00:04:07.738 EAL: Detected lcore 3 as core 3 on socket 0 00:04:07.738 EAL: Detected lcore 4 as core 4 on socket 0 00:04:07.738 EAL: Detected lcore 5 as core 5 on socket 0 00:04:07.738 EAL: Detected lcore 6 as core 8 on socket 0 00:04:07.738 EAL: Detected lcore 7 as core 9 on socket 0 00:04:07.738 EAL: Detected lcore 8 as core 10 on socket 0 00:04:07.738 EAL: Detected lcore 9 as core 11 on socket 0 00:04:07.738 EAL: Detected lcore 10 as core 12 on socket 0 00:04:07.738 EAL: Detected lcore 11 as core 13 on socket 0 00:04:07.738 EAL: Detected lcore 12 as core 0 on socket 1 00:04:07.738 EAL: Detected lcore 13 as core 1 on socket 1 00:04:07.738 EAL: Detected lcore 14 as core 2 on socket 1 00:04:07.738 EAL: Detected lcore 15 as core 3 on socket 1 00:04:07.738 EAL: Detected lcore 16 as core 4 on socket 1 00:04:07.738 EAL: Detected lcore 17 as core 5 on socket 1 00:04:07.738 EAL: Detected lcore 18 as core 8 on socket 1 00:04:07.738 EAL: Detected lcore 19 as core 9 on socket 1 00:04:07.738 EAL: Detected lcore 20 as core 10 on socket 1 00:04:07.738 EAL: Detected lcore 21 as core 11 on socket 1 00:04:07.738 EAL: Detected lcore 22 as core 12 on socket 1 00:04:07.739 EAL: Detected lcore 23 as core 13 on socket 1 00:04:07.739 EAL: Detected lcore 24 as core 0 on socket 0 00:04:07.739 EAL: Detected lcore 25 as core 1 on socket 0 00:04:07.739 EAL: Detected lcore 26 as core 2 on socket 0 00:04:07.739 EAL: Detected lcore 27 as core 3 on socket 0 00:04:07.739 EAL: Detected lcore 28 as core 4 on socket 0 00:04:07.739 EAL: Detected lcore 29 as core 5 on socket 0 00:04:07.739 EAL: Detected lcore 30 as core 8 on socket 0 00:04:07.739 EAL: Detected lcore 31 as core 9 on socket 0 00:04:07.739 EAL: Detected lcore 32 as core 10 on socket 0 00:04:07.739 EAL: Detected lcore 33 as core 11 on socket 0 00:04:07.739 EAL: Detected lcore 34 as core 12 on socket 0 00:04:07.739 EAL: Detected lcore 35 as core 13 on socket 0 00:04:07.739 EAL: Detected lcore 36 as core 0 on socket 1 00:04:07.739 EAL: Detected lcore 37 as core 1 on socket 1 00:04:07.739 EAL: Detected lcore 38 as core 2 on socket 1 00:04:07.739 EAL: Detected lcore 39 as core 3 on socket 1 00:04:07.739 EAL: Detected lcore 40 as core 4 on socket 1 00:04:07.739 EAL: Detected lcore 41 as core 5 on socket 1 00:04:07.739 EAL: Detected lcore 42 as core 8 on socket 1 00:04:07.739 EAL: Detected lcore 43 as core 9 on socket 1 00:04:07.739 EAL: Detected lcore 44 as core 10 on socket 1 00:04:07.739 EAL: Detected lcore 45 as core 11 on socket 1 00:04:07.739 EAL: Detected lcore 46 as core 12 on socket 1 00:04:07.739 EAL: Detected lcore 47 as core 13 on socket 1 00:04:07.739 EAL: Maximum logical cores by configuration: 128 00:04:07.739 EAL: Detected CPU lcores: 48 00:04:07.739 EAL: Detected NUMA nodes: 2 00:04:07.739 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:07.739 EAL: Detected shared linkage of DPDK 00:04:07.739 EAL: No shared files mode enabled, IPC will be disabled 00:04:07.739 EAL: Bus pci wants IOVA as 'DC' 00:04:07.739 EAL: Buses did not request a specific IOVA mode. 00:04:07.739 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:07.739 EAL: Selected IOVA mode 'VA' 00:04:07.739 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.739 EAL: Probing VFIO support... 00:04:07.739 EAL: IOMMU type 1 (Type 1) is supported 00:04:07.739 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:07.739 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:07.739 EAL: VFIO support initialized 00:04:07.739 EAL: Ask a virtual area of 0x2e000 bytes 00:04:07.739 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:07.739 EAL: Setting up physically contiguous memory... 00:04:07.739 EAL: Setting maximum number of open files to 524288 00:04:07.739 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:07.739 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:07.739 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:07.739 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:07.739 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.739 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:07.739 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.739 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.739 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:07.739 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:07.739 EAL: Hugepages will be freed exactly as allocated. 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: TSC frequency is ~2700000 KHz 00:04:07.739 EAL: Main lcore 0 is ready (tid=7f2447305a00;cpuset=[0]) 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 0 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 2MB 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:07.739 EAL: Mem event callback 'spdk:(nil)' registered 00:04:07.739 00:04:07.739 00:04:07.739 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.739 http://cunit.sourceforge.net/ 00:04:07.739 00:04:07.739 00:04:07.739 Suite: components_suite 00:04:07.739 Test: vtophys_malloc_test ...passed 00:04:07.739 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 4MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 4MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 6MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 6MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 10MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 10MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 18MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 18MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 34MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 34MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.739 EAL: Restoring previous memory policy: 4 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was expanded by 66MB 00:04:07.739 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.739 EAL: request: mp_malloc_sync 00:04:07.739 EAL: No shared files mode enabled, IPC is disabled 00:04:07.739 EAL: Heap on socket 0 was shrunk by 66MB 00:04:07.739 EAL: Trying to obtain current memory policy. 00:04:07.740 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.740 EAL: Restoring previous memory policy: 4 00:04:07.740 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.740 EAL: request: mp_malloc_sync 00:04:07.740 EAL: No shared files mode enabled, IPC is disabled 00:04:07.740 EAL: Heap on socket 0 was expanded by 130MB 00:04:07.740 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.740 EAL: request: mp_malloc_sync 00:04:07.740 EAL: No shared files mode enabled, IPC is disabled 00:04:07.740 EAL: Heap on socket 0 was shrunk by 130MB 00:04:07.740 EAL: Trying to obtain current memory policy. 00:04:07.740 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.998 EAL: Restoring previous memory policy: 4 00:04:07.998 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.998 EAL: request: mp_malloc_sync 00:04:07.998 EAL: No shared files mode enabled, IPC is disabled 00:04:07.998 EAL: Heap on socket 0 was expanded by 258MB 00:04:07.998 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.998 EAL: request: mp_malloc_sync 00:04:07.998 EAL: No shared files mode enabled, IPC is disabled 00:04:07.998 EAL: Heap on socket 0 was shrunk by 258MB 00:04:07.998 EAL: Trying to obtain current memory policy. 00:04:07.998 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:08.256 EAL: Restoring previous memory policy: 4 00:04:08.256 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.256 EAL: request: mp_malloc_sync 00:04:08.256 EAL: No shared files mode enabled, IPC is disabled 00:04:08.256 EAL: Heap on socket 0 was expanded by 514MB 00:04:08.256 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.256 EAL: request: mp_malloc_sync 00:04:08.256 EAL: No shared files mode enabled, IPC is disabled 00:04:08.256 EAL: Heap on socket 0 was shrunk by 514MB 00:04:08.256 EAL: Trying to obtain current memory policy. 00:04:08.256 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:08.823 EAL: Restoring previous memory policy: 4 00:04:08.823 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.823 EAL: request: mp_malloc_sync 00:04:08.823 EAL: No shared files mode enabled, IPC is disabled 00:04:08.823 EAL: Heap on socket 0 was expanded by 1026MB 00:04:08.823 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.081 EAL: request: mp_malloc_sync 00:04:09.081 EAL: No shared files mode enabled, IPC is disabled 00:04:09.081 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:09.081 passed 00:04:09.081 00:04:09.081 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.081 suites 1 1 n/a 0 0 00:04:09.081 tests 2 2 2 0 0 00:04:09.081 asserts 497 497 497 0 n/a 00:04:09.081 00:04:09.081 Elapsed time = 1.383 seconds 00:04:09.081 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.081 EAL: request: mp_malloc_sync 00:04:09.081 EAL: No shared files mode enabled, IPC is disabled 00:04:09.081 EAL: Heap on socket 0 was shrunk by 2MB 00:04:09.081 EAL: No shared files mode enabled, IPC is disabled 00:04:09.081 EAL: No shared files mode enabled, IPC is disabled 00:04:09.081 EAL: No shared files mode enabled, IPC is disabled 00:04:09.081 00:04:09.081 real 0m1.500s 00:04:09.081 user 0m0.861s 00:04:09.081 sys 0m0.605s 00:04:09.081 15:05:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.081 15:05:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 ************************************ 00:04:09.081 END TEST env_vtophys 00:04:09.081 ************************************ 00:04:09.081 15:05:07 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:09.081 15:05:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.081 15:05:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.081 15:05:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 ************************************ 00:04:09.081 START TEST env_pci 00:04:09.081 ************************************ 00:04:09.081 15:05:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:09.081 00:04:09.081 00:04:09.081 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.081 http://cunit.sourceforge.net/ 00:04:09.081 00:04:09.081 00:04:09.081 Suite: pci 00:04:09.081 Test: pci_hook ...[2024-11-19 15:05:07.584270] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2639462 has claimed it 00:04:09.081 EAL: Cannot find device (10000:00:01.0) 00:04:09.081 EAL: Failed to attach device on primary process 00:04:09.081 passed 00:04:09.081 00:04:09.081 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.081 suites 1 1 n/a 0 0 00:04:09.081 tests 1 1 1 0 0 00:04:09.081 asserts 25 25 25 0 n/a 00:04:09.081 00:04:09.081 Elapsed time = 0.021 seconds 00:04:09.081 00:04:09.081 real 0m0.035s 00:04:09.081 user 0m0.010s 00:04:09.081 sys 0m0.025s 00:04:09.081 15:05:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.081 15:05:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 ************************************ 00:04:09.081 END TEST env_pci 00:04:09.081 ************************************ 00:04:09.081 15:05:07 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:09.081 15:05:07 -- env/env.sh@15 -- # uname 00:04:09.081 15:05:07 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:09.081 15:05:07 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:09.081 15:05:07 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:09.081 15:05:07 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:09.081 15:05:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.081 15:05:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 ************************************ 00:04:09.081 START TEST env_dpdk_post_init 00:04:09.081 ************************************ 00:04:09.081 15:05:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:09.340 EAL: Detected CPU lcores: 48 00:04:09.340 EAL: Detected NUMA nodes: 2 00:04:09.340 EAL: Detected shared linkage of DPDK 00:04:09.340 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:09.340 EAL: Selected IOVA mode 'VA' 00:04:09.340 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.340 EAL: VFIO support initialized 00:04:09.340 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:09.340 EAL: Using IOMMU type 1 (Type 1) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:09.340 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:09.341 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:09.600 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:09.600 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:09.600 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:10.166 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:13.448 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:13.448 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:13.707 Starting DPDK initialization... 00:04:13.707 Starting SPDK post initialization... 00:04:13.707 SPDK NVMe probe 00:04:13.707 Attaching to 0000:88:00.0 00:04:13.707 Attached to 0000:88:00.0 00:04:13.707 Cleaning up... 00:04:13.707 00:04:13.707 real 0m4.395s 00:04:13.707 user 0m3.272s 00:04:13.707 sys 0m0.181s 00:04:13.707 15:05:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.707 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.707 ************************************ 00:04:13.707 END TEST env_dpdk_post_init 00:04:13.707 ************************************ 00:04:13.707 15:05:12 -- env/env.sh@26 -- # uname 00:04:13.707 15:05:12 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:13.707 15:05:12 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:13.707 15:05:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.707 15:05:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.707 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.707 ************************************ 00:04:13.707 START TEST env_mem_callbacks 00:04:13.707 ************************************ 00:04:13.707 15:05:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:13.707 EAL: Detected CPU lcores: 48 00:04:13.707 EAL: Detected NUMA nodes: 2 00:04:13.707 EAL: Detected shared linkage of DPDK 00:04:13.707 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:13.707 EAL: Selected IOVA mode 'VA' 00:04:13.707 EAL: No free 2048 kB hugepages reported on node 1 00:04:13.707 EAL: VFIO support initialized 00:04:13.707 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:13.707 00:04:13.707 00:04:13.707 CUnit - A unit testing framework for C - Version 2.1-3 00:04:13.707 http://cunit.sourceforge.net/ 00:04:13.707 00:04:13.707 00:04:13.707 Suite: memory 00:04:13.707 Test: test ... 00:04:13.707 register 0x200000200000 2097152 00:04:13.707 malloc 3145728 00:04:13.707 register 0x200000400000 4194304 00:04:13.707 buf 0x200000500000 len 3145728 PASSED 00:04:13.707 malloc 64 00:04:13.707 buf 0x2000004fff40 len 64 PASSED 00:04:13.707 malloc 4194304 00:04:13.707 register 0x200000800000 6291456 00:04:13.707 buf 0x200000a00000 len 4194304 PASSED 00:04:13.707 free 0x200000500000 3145728 00:04:13.707 free 0x2000004fff40 64 00:04:13.707 unregister 0x200000400000 4194304 PASSED 00:04:13.707 free 0x200000a00000 4194304 00:04:13.707 unregister 0x200000800000 6291456 PASSED 00:04:13.707 malloc 8388608 00:04:13.707 register 0x200000400000 10485760 00:04:13.707 buf 0x200000600000 len 8388608 PASSED 00:04:13.707 free 0x200000600000 8388608 00:04:13.707 unregister 0x200000400000 10485760 PASSED 00:04:13.707 passed 00:04:13.707 00:04:13.707 Run Summary: Type Total Ran Passed Failed Inactive 00:04:13.707 suites 1 1 n/a 0 0 00:04:13.707 tests 1 1 1 0 0 00:04:13.707 asserts 15 15 15 0 n/a 00:04:13.707 00:04:13.707 Elapsed time = 0.005 seconds 00:04:13.707 00:04:13.707 real 0m0.047s 00:04:13.707 user 0m0.012s 00:04:13.707 sys 0m0.035s 00:04:13.707 15:05:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.707 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.707 ************************************ 00:04:13.707 END TEST env_mem_callbacks 00:04:13.707 ************************************ 00:04:13.707 00:04:13.707 real 0m6.406s 00:04:13.707 user 0m4.453s 00:04:13.707 sys 0m1.005s 00:04:13.707 15:05:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.707 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.707 ************************************ 00:04:13.707 END TEST env 00:04:13.707 ************************************ 00:04:13.707 15:05:12 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:13.707 15:05:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.707 15:05:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.707 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.707 ************************************ 00:04:13.707 START TEST rpc 00:04:13.707 ************************************ 00:04:13.707 15:05:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:13.707 * Looking for test storage... 00:04:13.707 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:13.707 15:05:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:13.707 15:05:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:13.707 15:05:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:13.966 15:05:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:13.966 15:05:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:13.966 15:05:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:13.966 15:05:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:13.966 15:05:12 -- scripts/common.sh@335 -- # IFS=.-: 00:04:13.966 15:05:12 -- scripts/common.sh@335 -- # read -ra ver1 00:04:13.966 15:05:12 -- scripts/common.sh@336 -- # IFS=.-: 00:04:13.966 15:05:12 -- scripts/common.sh@336 -- # read -ra ver2 00:04:13.966 15:05:12 -- scripts/common.sh@337 -- # local 'op=<' 00:04:13.966 15:05:12 -- scripts/common.sh@339 -- # ver1_l=2 00:04:13.966 15:05:12 -- scripts/common.sh@340 -- # ver2_l=1 00:04:13.966 15:05:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:13.966 15:05:12 -- scripts/common.sh@343 -- # case "$op" in 00:04:13.966 15:05:12 -- scripts/common.sh@344 -- # : 1 00:04:13.966 15:05:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:13.966 15:05:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:13.966 15:05:12 -- scripts/common.sh@364 -- # decimal 1 00:04:13.966 15:05:12 -- scripts/common.sh@352 -- # local d=1 00:04:13.966 15:05:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:13.966 15:05:12 -- scripts/common.sh@354 -- # echo 1 00:04:13.966 15:05:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:13.966 15:05:12 -- scripts/common.sh@365 -- # decimal 2 00:04:13.966 15:05:12 -- scripts/common.sh@352 -- # local d=2 00:04:13.966 15:05:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:13.966 15:05:12 -- scripts/common.sh@354 -- # echo 2 00:04:13.967 15:05:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:13.967 15:05:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:13.967 15:05:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:13.967 15:05:12 -- scripts/common.sh@367 -- # return 0 00:04:13.967 15:05:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:13.967 15:05:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:13.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.967 --rc genhtml_branch_coverage=1 00:04:13.967 --rc genhtml_function_coverage=1 00:04:13.967 --rc genhtml_legend=1 00:04:13.967 --rc geninfo_all_blocks=1 00:04:13.967 --rc geninfo_unexecuted_blocks=1 00:04:13.967 00:04:13.967 ' 00:04:13.967 15:05:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:13.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.967 --rc genhtml_branch_coverage=1 00:04:13.967 --rc genhtml_function_coverage=1 00:04:13.967 --rc genhtml_legend=1 00:04:13.967 --rc geninfo_all_blocks=1 00:04:13.967 --rc geninfo_unexecuted_blocks=1 00:04:13.967 00:04:13.967 ' 00:04:13.967 15:05:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:13.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.967 --rc genhtml_branch_coverage=1 00:04:13.967 --rc genhtml_function_coverage=1 00:04:13.967 --rc genhtml_legend=1 00:04:13.967 --rc geninfo_all_blocks=1 00:04:13.967 --rc geninfo_unexecuted_blocks=1 00:04:13.967 00:04:13.967 ' 00:04:13.967 15:05:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:13.967 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.967 --rc genhtml_branch_coverage=1 00:04:13.967 --rc genhtml_function_coverage=1 00:04:13.967 --rc genhtml_legend=1 00:04:13.967 --rc geninfo_all_blocks=1 00:04:13.967 --rc geninfo_unexecuted_blocks=1 00:04:13.967 00:04:13.967 ' 00:04:13.967 15:05:12 -- rpc/rpc.sh@65 -- # spdk_pid=2640141 00:04:13.967 15:05:12 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:13.967 15:05:12 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:13.967 15:05:12 -- rpc/rpc.sh@67 -- # waitforlisten 2640141 00:04:13.967 15:05:12 -- common/autotest_common.sh@829 -- # '[' -z 2640141 ']' 00:04:13.967 15:05:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:13.967 15:05:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:13.967 15:05:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:13.967 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:13.967 15:05:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:13.967 15:05:12 -- common/autotest_common.sh@10 -- # set +x 00:04:13.967 [2024-11-19 15:05:12.330194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:13.967 [2024-11-19 15:05:12.330277] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2640141 ] 00:04:13.967 EAL: No free 2048 kB hugepages reported on node 1 00:04:13.967 [2024-11-19 15:05:12.386531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:13.967 [2024-11-19 15:05:12.493170] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:13.967 [2024-11-19 15:05:12.493319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:13.967 [2024-11-19 15:05:12.493339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2640141' to capture a snapshot of events at runtime. 00:04:13.967 [2024-11-19 15:05:12.493351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2640141 for offline analysis/debug. 00:04:13.967 [2024-11-19 15:05:12.493380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:14.901 15:05:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:14.901 15:05:13 -- common/autotest_common.sh@862 -- # return 0 00:04:14.901 15:05:13 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:14.901 15:05:13 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:14.901 15:05:13 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:14.901 15:05:13 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:14.901 15:05:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.901 15:05:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.901 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.901 ************************************ 00:04:14.901 START TEST rpc_integrity 00:04:14.901 ************************************ 00:04:14.901 15:05:13 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:14.901 15:05:13 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:14.901 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.901 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.901 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.901 15:05:13 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:14.901 15:05:13 -- rpc/rpc.sh@13 -- # jq length 00:04:14.901 15:05:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:14.901 15:05:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:14.901 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.901 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.901 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.901 15:05:13 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:14.901 15:05:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:14.901 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.901 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.901 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.901 15:05:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:14.901 { 00:04:14.901 "name": "Malloc0", 00:04:14.901 "aliases": [ 00:04:14.901 "9cc72243-8d9d-4c7d-81cf-1b0bcd987c61" 00:04:14.901 ], 00:04:14.901 "product_name": "Malloc disk", 00:04:14.901 "block_size": 512, 00:04:14.901 "num_blocks": 16384, 00:04:14.901 "uuid": "9cc72243-8d9d-4c7d-81cf-1b0bcd987c61", 00:04:14.902 "assigned_rate_limits": { 00:04:14.902 "rw_ios_per_sec": 0, 00:04:14.902 "rw_mbytes_per_sec": 0, 00:04:14.902 "r_mbytes_per_sec": 0, 00:04:14.902 "w_mbytes_per_sec": 0 00:04:14.902 }, 00:04:14.902 "claimed": false, 00:04:14.902 "zoned": false, 00:04:14.902 "supported_io_types": { 00:04:14.902 "read": true, 00:04:14.902 "write": true, 00:04:14.902 "unmap": true, 00:04:14.902 "write_zeroes": true, 00:04:14.902 "flush": true, 00:04:14.902 "reset": true, 00:04:14.902 "compare": false, 00:04:14.902 "compare_and_write": false, 00:04:14.902 "abort": true, 00:04:14.902 "nvme_admin": false, 00:04:14.902 "nvme_io": false 00:04:14.902 }, 00:04:14.902 "memory_domains": [ 00:04:14.902 { 00:04:14.902 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.902 "dma_device_type": 2 00:04:14.902 } 00:04:14.902 ], 00:04:14.902 "driver_specific": {} 00:04:14.902 } 00:04:14.902 ]' 00:04:14.902 15:05:13 -- rpc/rpc.sh@17 -- # jq length 00:04:14.902 15:05:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:14.902 15:05:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:14.902 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.902 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.902 [2024-11-19 15:05:13.405672] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:14.902 [2024-11-19 15:05:13.405745] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:14.902 [2024-11-19 15:05:13.405769] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x16afcb0 00:04:14.902 [2024-11-19 15:05:13.405782] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:14.902 [2024-11-19 15:05:13.407251] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:14.902 [2024-11-19 15:05:13.407280] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:14.902 Passthru0 00:04:14.902 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.902 15:05:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:14.902 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.902 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.902 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.902 15:05:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:14.902 { 00:04:14.902 "name": "Malloc0", 00:04:14.902 "aliases": [ 00:04:14.902 "9cc72243-8d9d-4c7d-81cf-1b0bcd987c61" 00:04:14.902 ], 00:04:14.902 "product_name": "Malloc disk", 00:04:14.902 "block_size": 512, 00:04:14.902 "num_blocks": 16384, 00:04:14.902 "uuid": "9cc72243-8d9d-4c7d-81cf-1b0bcd987c61", 00:04:14.902 "assigned_rate_limits": { 00:04:14.902 "rw_ios_per_sec": 0, 00:04:14.902 "rw_mbytes_per_sec": 0, 00:04:14.902 "r_mbytes_per_sec": 0, 00:04:14.902 "w_mbytes_per_sec": 0 00:04:14.902 }, 00:04:14.902 "claimed": true, 00:04:14.902 "claim_type": "exclusive_write", 00:04:14.902 "zoned": false, 00:04:14.902 "supported_io_types": { 00:04:14.902 "read": true, 00:04:14.902 "write": true, 00:04:14.902 "unmap": true, 00:04:14.902 "write_zeroes": true, 00:04:14.902 "flush": true, 00:04:14.902 "reset": true, 00:04:14.902 "compare": false, 00:04:14.902 "compare_and_write": false, 00:04:14.902 "abort": true, 00:04:14.902 "nvme_admin": false, 00:04:14.902 "nvme_io": false 00:04:14.902 }, 00:04:14.902 "memory_domains": [ 00:04:14.902 { 00:04:14.902 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.902 "dma_device_type": 2 00:04:14.902 } 00:04:14.902 ], 00:04:14.902 "driver_specific": {} 00:04:14.902 }, 00:04:14.902 { 00:04:14.902 "name": "Passthru0", 00:04:14.902 "aliases": [ 00:04:14.902 "7e1facd6-40dd-559a-9a2d-603a574903ea" 00:04:14.902 ], 00:04:14.902 "product_name": "passthru", 00:04:14.902 "block_size": 512, 00:04:14.902 "num_blocks": 16384, 00:04:14.902 "uuid": "7e1facd6-40dd-559a-9a2d-603a574903ea", 00:04:14.902 "assigned_rate_limits": { 00:04:14.902 "rw_ios_per_sec": 0, 00:04:14.902 "rw_mbytes_per_sec": 0, 00:04:14.902 "r_mbytes_per_sec": 0, 00:04:14.902 "w_mbytes_per_sec": 0 00:04:14.902 }, 00:04:14.902 "claimed": false, 00:04:14.902 "zoned": false, 00:04:14.902 "supported_io_types": { 00:04:14.902 "read": true, 00:04:14.902 "write": true, 00:04:14.902 "unmap": true, 00:04:14.902 "write_zeroes": true, 00:04:14.902 "flush": true, 00:04:14.902 "reset": true, 00:04:14.902 "compare": false, 00:04:14.902 "compare_and_write": false, 00:04:14.902 "abort": true, 00:04:14.902 "nvme_admin": false, 00:04:14.902 "nvme_io": false 00:04:14.902 }, 00:04:14.902 "memory_domains": [ 00:04:14.902 { 00:04:14.902 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.902 "dma_device_type": 2 00:04:14.902 } 00:04:14.902 ], 00:04:14.902 "driver_specific": { 00:04:14.902 "passthru": { 00:04:14.902 "name": "Passthru0", 00:04:14.902 "base_bdev_name": "Malloc0" 00:04:14.902 } 00:04:14.902 } 00:04:14.902 } 00:04:14.902 ]' 00:04:14.902 15:05:13 -- rpc/rpc.sh@21 -- # jq length 00:04:14.902 15:05:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:14.902 15:05:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:14.902 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:14.902 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:15.161 15:05:13 -- rpc/rpc.sh@26 -- # jq length 00:04:15.161 15:05:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:15.161 00:04:15.161 real 0m0.230s 00:04:15.161 user 0m0.151s 00:04:15.161 sys 0m0.022s 00:04:15.161 15:05:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 ************************************ 00:04:15.161 END TEST rpc_integrity 00:04:15.161 ************************************ 00:04:15.161 15:05:13 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:15.161 15:05:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.161 15:05:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 ************************************ 00:04:15.161 START TEST rpc_plugins 00:04:15.161 ************************************ 00:04:15.161 15:05:13 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:15.161 15:05:13 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:15.161 15:05:13 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:15.161 { 00:04:15.161 "name": "Malloc1", 00:04:15.161 "aliases": [ 00:04:15.161 "990cb537-e471-44e4-900a-80100efc7dd8" 00:04:15.161 ], 00:04:15.161 "product_name": "Malloc disk", 00:04:15.161 "block_size": 4096, 00:04:15.161 "num_blocks": 256, 00:04:15.161 "uuid": "990cb537-e471-44e4-900a-80100efc7dd8", 00:04:15.161 "assigned_rate_limits": { 00:04:15.161 "rw_ios_per_sec": 0, 00:04:15.161 "rw_mbytes_per_sec": 0, 00:04:15.161 "r_mbytes_per_sec": 0, 00:04:15.161 "w_mbytes_per_sec": 0 00:04:15.161 }, 00:04:15.161 "claimed": false, 00:04:15.161 "zoned": false, 00:04:15.161 "supported_io_types": { 00:04:15.161 "read": true, 00:04:15.161 "write": true, 00:04:15.161 "unmap": true, 00:04:15.161 "write_zeroes": true, 00:04:15.161 "flush": true, 00:04:15.161 "reset": true, 00:04:15.161 "compare": false, 00:04:15.161 "compare_and_write": false, 00:04:15.161 "abort": true, 00:04:15.161 "nvme_admin": false, 00:04:15.161 "nvme_io": false 00:04:15.161 }, 00:04:15.161 "memory_domains": [ 00:04:15.161 { 00:04:15.161 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.161 "dma_device_type": 2 00:04:15.161 } 00:04:15.161 ], 00:04:15.161 "driver_specific": {} 00:04:15.161 } 00:04:15.161 ]' 00:04:15.161 15:05:13 -- rpc/rpc.sh@32 -- # jq length 00:04:15.161 15:05:13 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:15.161 15:05:13 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:15.161 15:05:13 -- rpc/rpc.sh@36 -- # jq length 00:04:15.161 15:05:13 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:15.161 00:04:15.161 real 0m0.113s 00:04:15.161 user 0m0.067s 00:04:15.161 sys 0m0.015s 00:04:15.161 15:05:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 ************************************ 00:04:15.161 END TEST rpc_plugins 00:04:15.161 ************************************ 00:04:15.161 15:05:13 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:15.161 15:05:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.161 15:05:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 ************************************ 00:04:15.161 START TEST rpc_trace_cmd_test 00:04:15.161 ************************************ 00:04:15.161 15:05:13 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:15.161 15:05:13 -- rpc/rpc.sh@40 -- # local info 00:04:15.161 15:05:13 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:15.161 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.161 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.161 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.161 15:05:13 -- rpc/rpc.sh@42 -- # info='{ 00:04:15.161 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2640141", 00:04:15.161 "tpoint_group_mask": "0x8", 00:04:15.161 "iscsi_conn": { 00:04:15.161 "mask": "0x2", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "scsi": { 00:04:15.161 "mask": "0x4", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "bdev": { 00:04:15.161 "mask": "0x8", 00:04:15.161 "tpoint_mask": "0xffffffffffffffff" 00:04:15.161 }, 00:04:15.161 "nvmf_rdma": { 00:04:15.161 "mask": "0x10", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "nvmf_tcp": { 00:04:15.161 "mask": "0x20", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "ftl": { 00:04:15.161 "mask": "0x40", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "blobfs": { 00:04:15.161 "mask": "0x80", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "dsa": { 00:04:15.161 "mask": "0x200", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "thread": { 00:04:15.161 "mask": "0x400", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "nvme_pcie": { 00:04:15.161 "mask": "0x800", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "iaa": { 00:04:15.161 "mask": "0x1000", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "nvme_tcp": { 00:04:15.161 "mask": "0x2000", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 }, 00:04:15.161 "bdev_nvme": { 00:04:15.161 "mask": "0x4000", 00:04:15.161 "tpoint_mask": "0x0" 00:04:15.161 } 00:04:15.161 }' 00:04:15.161 15:05:13 -- rpc/rpc.sh@43 -- # jq length 00:04:15.420 15:05:13 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:15.420 15:05:13 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:15.420 15:05:13 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:15.420 15:05:13 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:15.420 15:05:13 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:15.420 15:05:13 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:15.420 15:05:13 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:15.420 15:05:13 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:15.420 15:05:13 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:15.420 00:04:15.420 real 0m0.194s 00:04:15.420 user 0m0.167s 00:04:15.420 sys 0m0.017s 00:04:15.420 15:05:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.420 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.420 ************************************ 00:04:15.420 END TEST rpc_trace_cmd_test 00:04:15.420 ************************************ 00:04:15.420 15:05:13 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:15.420 15:05:13 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:15.420 15:05:13 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:15.420 15:05:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.420 15:05:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.420 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.420 ************************************ 00:04:15.420 START TEST rpc_daemon_integrity 00:04:15.420 ************************************ 00:04:15.420 15:05:13 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:15.420 15:05:13 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:15.420 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.420 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.420 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.420 15:05:13 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:15.420 15:05:13 -- rpc/rpc.sh@13 -- # jq length 00:04:15.420 15:05:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:15.420 15:05:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:15.420 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.420 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.420 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.420 15:05:13 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:15.420 15:05:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:15.420 15:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.420 15:05:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.420 15:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.420 15:05:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:15.420 { 00:04:15.420 "name": "Malloc2", 00:04:15.420 "aliases": [ 00:04:15.420 "284a7259-8e76-41cb-a813-0822f65dc9ea" 00:04:15.420 ], 00:04:15.420 "product_name": "Malloc disk", 00:04:15.420 "block_size": 512, 00:04:15.420 "num_blocks": 16384, 00:04:15.420 "uuid": "284a7259-8e76-41cb-a813-0822f65dc9ea", 00:04:15.420 "assigned_rate_limits": { 00:04:15.420 "rw_ios_per_sec": 0, 00:04:15.420 "rw_mbytes_per_sec": 0, 00:04:15.420 "r_mbytes_per_sec": 0, 00:04:15.420 "w_mbytes_per_sec": 0 00:04:15.420 }, 00:04:15.420 "claimed": false, 00:04:15.420 "zoned": false, 00:04:15.420 "supported_io_types": { 00:04:15.420 "read": true, 00:04:15.420 "write": true, 00:04:15.420 "unmap": true, 00:04:15.420 "write_zeroes": true, 00:04:15.420 "flush": true, 00:04:15.420 "reset": true, 00:04:15.420 "compare": false, 00:04:15.420 "compare_and_write": false, 00:04:15.420 "abort": true, 00:04:15.420 "nvme_admin": false, 00:04:15.420 "nvme_io": false 00:04:15.421 }, 00:04:15.421 "memory_domains": [ 00:04:15.421 { 00:04:15.421 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.421 "dma_device_type": 2 00:04:15.421 } 00:04:15.421 ], 00:04:15.421 "driver_specific": {} 00:04:15.421 } 00:04:15.421 ]' 00:04:15.421 15:05:13 -- rpc/rpc.sh@17 -- # jq length 00:04:15.679 15:05:14 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:15.679 15:05:14 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:15.679 15:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.679 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.679 [2024-11-19 15:05:14.019553] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:15.679 [2024-11-19 15:05:14.019601] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:15.679 [2024-11-19 15:05:14.019626] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x16b1590 00:04:15.679 [2024-11-19 15:05:14.019641] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:15.679 [2024-11-19 15:05:14.020986] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:15.679 [2024-11-19 15:05:14.021010] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:15.679 Passthru0 00:04:15.679 15:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.679 15:05:14 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:15.679 15:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.679 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.679 15:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.679 15:05:14 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:15.679 { 00:04:15.679 "name": "Malloc2", 00:04:15.679 "aliases": [ 00:04:15.679 "284a7259-8e76-41cb-a813-0822f65dc9ea" 00:04:15.679 ], 00:04:15.679 "product_name": "Malloc disk", 00:04:15.679 "block_size": 512, 00:04:15.679 "num_blocks": 16384, 00:04:15.679 "uuid": "284a7259-8e76-41cb-a813-0822f65dc9ea", 00:04:15.679 "assigned_rate_limits": { 00:04:15.679 "rw_ios_per_sec": 0, 00:04:15.679 "rw_mbytes_per_sec": 0, 00:04:15.679 "r_mbytes_per_sec": 0, 00:04:15.679 "w_mbytes_per_sec": 0 00:04:15.679 }, 00:04:15.679 "claimed": true, 00:04:15.679 "claim_type": "exclusive_write", 00:04:15.679 "zoned": false, 00:04:15.679 "supported_io_types": { 00:04:15.679 "read": true, 00:04:15.679 "write": true, 00:04:15.679 "unmap": true, 00:04:15.679 "write_zeroes": true, 00:04:15.679 "flush": true, 00:04:15.679 "reset": true, 00:04:15.679 "compare": false, 00:04:15.679 "compare_and_write": false, 00:04:15.679 "abort": true, 00:04:15.679 "nvme_admin": false, 00:04:15.679 "nvme_io": false 00:04:15.680 }, 00:04:15.680 "memory_domains": [ 00:04:15.680 { 00:04:15.680 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.680 "dma_device_type": 2 00:04:15.680 } 00:04:15.680 ], 00:04:15.680 "driver_specific": {} 00:04:15.680 }, 00:04:15.680 { 00:04:15.680 "name": "Passthru0", 00:04:15.680 "aliases": [ 00:04:15.680 "3ffef1cf-dc02-5b29-bc98-713276f10b24" 00:04:15.680 ], 00:04:15.680 "product_name": "passthru", 00:04:15.680 "block_size": 512, 00:04:15.680 "num_blocks": 16384, 00:04:15.680 "uuid": "3ffef1cf-dc02-5b29-bc98-713276f10b24", 00:04:15.680 "assigned_rate_limits": { 00:04:15.680 "rw_ios_per_sec": 0, 00:04:15.680 "rw_mbytes_per_sec": 0, 00:04:15.680 "r_mbytes_per_sec": 0, 00:04:15.680 "w_mbytes_per_sec": 0 00:04:15.680 }, 00:04:15.680 "claimed": false, 00:04:15.680 "zoned": false, 00:04:15.680 "supported_io_types": { 00:04:15.680 "read": true, 00:04:15.680 "write": true, 00:04:15.680 "unmap": true, 00:04:15.680 "write_zeroes": true, 00:04:15.680 "flush": true, 00:04:15.680 "reset": true, 00:04:15.680 "compare": false, 00:04:15.680 "compare_and_write": false, 00:04:15.680 "abort": true, 00:04:15.680 "nvme_admin": false, 00:04:15.680 "nvme_io": false 00:04:15.680 }, 00:04:15.680 "memory_domains": [ 00:04:15.680 { 00:04:15.680 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.680 "dma_device_type": 2 00:04:15.680 } 00:04:15.680 ], 00:04:15.680 "driver_specific": { 00:04:15.680 "passthru": { 00:04:15.680 "name": "Passthru0", 00:04:15.680 "base_bdev_name": "Malloc2" 00:04:15.680 } 00:04:15.680 } 00:04:15.680 } 00:04:15.680 ]' 00:04:15.680 15:05:14 -- rpc/rpc.sh@21 -- # jq length 00:04:15.680 15:05:14 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:15.680 15:05:14 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:15.680 15:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.680 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.680 15:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.680 15:05:14 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:15.680 15:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.680 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.680 15:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.680 15:05:14 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:15.680 15:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:15.680 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.680 15:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:15.680 15:05:14 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:15.680 15:05:14 -- rpc/rpc.sh@26 -- # jq length 00:04:15.680 15:05:14 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:15.680 00:04:15.680 real 0m0.229s 00:04:15.680 user 0m0.150s 00:04:15.680 sys 0m0.018s 00:04:15.680 15:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.680 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.680 ************************************ 00:04:15.680 END TEST rpc_daemon_integrity 00:04:15.680 ************************************ 00:04:15.680 15:05:14 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:15.680 15:05:14 -- rpc/rpc.sh@84 -- # killprocess 2640141 00:04:15.680 15:05:14 -- common/autotest_common.sh@936 -- # '[' -z 2640141 ']' 00:04:15.680 15:05:14 -- common/autotest_common.sh@940 -- # kill -0 2640141 00:04:15.680 15:05:14 -- common/autotest_common.sh@941 -- # uname 00:04:15.680 15:05:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:15.680 15:05:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2640141 00:04:15.680 15:05:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:15.680 15:05:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:15.680 15:05:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2640141' 00:04:15.680 killing process with pid 2640141 00:04:15.680 15:05:14 -- common/autotest_common.sh@955 -- # kill 2640141 00:04:15.680 15:05:14 -- common/autotest_common.sh@960 -- # wait 2640141 00:04:16.248 00:04:16.248 real 0m2.501s 00:04:16.248 user 0m3.142s 00:04:16.248 sys 0m0.609s 00:04:16.248 15:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.248 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.248 ************************************ 00:04:16.248 END TEST rpc 00:04:16.248 ************************************ 00:04:16.248 15:05:14 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:16.248 15:05:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.248 15:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.248 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.248 ************************************ 00:04:16.248 START TEST rpc_client 00:04:16.248 ************************************ 00:04:16.248 15:05:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:16.248 * Looking for test storage... 00:04:16.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:16.248 15:05:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:16.248 15:05:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:16.248 15:05:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:16.507 15:05:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:16.507 15:05:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:16.507 15:05:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:16.507 15:05:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:16.507 15:05:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:16.507 15:05:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:16.507 15:05:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:16.507 15:05:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:16.507 15:05:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:16.507 15:05:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:16.507 15:05:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:16.507 15:05:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:16.507 15:05:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:16.507 15:05:14 -- scripts/common.sh@344 -- # : 1 00:04:16.507 15:05:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:16.507 15:05:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:16.508 15:05:14 -- scripts/common.sh@364 -- # decimal 1 00:04:16.508 15:05:14 -- scripts/common.sh@352 -- # local d=1 00:04:16.508 15:05:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:16.508 15:05:14 -- scripts/common.sh@354 -- # echo 1 00:04:16.508 15:05:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:16.508 15:05:14 -- scripts/common.sh@365 -- # decimal 2 00:04:16.508 15:05:14 -- scripts/common.sh@352 -- # local d=2 00:04:16.508 15:05:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:16.508 15:05:14 -- scripts/common.sh@354 -- # echo 2 00:04:16.508 15:05:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:16.508 15:05:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:16.508 15:05:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:16.508 15:05:14 -- scripts/common.sh@367 -- # return 0 00:04:16.508 15:05:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:16.508 OK 00:04:16.508 15:05:14 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:16.508 00:04:16.508 real 0m0.159s 00:04:16.508 user 0m0.109s 00:04:16.508 sys 0m0.059s 00:04:16.508 15:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.508 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.508 ************************************ 00:04:16.508 END TEST rpc_client 00:04:16.508 ************************************ 00:04:16.508 15:05:14 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:16.508 15:05:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.508 15:05:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.508 ************************************ 00:04:16.508 START TEST json_config 00:04:16.508 ************************************ 00:04:16.508 15:05:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:16.508 15:05:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:16.508 15:05:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:16.508 15:05:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:16.508 15:05:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:16.508 15:05:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:16.508 15:05:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:16.508 15:05:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:16.508 15:05:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:16.508 15:05:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:16.508 15:05:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:16.508 15:05:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:16.508 15:05:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:16.508 15:05:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:16.508 15:05:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:16.508 15:05:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:16.508 15:05:14 -- scripts/common.sh@344 -- # : 1 00:04:16.508 15:05:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:16.508 15:05:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:16.508 15:05:14 -- scripts/common.sh@364 -- # decimal 1 00:04:16.508 15:05:14 -- scripts/common.sh@352 -- # local d=1 00:04:16.508 15:05:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:16.508 15:05:14 -- scripts/common.sh@354 -- # echo 1 00:04:16.508 15:05:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:16.508 15:05:14 -- scripts/common.sh@365 -- # decimal 2 00:04:16.508 15:05:14 -- scripts/common.sh@352 -- # local d=2 00:04:16.508 15:05:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:16.508 15:05:14 -- scripts/common.sh@354 -- # echo 2 00:04:16.508 15:05:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:16.508 15:05:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:16.508 15:05:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:16.508 15:05:14 -- scripts/common.sh@367 -- # return 0 00:04:16.508 15:05:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:16.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.508 --rc genhtml_branch_coverage=1 00:04:16.508 --rc genhtml_function_coverage=1 00:04:16.508 --rc genhtml_legend=1 00:04:16.508 --rc geninfo_all_blocks=1 00:04:16.508 --rc geninfo_unexecuted_blocks=1 00:04:16.508 00:04:16.508 ' 00:04:16.508 15:05:14 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:16.508 15:05:14 -- nvmf/common.sh@7 -- # uname -s 00:04:16.508 15:05:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:16.508 15:05:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:16.508 15:05:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:16.508 15:05:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:16.508 15:05:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:16.508 15:05:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:16.508 15:05:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:16.508 15:05:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:16.508 15:05:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:16.508 15:05:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:16.508 15:05:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:16.508 15:05:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:16.508 15:05:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:16.508 15:05:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:16.508 15:05:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:16.508 15:05:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:16.508 15:05:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:16.508 15:05:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:16.508 15:05:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:16.508 15:05:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:16.508 15:05:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:16.508 15:05:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:16.508 15:05:14 -- paths/export.sh@5 -- # export PATH 00:04:16.509 15:05:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:16.509 15:05:14 -- nvmf/common.sh@46 -- # : 0 00:04:16.509 15:05:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:16.509 15:05:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:16.509 15:05:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:16.509 15:05:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:16.509 15:05:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:16.509 15:05:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:16.509 15:05:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:16.509 15:05:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:16.509 15:05:14 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:16.509 15:05:14 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:16.509 15:05:14 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:16.509 15:05:14 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:16.509 15:05:14 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:16.509 15:05:14 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:16.509 15:05:14 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:16.509 15:05:14 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:16.509 15:05:14 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:16.509 15:05:14 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:16.509 15:05:14 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:16.509 15:05:15 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:16.509 15:05:15 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:16.509 15:05:15 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:16.509 15:05:15 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:16.509 INFO: JSON configuration test init 00:04:16.509 15:05:15 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:16.509 15:05:15 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:16.509 15:05:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:16.509 15:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.509 15:05:15 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:16.509 15:05:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:16.509 15:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.509 15:05:15 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:16.509 15:05:15 -- json_config/json_config.sh@98 -- # local app=target 00:04:16.509 15:05:15 -- json_config/json_config.sh@99 -- # shift 00:04:16.509 15:05:15 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:16.509 15:05:15 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:16.509 15:05:15 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:16.509 15:05:15 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:16.509 15:05:15 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:16.509 15:05:15 -- json_config/json_config.sh@111 -- # app_pid[$app]=2640653 00:04:16.509 15:05:15 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:16.509 15:05:15 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:16.509 Waiting for target to run... 00:04:16.509 15:05:15 -- json_config/json_config.sh@114 -- # waitforlisten 2640653 /var/tmp/spdk_tgt.sock 00:04:16.509 15:05:15 -- common/autotest_common.sh@829 -- # '[' -z 2640653 ']' 00:04:16.509 15:05:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:16.509 15:05:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:16.509 15:05:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:16.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:16.509 15:05:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:16.509 15:05:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.509 [2024-11-19 15:05:15.054588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:16.509 [2024-11-19 15:05:15.054682] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2640653 ] 00:04:16.768 EAL: No free 2048 kB hugepages reported on node 1 00:04:17.026 [2024-11-19 15:05:15.389046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:17.026 [2024-11-19 15:05:15.479137] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:17.026 [2024-11-19 15:05:15.479313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.592 15:05:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:17.592 15:05:16 -- common/autotest_common.sh@862 -- # return 0 00:04:17.592 15:05:16 -- json_config/json_config.sh@115 -- # echo '' 00:04:17.592 00:04:17.592 15:05:16 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:17.592 15:05:16 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:17.592 15:05:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.592 15:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:17.592 15:05:16 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:17.592 15:05:16 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:17.592 15:05:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:17.592 15:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:17.592 15:05:16 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:17.592 15:05:16 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:17.592 15:05:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:20.877 15:05:19 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:20.877 15:05:19 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:20.877 15:05:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.877 15:05:19 -- common/autotest_common.sh@10 -- # set +x 00:04:20.877 15:05:19 -- json_config/json_config.sh@48 -- # local ret=0 00:04:20.877 15:05:19 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:20.877 15:05:19 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:20.877 15:05:19 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:20.877 15:05:19 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:20.877 15:05:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:21.135 15:05:19 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:21.135 15:05:19 -- json_config/json_config.sh@51 -- # local get_types 00:04:21.135 15:05:19 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:21.135 15:05:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:21.135 15:05:19 -- common/autotest_common.sh@10 -- # set +x 00:04:21.135 15:05:19 -- json_config/json_config.sh@58 -- # return 0 00:04:21.135 15:05:19 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:21.135 15:05:19 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:21.135 15:05:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:21.135 15:05:19 -- common/autotest_common.sh@10 -- # set +x 00:04:21.135 15:05:19 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:21.135 15:05:19 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:21.135 15:05:19 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:21.135 15:05:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:21.393 MallocForNvmf0 00:04:21.393 15:05:19 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:21.393 15:05:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:21.651 MallocForNvmf1 00:04:21.651 15:05:20 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:21.651 15:05:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:21.909 [2024-11-19 15:05:20.252351] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:21.909 15:05:20 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:21.909 15:05:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:22.166 15:05:20 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:22.166 15:05:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:22.423 15:05:20 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:22.423 15:05:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:22.681 15:05:21 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:22.681 15:05:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:22.969 [2024-11-19 15:05:21.259683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:22.969 15:05:21 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:22.969 15:05:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:22.969 15:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:22.969 15:05:21 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:22.969 15:05:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:22.969 15:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:22.969 15:05:21 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:22.969 15:05:21 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:22.969 15:05:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:23.235 MallocBdevForConfigChangeCheck 00:04:23.235 15:05:21 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:23.235 15:05:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:23.235 15:05:21 -- common/autotest_common.sh@10 -- # set +x 00:04:23.235 15:05:21 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:23.235 15:05:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:23.553 15:05:21 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:23.553 INFO: shutting down applications... 00:04:23.553 15:05:21 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:23.553 15:05:21 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:23.553 15:05:21 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:23.553 15:05:21 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:25.481 Calling clear_iscsi_subsystem 00:04:25.481 Calling clear_nvmf_subsystem 00:04:25.481 Calling clear_nbd_subsystem 00:04:25.481 Calling clear_ublk_subsystem 00:04:25.481 Calling clear_vhost_blk_subsystem 00:04:25.481 Calling clear_vhost_scsi_subsystem 00:04:25.481 Calling clear_scheduler_subsystem 00:04:25.481 Calling clear_bdev_subsystem 00:04:25.481 Calling clear_accel_subsystem 00:04:25.481 Calling clear_vmd_subsystem 00:04:25.481 Calling clear_sock_subsystem 00:04:25.481 Calling clear_iobuf_subsystem 00:04:25.481 15:05:23 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:25.481 15:05:23 -- json_config/json_config.sh@396 -- # count=100 00:04:25.481 15:05:23 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:25.481 15:05:23 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:25.481 15:05:23 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:25.481 15:05:23 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:25.481 15:05:23 -- json_config/json_config.sh@398 -- # break 00:04:25.481 15:05:23 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:25.481 15:05:23 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:25.481 15:05:23 -- json_config/json_config.sh@120 -- # local app=target 00:04:25.481 15:05:23 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:25.481 15:05:23 -- json_config/json_config.sh@124 -- # [[ -n 2640653 ]] 00:04:25.481 15:05:23 -- json_config/json_config.sh@127 -- # kill -SIGINT 2640653 00:04:25.481 15:05:23 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:25.481 15:05:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:25.481 15:05:23 -- json_config/json_config.sh@130 -- # kill -0 2640653 00:04:25.481 15:05:23 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:26.046 15:05:24 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:26.046 15:05:24 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:26.046 15:05:24 -- json_config/json_config.sh@130 -- # kill -0 2640653 00:04:26.046 15:05:24 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:26.046 15:05:24 -- json_config/json_config.sh@132 -- # break 00:04:26.046 15:05:24 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:26.046 15:05:24 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:26.046 SPDK target shutdown done 00:04:26.046 15:05:24 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:26.046 INFO: relaunching applications... 00:04:26.046 15:05:24 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.046 15:05:24 -- json_config/json_config.sh@98 -- # local app=target 00:04:26.046 15:05:24 -- json_config/json_config.sh@99 -- # shift 00:04:26.046 15:05:24 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:26.046 15:05:24 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:26.046 15:05:24 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:26.046 15:05:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:26.046 15:05:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:26.046 15:05:24 -- json_config/json_config.sh@111 -- # app_pid[$app]=2641985 00:04:26.046 15:05:24 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.046 15:05:24 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:26.046 Waiting for target to run... 00:04:26.046 15:05:24 -- json_config/json_config.sh@114 -- # waitforlisten 2641985 /var/tmp/spdk_tgt.sock 00:04:26.046 15:05:24 -- common/autotest_common.sh@829 -- # '[' -z 2641985 ']' 00:04:26.046 15:05:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:26.046 15:05:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:26.046 15:05:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:26.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:26.046 15:05:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:26.046 15:05:24 -- common/autotest_common.sh@10 -- # set +x 00:04:26.046 [2024-11-19 15:05:24.495523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:26.046 [2024-11-19 15:05:24.495629] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2641985 ] 00:04:26.046 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.613 [2024-11-19 15:05:25.033623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.613 [2024-11-19 15:05:25.139021] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.613 [2024-11-19 15:05:25.139229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.898 [2024-11-19 15:05:28.173850] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:29.898 [2024-11-19 15:05:28.206318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:29.898 15:05:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.898 15:05:28 -- common/autotest_common.sh@862 -- # return 0 00:04:29.898 15:05:28 -- json_config/json_config.sh@115 -- # echo '' 00:04:29.898 00:04:29.898 15:05:28 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:29.898 15:05:28 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:29.898 INFO: Checking if target configuration is the same... 00:04:29.898 15:05:28 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:29.898 15:05:28 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:29.898 15:05:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:29.898 + '[' 2 -ne 2 ']' 00:04:29.898 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:29.898 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:29.898 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:29.898 +++ basename /dev/fd/62 00:04:29.898 ++ mktemp /tmp/62.XXX 00:04:29.898 + tmp_file_1=/tmp/62.qVy 00:04:29.898 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:29.898 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:29.898 + tmp_file_2=/tmp/spdk_tgt_config.json.FsC 00:04:29.898 + ret=0 00:04:29.898 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:30.464 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:30.464 + diff -u /tmp/62.qVy /tmp/spdk_tgt_config.json.FsC 00:04:30.464 + echo 'INFO: JSON config files are the same' 00:04:30.464 INFO: JSON config files are the same 00:04:30.464 + rm /tmp/62.qVy /tmp/spdk_tgt_config.json.FsC 00:04:30.464 + exit 0 00:04:30.464 15:05:28 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:30.464 15:05:28 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:30.464 INFO: changing configuration and checking if this can be detected... 00:04:30.464 15:05:28 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:30.464 15:05:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:30.722 15:05:29 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:30.722 15:05:29 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:30.722 15:05:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:30.722 + '[' 2 -ne 2 ']' 00:04:30.722 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:30.722 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:30.722 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:30.722 +++ basename /dev/fd/62 00:04:30.722 ++ mktemp /tmp/62.XXX 00:04:30.722 + tmp_file_1=/tmp/62.nc3 00:04:30.722 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:30.722 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:30.722 + tmp_file_2=/tmp/spdk_tgt_config.json.HVX 00:04:30.722 + ret=0 00:04:30.722 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:30.980 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:30.980 + diff -u /tmp/62.nc3 /tmp/spdk_tgt_config.json.HVX 00:04:30.980 + ret=1 00:04:30.980 + echo '=== Start of file: /tmp/62.nc3 ===' 00:04:30.980 + cat /tmp/62.nc3 00:04:30.980 + echo '=== End of file: /tmp/62.nc3 ===' 00:04:30.980 + echo '' 00:04:30.980 + echo '=== Start of file: /tmp/spdk_tgt_config.json.HVX ===' 00:04:30.980 + cat /tmp/spdk_tgt_config.json.HVX 00:04:30.980 + echo '=== End of file: /tmp/spdk_tgt_config.json.HVX ===' 00:04:30.980 + echo '' 00:04:30.980 + rm /tmp/62.nc3 /tmp/spdk_tgt_config.json.HVX 00:04:30.980 + exit 1 00:04:30.980 15:05:29 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:30.980 INFO: configuration change detected. 00:04:30.980 15:05:29 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:30.980 15:05:29 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:30.980 15:05:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:30.980 15:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:30.980 15:05:29 -- json_config/json_config.sh@360 -- # local ret=0 00:04:30.980 15:05:29 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:30.980 15:05:29 -- json_config/json_config.sh@370 -- # [[ -n 2641985 ]] 00:04:30.980 15:05:29 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:30.980 15:05:29 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:30.980 15:05:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:30.980 15:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:30.980 15:05:29 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:30.980 15:05:29 -- json_config/json_config.sh@246 -- # uname -s 00:04:30.980 15:05:29 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:30.980 15:05:29 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:30.980 15:05:29 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:30.980 15:05:29 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:30.980 15:05:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:30.980 15:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:30.980 15:05:29 -- json_config/json_config.sh@376 -- # killprocess 2641985 00:04:30.980 15:05:29 -- common/autotest_common.sh@936 -- # '[' -z 2641985 ']' 00:04:30.980 15:05:29 -- common/autotest_common.sh@940 -- # kill -0 2641985 00:04:30.980 15:05:29 -- common/autotest_common.sh@941 -- # uname 00:04:30.980 15:05:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:30.980 15:05:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2641985 00:04:31.239 15:05:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.239 15:05:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.239 15:05:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2641985' 00:04:31.239 killing process with pid 2641985 00:04:31.239 15:05:29 -- common/autotest_common.sh@955 -- # kill 2641985 00:04:31.239 15:05:29 -- common/autotest_common.sh@960 -- # wait 2641985 00:04:33.141 15:05:31 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:33.141 15:05:31 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:33.141 15:05:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.141 15:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.141 15:05:31 -- json_config/json_config.sh@381 -- # return 0 00:04:33.141 15:05:31 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:33.141 INFO: Success 00:04:33.141 00:04:33.141 real 0m16.434s 00:04:33.141 user 0m18.951s 00:04:33.141 sys 0m2.142s 00:04:33.141 15:05:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.141 15:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.141 ************************************ 00:04:33.141 END TEST json_config 00:04:33.141 ************************************ 00:04:33.141 15:05:31 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:33.141 15:05:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.141 15:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.141 15:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.141 ************************************ 00:04:33.141 START TEST json_config_extra_key 00:04:33.141 ************************************ 00:04:33.141 15:05:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:33.141 15:05:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:33.141 15:05:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:33.141 15:05:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:33.141 15:05:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:33.141 15:05:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:33.141 15:05:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:33.141 15:05:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:33.141 15:05:31 -- scripts/common.sh@335 -- # IFS=.-: 00:04:33.141 15:05:31 -- scripts/common.sh@335 -- # read -ra ver1 00:04:33.142 15:05:31 -- scripts/common.sh@336 -- # IFS=.-: 00:04:33.142 15:05:31 -- scripts/common.sh@336 -- # read -ra ver2 00:04:33.142 15:05:31 -- scripts/common.sh@337 -- # local 'op=<' 00:04:33.142 15:05:31 -- scripts/common.sh@339 -- # ver1_l=2 00:04:33.142 15:05:31 -- scripts/common.sh@340 -- # ver2_l=1 00:04:33.142 15:05:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:33.142 15:05:31 -- scripts/common.sh@343 -- # case "$op" in 00:04:33.142 15:05:31 -- scripts/common.sh@344 -- # : 1 00:04:33.142 15:05:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:33.142 15:05:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:33.142 15:05:31 -- scripts/common.sh@364 -- # decimal 1 00:04:33.142 15:05:31 -- scripts/common.sh@352 -- # local d=1 00:04:33.142 15:05:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:33.142 15:05:31 -- scripts/common.sh@354 -- # echo 1 00:04:33.142 15:05:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:33.142 15:05:31 -- scripts/common.sh@365 -- # decimal 2 00:04:33.142 15:05:31 -- scripts/common.sh@352 -- # local d=2 00:04:33.142 15:05:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:33.142 15:05:31 -- scripts/common.sh@354 -- # echo 2 00:04:33.142 15:05:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:33.142 15:05:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:33.142 15:05:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:33.142 15:05:31 -- scripts/common.sh@367 -- # return 0 00:04:33.142 15:05:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:33.142 15:05:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:33.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.142 --rc genhtml_branch_coverage=1 00:04:33.142 --rc genhtml_function_coverage=1 00:04:33.142 --rc genhtml_legend=1 00:04:33.142 --rc geninfo_all_blocks=1 00:04:33.142 --rc geninfo_unexecuted_blocks=1 00:04:33.142 00:04:33.142 ' 00:04:33.142 15:05:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:33.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.142 --rc genhtml_branch_coverage=1 00:04:33.142 --rc genhtml_function_coverage=1 00:04:33.142 --rc genhtml_legend=1 00:04:33.142 --rc geninfo_all_blocks=1 00:04:33.142 --rc geninfo_unexecuted_blocks=1 00:04:33.142 00:04:33.142 ' 00:04:33.142 15:05:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:33.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.142 --rc genhtml_branch_coverage=1 00:04:33.142 --rc genhtml_function_coverage=1 00:04:33.142 --rc genhtml_legend=1 00:04:33.142 --rc geninfo_all_blocks=1 00:04:33.142 --rc geninfo_unexecuted_blocks=1 00:04:33.142 00:04:33.142 ' 00:04:33.142 15:05:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:33.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.142 --rc genhtml_branch_coverage=1 00:04:33.142 --rc genhtml_function_coverage=1 00:04:33.142 --rc genhtml_legend=1 00:04:33.142 --rc geninfo_all_blocks=1 00:04:33.142 --rc geninfo_unexecuted_blocks=1 00:04:33.142 00:04:33.142 ' 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:33.142 15:05:31 -- nvmf/common.sh@7 -- # uname -s 00:04:33.142 15:05:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:33.142 15:05:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:33.142 15:05:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:33.142 15:05:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:33.142 15:05:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:33.142 15:05:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:33.142 15:05:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:33.142 15:05:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:33.142 15:05:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:33.142 15:05:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:33.142 15:05:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:33.142 15:05:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:33.142 15:05:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:33.142 15:05:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:33.142 15:05:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:33.142 15:05:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:33.142 15:05:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:33.142 15:05:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:33.142 15:05:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:33.142 15:05:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:33.142 15:05:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:33.142 15:05:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:33.142 15:05:31 -- paths/export.sh@5 -- # export PATH 00:04:33.142 15:05:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:33.142 15:05:31 -- nvmf/common.sh@46 -- # : 0 00:04:33.142 15:05:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:33.142 15:05:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:33.142 15:05:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:33.142 15:05:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:33.142 15:05:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:33.142 15:05:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:33.142 15:05:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:33.142 15:05:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:33.142 INFO: launching applications... 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2642935 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:33.142 Waiting for target to run... 00:04:33.142 15:05:31 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2642935 /var/tmp/spdk_tgt.sock 00:04:33.142 15:05:31 -- common/autotest_common.sh@829 -- # '[' -z 2642935 ']' 00:04:33.142 15:05:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:33.142 15:05:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.142 15:05:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:33.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:33.142 15:05:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.142 15:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.142 [2024-11-19 15:05:31.502954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.142 [2024-11-19 15:05:31.503051] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2642935 ] 00:04:33.142 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.709 [2024-11-19 15:05:31.999484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.709 [2024-11-19 15:05:32.097966] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.709 [2024-11-19 15:05:32.098158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.967 15:05:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.967 15:05:32 -- common/autotest_common.sh@862 -- # return 0 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:33.967 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:33.967 INFO: shutting down applications... 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2642935 ]] 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2642935 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2642935 00:04:33.967 15:05:32 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:34.534 15:05:32 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:34.534 15:05:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:34.534 15:05:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2642935 00:04:34.534 15:05:32 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2642935 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:35.103 SPDK target shutdown done 00:04:35.103 15:05:33 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:35.103 Success 00:04:35.103 00:04:35.103 real 0m2.181s 00:04:35.103 user 0m1.598s 00:04:35.103 sys 0m0.591s 00:04:35.103 15:05:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.103 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:35.103 ************************************ 00:04:35.103 END TEST json_config_extra_key 00:04:35.103 ************************************ 00:04:35.103 15:05:33 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:35.103 15:05:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.103 15:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.103 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:35.103 ************************************ 00:04:35.103 START TEST alias_rpc 00:04:35.103 ************************************ 00:04:35.103 15:05:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:35.103 * Looking for test storage... 00:04:35.103 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:35.103 15:05:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.103 15:05:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.103 15:05:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.103 15:05:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.103 15:05:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.103 15:05:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.103 15:05:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.103 15:05:33 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.103 15:05:33 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.103 15:05:33 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.103 15:05:33 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.103 15:05:33 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.103 15:05:33 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.103 15:05:33 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.103 15:05:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.103 15:05:33 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.103 15:05:33 -- scripts/common.sh@344 -- # : 1 00:04:35.103 15:05:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.103 15:05:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.103 15:05:33 -- scripts/common.sh@364 -- # decimal 1 00:04:35.103 15:05:33 -- scripts/common.sh@352 -- # local d=1 00:04:35.103 15:05:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.103 15:05:33 -- scripts/common.sh@354 -- # echo 1 00:04:35.103 15:05:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.362 15:05:33 -- scripts/common.sh@365 -- # decimal 2 00:04:35.362 15:05:33 -- scripts/common.sh@352 -- # local d=2 00:04:35.362 15:05:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.362 15:05:33 -- scripts/common.sh@354 -- # echo 2 00:04:35.362 15:05:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.362 15:05:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.362 15:05:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.362 15:05:33 -- scripts/common.sh@367 -- # return 0 00:04:35.362 15:05:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.362 15:05:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.362 --rc genhtml_branch_coverage=1 00:04:35.362 --rc genhtml_function_coverage=1 00:04:35.362 --rc genhtml_legend=1 00:04:35.362 --rc geninfo_all_blocks=1 00:04:35.362 --rc geninfo_unexecuted_blocks=1 00:04:35.362 00:04:35.362 ' 00:04:35.362 15:05:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.362 --rc genhtml_branch_coverage=1 00:04:35.362 --rc genhtml_function_coverage=1 00:04:35.362 --rc genhtml_legend=1 00:04:35.362 --rc geninfo_all_blocks=1 00:04:35.362 --rc geninfo_unexecuted_blocks=1 00:04:35.362 00:04:35.362 ' 00:04:35.362 15:05:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.362 --rc genhtml_branch_coverage=1 00:04:35.362 --rc genhtml_function_coverage=1 00:04:35.362 --rc genhtml_legend=1 00:04:35.362 --rc geninfo_all_blocks=1 00:04:35.362 --rc geninfo_unexecuted_blocks=1 00:04:35.362 00:04:35.362 ' 00:04:35.362 15:05:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.362 --rc genhtml_branch_coverage=1 00:04:35.362 --rc genhtml_function_coverage=1 00:04:35.362 --rc genhtml_legend=1 00:04:35.362 --rc geninfo_all_blocks=1 00:04:35.363 --rc geninfo_unexecuted_blocks=1 00:04:35.363 00:04:35.363 ' 00:04:35.363 15:05:33 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:35.363 15:05:33 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2643261 00:04:35.363 15:05:33 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:35.363 15:05:33 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2643261 00:04:35.363 15:05:33 -- common/autotest_common.sh@829 -- # '[' -z 2643261 ']' 00:04:35.363 15:05:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.363 15:05:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.363 15:05:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.363 15:05:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.363 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:35.363 [2024-11-19 15:05:33.716349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.363 [2024-11-19 15:05:33.716445] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2643261 ] 00:04:35.363 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.363 [2024-11-19 15:05:33.772239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.363 [2024-11-19 15:05:33.883239] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.363 [2024-11-19 15:05:33.883445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.296 15:05:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.296 15:05:34 -- common/autotest_common.sh@862 -- # return 0 00:04:36.296 15:05:34 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:36.554 15:05:34 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2643261 00:04:36.554 15:05:34 -- common/autotest_common.sh@936 -- # '[' -z 2643261 ']' 00:04:36.554 15:05:34 -- common/autotest_common.sh@940 -- # kill -0 2643261 00:04:36.554 15:05:34 -- common/autotest_common.sh@941 -- # uname 00:04:36.554 15:05:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:36.554 15:05:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2643261 00:04:36.554 15:05:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:36.554 15:05:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:36.554 15:05:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2643261' 00:04:36.554 killing process with pid 2643261 00:04:36.554 15:05:34 -- common/autotest_common.sh@955 -- # kill 2643261 00:04:36.554 15:05:34 -- common/autotest_common.sh@960 -- # wait 2643261 00:04:37.120 00:04:37.120 real 0m1.880s 00:04:37.120 user 0m2.133s 00:04:37.120 sys 0m0.486s 00:04:37.120 15:05:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.120 15:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:37.120 ************************************ 00:04:37.120 END TEST alias_rpc 00:04:37.120 ************************************ 00:04:37.120 15:05:35 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:37.120 15:05:35 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:37.120 15:05:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.120 15:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.120 15:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:37.120 ************************************ 00:04:37.120 START TEST spdkcli_tcp 00:04:37.120 ************************************ 00:04:37.120 15:05:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:37.120 * Looking for test storage... 00:04:37.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:37.120 15:05:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:37.120 15:05:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:37.120 15:05:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:37.120 15:05:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:37.120 15:05:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:37.120 15:05:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:37.120 15:05:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:37.120 15:05:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:37.120 15:05:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:37.120 15:05:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:37.120 15:05:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:37.120 15:05:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:37.120 15:05:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:37.120 15:05:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:37.120 15:05:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:37.120 15:05:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:37.120 15:05:35 -- scripts/common.sh@344 -- # : 1 00:04:37.120 15:05:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:37.120 15:05:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:37.120 15:05:35 -- scripts/common.sh@364 -- # decimal 1 00:04:37.120 15:05:35 -- scripts/common.sh@352 -- # local d=1 00:04:37.120 15:05:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:37.120 15:05:35 -- scripts/common.sh@354 -- # echo 1 00:04:37.120 15:05:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:37.120 15:05:35 -- scripts/common.sh@365 -- # decimal 2 00:04:37.120 15:05:35 -- scripts/common.sh@352 -- # local d=2 00:04:37.120 15:05:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:37.120 15:05:35 -- scripts/common.sh@354 -- # echo 2 00:04:37.120 15:05:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:37.120 15:05:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:37.120 15:05:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:37.120 15:05:35 -- scripts/common.sh@367 -- # return 0 00:04:37.120 15:05:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:37.120 15:05:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:37.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.120 --rc genhtml_branch_coverage=1 00:04:37.120 --rc genhtml_function_coverage=1 00:04:37.120 --rc genhtml_legend=1 00:04:37.120 --rc geninfo_all_blocks=1 00:04:37.120 --rc geninfo_unexecuted_blocks=1 00:04:37.120 00:04:37.120 ' 00:04:37.120 15:05:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:37.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.120 --rc genhtml_branch_coverage=1 00:04:37.120 --rc genhtml_function_coverage=1 00:04:37.120 --rc genhtml_legend=1 00:04:37.120 --rc geninfo_all_blocks=1 00:04:37.120 --rc geninfo_unexecuted_blocks=1 00:04:37.120 00:04:37.120 ' 00:04:37.120 15:05:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:37.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.120 --rc genhtml_branch_coverage=1 00:04:37.121 --rc genhtml_function_coverage=1 00:04:37.121 --rc genhtml_legend=1 00:04:37.121 --rc geninfo_all_blocks=1 00:04:37.121 --rc geninfo_unexecuted_blocks=1 00:04:37.121 00:04:37.121 ' 00:04:37.121 15:05:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:37.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.121 --rc genhtml_branch_coverage=1 00:04:37.121 --rc genhtml_function_coverage=1 00:04:37.121 --rc genhtml_legend=1 00:04:37.121 --rc geninfo_all_blocks=1 00:04:37.121 --rc geninfo_unexecuted_blocks=1 00:04:37.121 00:04:37.121 ' 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:37.121 15:05:35 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:37.121 15:05:35 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:37.121 15:05:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:37.121 15:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2643594 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:37.121 15:05:35 -- spdkcli/tcp.sh@27 -- # waitforlisten 2643594 00:04:37.121 15:05:35 -- common/autotest_common.sh@829 -- # '[' -z 2643594 ']' 00:04:37.121 15:05:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.121 15:05:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.121 15:05:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.121 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.121 15:05:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.121 15:05:35 -- common/autotest_common.sh@10 -- # set +x 00:04:37.121 [2024-11-19 15:05:35.615892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.121 [2024-11-19 15:05:35.615979] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2643594 ] 00:04:37.121 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.121 [2024-11-19 15:05:35.672498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:37.379 [2024-11-19 15:05:35.785376] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.379 [2024-11-19 15:05:35.785615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:37.379 [2024-11-19 15:05:35.785621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.315 15:05:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.315 15:05:36 -- common/autotest_common.sh@862 -- # return 0 00:04:38.315 15:05:36 -- spdkcli/tcp.sh@31 -- # socat_pid=2643734 00:04:38.315 15:05:36 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:38.315 15:05:36 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:38.315 [ 00:04:38.315 "bdev_malloc_delete", 00:04:38.315 "bdev_malloc_create", 00:04:38.315 "bdev_null_resize", 00:04:38.315 "bdev_null_delete", 00:04:38.315 "bdev_null_create", 00:04:38.315 "bdev_nvme_cuse_unregister", 00:04:38.315 "bdev_nvme_cuse_register", 00:04:38.315 "bdev_opal_new_user", 00:04:38.315 "bdev_opal_set_lock_state", 00:04:38.315 "bdev_opal_delete", 00:04:38.315 "bdev_opal_get_info", 00:04:38.315 "bdev_opal_create", 00:04:38.315 "bdev_nvme_opal_revert", 00:04:38.315 "bdev_nvme_opal_init", 00:04:38.315 "bdev_nvme_send_cmd", 00:04:38.315 "bdev_nvme_get_path_iostat", 00:04:38.315 "bdev_nvme_get_mdns_discovery_info", 00:04:38.315 "bdev_nvme_stop_mdns_discovery", 00:04:38.315 "bdev_nvme_start_mdns_discovery", 00:04:38.315 "bdev_nvme_set_multipath_policy", 00:04:38.315 "bdev_nvme_set_preferred_path", 00:04:38.315 "bdev_nvme_get_io_paths", 00:04:38.315 "bdev_nvme_remove_error_injection", 00:04:38.315 "bdev_nvme_add_error_injection", 00:04:38.315 "bdev_nvme_get_discovery_info", 00:04:38.315 "bdev_nvme_stop_discovery", 00:04:38.315 "bdev_nvme_start_discovery", 00:04:38.315 "bdev_nvme_get_controller_health_info", 00:04:38.315 "bdev_nvme_disable_controller", 00:04:38.315 "bdev_nvme_enable_controller", 00:04:38.315 "bdev_nvme_reset_controller", 00:04:38.315 "bdev_nvme_get_transport_statistics", 00:04:38.315 "bdev_nvme_apply_firmware", 00:04:38.315 "bdev_nvme_detach_controller", 00:04:38.315 "bdev_nvme_get_controllers", 00:04:38.315 "bdev_nvme_attach_controller", 00:04:38.315 "bdev_nvme_set_hotplug", 00:04:38.315 "bdev_nvme_set_options", 00:04:38.315 "bdev_passthru_delete", 00:04:38.315 "bdev_passthru_create", 00:04:38.315 "bdev_lvol_grow_lvstore", 00:04:38.315 "bdev_lvol_get_lvols", 00:04:38.315 "bdev_lvol_get_lvstores", 00:04:38.315 "bdev_lvol_delete", 00:04:38.315 "bdev_lvol_set_read_only", 00:04:38.315 "bdev_lvol_resize", 00:04:38.315 "bdev_lvol_decouple_parent", 00:04:38.315 "bdev_lvol_inflate", 00:04:38.315 "bdev_lvol_rename", 00:04:38.315 "bdev_lvol_clone_bdev", 00:04:38.315 "bdev_lvol_clone", 00:04:38.315 "bdev_lvol_snapshot", 00:04:38.315 "bdev_lvol_create", 00:04:38.315 "bdev_lvol_delete_lvstore", 00:04:38.315 "bdev_lvol_rename_lvstore", 00:04:38.315 "bdev_lvol_create_lvstore", 00:04:38.315 "bdev_raid_set_options", 00:04:38.315 "bdev_raid_remove_base_bdev", 00:04:38.315 "bdev_raid_add_base_bdev", 00:04:38.315 "bdev_raid_delete", 00:04:38.315 "bdev_raid_create", 00:04:38.315 "bdev_raid_get_bdevs", 00:04:38.315 "bdev_error_inject_error", 00:04:38.315 "bdev_error_delete", 00:04:38.315 "bdev_error_create", 00:04:38.315 "bdev_split_delete", 00:04:38.315 "bdev_split_create", 00:04:38.315 "bdev_delay_delete", 00:04:38.315 "bdev_delay_create", 00:04:38.315 "bdev_delay_update_latency", 00:04:38.315 "bdev_zone_block_delete", 00:04:38.315 "bdev_zone_block_create", 00:04:38.315 "blobfs_create", 00:04:38.315 "blobfs_detect", 00:04:38.315 "blobfs_set_cache_size", 00:04:38.315 "bdev_aio_delete", 00:04:38.315 "bdev_aio_rescan", 00:04:38.315 "bdev_aio_create", 00:04:38.315 "bdev_ftl_set_property", 00:04:38.315 "bdev_ftl_get_properties", 00:04:38.315 "bdev_ftl_get_stats", 00:04:38.315 "bdev_ftl_unmap", 00:04:38.315 "bdev_ftl_unload", 00:04:38.315 "bdev_ftl_delete", 00:04:38.315 "bdev_ftl_load", 00:04:38.315 "bdev_ftl_create", 00:04:38.315 "bdev_virtio_attach_controller", 00:04:38.315 "bdev_virtio_scsi_get_devices", 00:04:38.315 "bdev_virtio_detach_controller", 00:04:38.315 "bdev_virtio_blk_set_hotplug", 00:04:38.315 "bdev_iscsi_delete", 00:04:38.315 "bdev_iscsi_create", 00:04:38.315 "bdev_iscsi_set_options", 00:04:38.315 "accel_error_inject_error", 00:04:38.315 "ioat_scan_accel_module", 00:04:38.315 "dsa_scan_accel_module", 00:04:38.315 "iaa_scan_accel_module", 00:04:38.315 "iscsi_set_options", 00:04:38.315 "iscsi_get_auth_groups", 00:04:38.315 "iscsi_auth_group_remove_secret", 00:04:38.315 "iscsi_auth_group_add_secret", 00:04:38.315 "iscsi_delete_auth_group", 00:04:38.315 "iscsi_create_auth_group", 00:04:38.315 "iscsi_set_discovery_auth", 00:04:38.315 "iscsi_get_options", 00:04:38.315 "iscsi_target_node_request_logout", 00:04:38.315 "iscsi_target_node_set_redirect", 00:04:38.315 "iscsi_target_node_set_auth", 00:04:38.315 "iscsi_target_node_add_lun", 00:04:38.315 "iscsi_get_connections", 00:04:38.315 "iscsi_portal_group_set_auth", 00:04:38.315 "iscsi_start_portal_group", 00:04:38.315 "iscsi_delete_portal_group", 00:04:38.315 "iscsi_create_portal_group", 00:04:38.315 "iscsi_get_portal_groups", 00:04:38.315 "iscsi_delete_target_node", 00:04:38.315 "iscsi_target_node_remove_pg_ig_maps", 00:04:38.315 "iscsi_target_node_add_pg_ig_maps", 00:04:38.315 "iscsi_create_target_node", 00:04:38.315 "iscsi_get_target_nodes", 00:04:38.315 "iscsi_delete_initiator_group", 00:04:38.315 "iscsi_initiator_group_remove_initiators", 00:04:38.315 "iscsi_initiator_group_add_initiators", 00:04:38.315 "iscsi_create_initiator_group", 00:04:38.315 "iscsi_get_initiator_groups", 00:04:38.315 "nvmf_set_crdt", 00:04:38.315 "nvmf_set_config", 00:04:38.315 "nvmf_set_max_subsystems", 00:04:38.315 "nvmf_subsystem_get_listeners", 00:04:38.315 "nvmf_subsystem_get_qpairs", 00:04:38.315 "nvmf_subsystem_get_controllers", 00:04:38.315 "nvmf_get_stats", 00:04:38.315 "nvmf_get_transports", 00:04:38.316 "nvmf_create_transport", 00:04:38.316 "nvmf_get_targets", 00:04:38.316 "nvmf_delete_target", 00:04:38.316 "nvmf_create_target", 00:04:38.316 "nvmf_subsystem_allow_any_host", 00:04:38.316 "nvmf_subsystem_remove_host", 00:04:38.316 "nvmf_subsystem_add_host", 00:04:38.316 "nvmf_subsystem_remove_ns", 00:04:38.316 "nvmf_subsystem_add_ns", 00:04:38.316 "nvmf_subsystem_listener_set_ana_state", 00:04:38.316 "nvmf_discovery_get_referrals", 00:04:38.316 "nvmf_discovery_remove_referral", 00:04:38.316 "nvmf_discovery_add_referral", 00:04:38.316 "nvmf_subsystem_remove_listener", 00:04:38.316 "nvmf_subsystem_add_listener", 00:04:38.316 "nvmf_delete_subsystem", 00:04:38.316 "nvmf_create_subsystem", 00:04:38.316 "nvmf_get_subsystems", 00:04:38.316 "env_dpdk_get_mem_stats", 00:04:38.316 "nbd_get_disks", 00:04:38.316 "nbd_stop_disk", 00:04:38.316 "nbd_start_disk", 00:04:38.316 "ublk_recover_disk", 00:04:38.316 "ublk_get_disks", 00:04:38.316 "ublk_stop_disk", 00:04:38.316 "ublk_start_disk", 00:04:38.316 "ublk_destroy_target", 00:04:38.316 "ublk_create_target", 00:04:38.316 "virtio_blk_create_transport", 00:04:38.316 "virtio_blk_get_transports", 00:04:38.316 "vhost_controller_set_coalescing", 00:04:38.316 "vhost_get_controllers", 00:04:38.316 "vhost_delete_controller", 00:04:38.316 "vhost_create_blk_controller", 00:04:38.316 "vhost_scsi_controller_remove_target", 00:04:38.316 "vhost_scsi_controller_add_target", 00:04:38.316 "vhost_start_scsi_controller", 00:04:38.316 "vhost_create_scsi_controller", 00:04:38.316 "thread_set_cpumask", 00:04:38.316 "framework_get_scheduler", 00:04:38.316 "framework_set_scheduler", 00:04:38.316 "framework_get_reactors", 00:04:38.316 "thread_get_io_channels", 00:04:38.316 "thread_get_pollers", 00:04:38.316 "thread_get_stats", 00:04:38.316 "framework_monitor_context_switch", 00:04:38.316 "spdk_kill_instance", 00:04:38.316 "log_enable_timestamps", 00:04:38.316 "log_get_flags", 00:04:38.316 "log_clear_flag", 00:04:38.316 "log_set_flag", 00:04:38.316 "log_get_level", 00:04:38.316 "log_set_level", 00:04:38.316 "log_get_print_level", 00:04:38.316 "log_set_print_level", 00:04:38.316 "framework_enable_cpumask_locks", 00:04:38.316 "framework_disable_cpumask_locks", 00:04:38.316 "framework_wait_init", 00:04:38.316 "framework_start_init", 00:04:38.316 "scsi_get_devices", 00:04:38.316 "bdev_get_histogram", 00:04:38.316 "bdev_enable_histogram", 00:04:38.316 "bdev_set_qos_limit", 00:04:38.316 "bdev_set_qd_sampling_period", 00:04:38.316 "bdev_get_bdevs", 00:04:38.316 "bdev_reset_iostat", 00:04:38.316 "bdev_get_iostat", 00:04:38.316 "bdev_examine", 00:04:38.316 "bdev_wait_for_examine", 00:04:38.316 "bdev_set_options", 00:04:38.316 "notify_get_notifications", 00:04:38.316 "notify_get_types", 00:04:38.316 "accel_get_stats", 00:04:38.316 "accel_set_options", 00:04:38.316 "accel_set_driver", 00:04:38.316 "accel_crypto_key_destroy", 00:04:38.316 "accel_crypto_keys_get", 00:04:38.316 "accel_crypto_key_create", 00:04:38.316 "accel_assign_opc", 00:04:38.316 "accel_get_module_info", 00:04:38.316 "accel_get_opc_assignments", 00:04:38.316 "vmd_rescan", 00:04:38.316 "vmd_remove_device", 00:04:38.316 "vmd_enable", 00:04:38.316 "sock_set_default_impl", 00:04:38.316 "sock_impl_set_options", 00:04:38.316 "sock_impl_get_options", 00:04:38.316 "iobuf_get_stats", 00:04:38.316 "iobuf_set_options", 00:04:38.316 "framework_get_pci_devices", 00:04:38.316 "framework_get_config", 00:04:38.316 "framework_get_subsystems", 00:04:38.316 "trace_get_info", 00:04:38.316 "trace_get_tpoint_group_mask", 00:04:38.316 "trace_disable_tpoint_group", 00:04:38.316 "trace_enable_tpoint_group", 00:04:38.316 "trace_clear_tpoint_mask", 00:04:38.316 "trace_set_tpoint_mask", 00:04:38.316 "spdk_get_version", 00:04:38.316 "rpc_get_methods" 00:04:38.316 ] 00:04:38.316 15:05:36 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:38.316 15:05:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:38.316 15:05:36 -- common/autotest_common.sh@10 -- # set +x 00:04:38.574 15:05:36 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:38.574 15:05:36 -- spdkcli/tcp.sh@38 -- # killprocess 2643594 00:04:38.574 15:05:36 -- common/autotest_common.sh@936 -- # '[' -z 2643594 ']' 00:04:38.574 15:05:36 -- common/autotest_common.sh@940 -- # kill -0 2643594 00:04:38.574 15:05:36 -- common/autotest_common.sh@941 -- # uname 00:04:38.574 15:05:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.574 15:05:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2643594 00:04:38.574 15:05:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.574 15:05:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.574 15:05:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2643594' 00:04:38.574 killing process with pid 2643594 00:04:38.574 15:05:36 -- common/autotest_common.sh@955 -- # kill 2643594 00:04:38.574 15:05:36 -- common/autotest_common.sh@960 -- # wait 2643594 00:04:38.832 00:04:38.832 real 0m1.955s 00:04:38.832 user 0m3.763s 00:04:38.832 sys 0m0.496s 00:04:38.832 15:05:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.832 15:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:38.832 ************************************ 00:04:38.832 END TEST spdkcli_tcp 00:04:38.832 ************************************ 00:04:39.091 15:05:37 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:39.091 15:05:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.091 15:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:39.091 ************************************ 00:04:39.091 START TEST dpdk_mem_utility 00:04:39.091 ************************************ 00:04:39.091 15:05:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:39.091 * Looking for test storage... 00:04:39.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:39.091 15:05:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:39.091 15:05:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:39.091 15:05:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:39.091 15:05:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:39.091 15:05:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:39.091 15:05:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:39.091 15:05:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:39.091 15:05:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:39.091 15:05:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:39.091 15:05:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:39.091 15:05:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:39.091 15:05:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:39.091 15:05:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:39.091 15:05:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:39.091 15:05:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:39.091 15:05:37 -- scripts/common.sh@344 -- # : 1 00:04:39.091 15:05:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:39.091 15:05:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:39.091 15:05:37 -- scripts/common.sh@364 -- # decimal 1 00:04:39.091 15:05:37 -- scripts/common.sh@352 -- # local d=1 00:04:39.091 15:05:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:39.091 15:05:37 -- scripts/common.sh@354 -- # echo 1 00:04:39.091 15:05:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:39.091 15:05:37 -- scripts/common.sh@365 -- # decimal 2 00:04:39.091 15:05:37 -- scripts/common.sh@352 -- # local d=2 00:04:39.091 15:05:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:39.091 15:05:37 -- scripts/common.sh@354 -- # echo 2 00:04:39.091 15:05:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:39.091 15:05:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:39.091 15:05:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:39.091 15:05:37 -- scripts/common.sh@367 -- # return 0 00:04:39.091 15:05:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:39.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.091 --rc genhtml_branch_coverage=1 00:04:39.091 --rc genhtml_function_coverage=1 00:04:39.091 --rc genhtml_legend=1 00:04:39.091 --rc geninfo_all_blocks=1 00:04:39.091 --rc geninfo_unexecuted_blocks=1 00:04:39.091 00:04:39.091 ' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:39.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.091 --rc genhtml_branch_coverage=1 00:04:39.091 --rc genhtml_function_coverage=1 00:04:39.091 --rc genhtml_legend=1 00:04:39.091 --rc geninfo_all_blocks=1 00:04:39.091 --rc geninfo_unexecuted_blocks=1 00:04:39.091 00:04:39.091 ' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:39.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.091 --rc genhtml_branch_coverage=1 00:04:39.091 --rc genhtml_function_coverage=1 00:04:39.091 --rc genhtml_legend=1 00:04:39.091 --rc geninfo_all_blocks=1 00:04:39.091 --rc geninfo_unexecuted_blocks=1 00:04:39.091 00:04:39.091 ' 00:04:39.091 15:05:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:39.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.091 --rc genhtml_branch_coverage=1 00:04:39.091 --rc genhtml_function_coverage=1 00:04:39.091 --rc genhtml_legend=1 00:04:39.091 --rc geninfo_all_blocks=1 00:04:39.091 --rc geninfo_unexecuted_blocks=1 00:04:39.091 00:04:39.091 ' 00:04:39.091 15:05:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:39.091 15:05:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2643823 00:04:39.091 15:05:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:39.091 15:05:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2643823 00:04:39.091 15:05:37 -- common/autotest_common.sh@829 -- # '[' -z 2643823 ']' 00:04:39.091 15:05:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.091 15:05:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.091 15:05:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.091 15:05:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.091 15:05:37 -- common/autotest_common.sh@10 -- # set +x 00:04:39.091 [2024-11-19 15:05:37.604618] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.091 [2024-11-19 15:05:37.604736] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2643823 ] 00:04:39.091 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.351 [2024-11-19 15:05:37.667786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.351 [2024-11-19 15:05:37.778366] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.352 [2024-11-19 15:05:37.778545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.286 15:05:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.286 15:05:38 -- common/autotest_common.sh@862 -- # return 0 00:04:40.286 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:40.286 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:40.286 15:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.286 15:05:38 -- common/autotest_common.sh@10 -- # set +x 00:04:40.286 { 00:04:40.286 "filename": "/tmp/spdk_mem_dump.txt" 00:04:40.286 } 00:04:40.286 15:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.286 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:40.286 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:40.286 1 heaps totaling size 814.000000 MiB 00:04:40.286 size: 814.000000 MiB heap id: 0 00:04:40.286 end heaps---------- 00:04:40.286 8 mempools totaling size 598.116089 MiB 00:04:40.286 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:40.286 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:40.286 size: 84.521057 MiB name: bdev_io_2643823 00:04:40.286 size: 51.011292 MiB name: evtpool_2643823 00:04:40.286 size: 50.003479 MiB name: msgpool_2643823 00:04:40.286 size: 21.763794 MiB name: PDU_Pool 00:04:40.286 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:40.286 size: 0.026123 MiB name: Session_Pool 00:04:40.286 end mempools------- 00:04:40.286 6 memzones totaling size 4.142822 MiB 00:04:40.286 size: 1.000366 MiB name: RG_ring_0_2643823 00:04:40.286 size: 1.000366 MiB name: RG_ring_1_2643823 00:04:40.286 size: 1.000366 MiB name: RG_ring_4_2643823 00:04:40.286 size: 1.000366 MiB name: RG_ring_5_2643823 00:04:40.286 size: 0.125366 MiB name: RG_ring_2_2643823 00:04:40.286 size: 0.015991 MiB name: RG_ring_3_2643823 00:04:40.286 end memzones------- 00:04:40.286 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:40.286 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:40.286 list of free elements. size: 12.519348 MiB 00:04:40.286 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:40.286 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:40.286 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:40.286 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:40.286 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:40.286 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:40.286 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:40.286 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:40.286 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:40.286 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:40.286 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:40.286 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:40.286 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:40.286 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:40.286 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:40.286 list of standard malloc elements. size: 199.218079 MiB 00:04:40.286 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:40.286 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:40.286 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:40.286 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:40.286 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:40.286 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:40.286 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:40.286 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:40.286 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:40.286 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:40.286 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:40.286 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:40.286 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:40.286 list of memzone associated elements. size: 602.262573 MiB 00:04:40.286 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:40.287 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:40.287 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:40.287 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:40.287 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:40.287 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2643823_0 00:04:40.287 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:40.287 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2643823_0 00:04:40.287 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:40.287 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2643823_0 00:04:40.287 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:40.287 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:40.287 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:40.287 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:40.287 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:40.287 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2643823 00:04:40.287 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:40.287 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2643823 00:04:40.287 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:40.287 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2643823 00:04:40.287 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:40.287 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:40.287 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:40.287 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:40.287 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:40.287 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:40.287 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:40.287 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:40.287 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:40.287 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2643823 00:04:40.287 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:40.287 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2643823 00:04:40.287 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:40.287 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2643823 00:04:40.287 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:40.287 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2643823 00:04:40.287 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:40.287 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2643823 00:04:40.287 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:40.287 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:40.287 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:40.287 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:40.287 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:40.287 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:40.287 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:40.287 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2643823 00:04:40.287 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:40.287 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:40.287 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:40.287 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:40.287 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:40.287 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2643823 00:04:40.287 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:40.287 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:40.287 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:40.287 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2643823 00:04:40.287 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:40.287 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2643823 00:04:40.287 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:40.287 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:40.287 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:40.287 15:05:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2643823 00:04:40.287 15:05:38 -- common/autotest_common.sh@936 -- # '[' -z 2643823 ']' 00:04:40.287 15:05:38 -- common/autotest_common.sh@940 -- # kill -0 2643823 00:04:40.287 15:05:38 -- common/autotest_common.sh@941 -- # uname 00:04:40.287 15:05:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.287 15:05:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2643823 00:04:40.287 15:05:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.287 15:05:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.287 15:05:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2643823' 00:04:40.287 killing process with pid 2643823 00:04:40.287 15:05:38 -- common/autotest_common.sh@955 -- # kill 2643823 00:04:40.287 15:05:38 -- common/autotest_common.sh@960 -- # wait 2643823 00:04:40.853 00:04:40.853 real 0m1.779s 00:04:40.853 user 0m1.942s 00:04:40.853 sys 0m0.482s 00:04:40.853 15:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.853 15:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:40.853 ************************************ 00:04:40.853 END TEST dpdk_mem_utility 00:04:40.853 ************************************ 00:04:40.853 15:05:39 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:40.853 15:05:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.853 15:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:40.853 ************************************ 00:04:40.853 START TEST event 00:04:40.853 ************************************ 00:04:40.853 15:05:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:40.853 * Looking for test storage... 00:04:40.853 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:40.853 15:05:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.853 15:05:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.853 15:05:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.853 15:05:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.853 15:05:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.853 15:05:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.853 15:05:39 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.853 15:05:39 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.853 15:05:39 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.853 15:05:39 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.853 15:05:39 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.853 15:05:39 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.853 15:05:39 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.853 15:05:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.853 15:05:39 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.853 15:05:39 -- scripts/common.sh@344 -- # : 1 00:04:40.853 15:05:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.853 15:05:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.853 15:05:39 -- scripts/common.sh@364 -- # decimal 1 00:04:40.853 15:05:39 -- scripts/common.sh@352 -- # local d=1 00:04:40.853 15:05:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.853 15:05:39 -- scripts/common.sh@354 -- # echo 1 00:04:40.853 15:05:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.853 15:05:39 -- scripts/common.sh@365 -- # decimal 2 00:04:40.853 15:05:39 -- scripts/common.sh@352 -- # local d=2 00:04:40.853 15:05:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.853 15:05:39 -- scripts/common.sh@354 -- # echo 2 00:04:40.853 15:05:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.853 15:05:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.853 15:05:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.853 15:05:39 -- scripts/common.sh@367 -- # return 0 00:04:40.853 15:05:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.853 --rc genhtml_branch_coverage=1 00:04:40.853 --rc genhtml_function_coverage=1 00:04:40.853 --rc genhtml_legend=1 00:04:40.853 --rc geninfo_all_blocks=1 00:04:40.853 --rc geninfo_unexecuted_blocks=1 00:04:40.853 00:04:40.853 ' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.853 --rc genhtml_branch_coverage=1 00:04:40.853 --rc genhtml_function_coverage=1 00:04:40.853 --rc genhtml_legend=1 00:04:40.853 --rc geninfo_all_blocks=1 00:04:40.853 --rc geninfo_unexecuted_blocks=1 00:04:40.853 00:04:40.853 ' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.853 --rc genhtml_branch_coverage=1 00:04:40.853 --rc genhtml_function_coverage=1 00:04:40.853 --rc genhtml_legend=1 00:04:40.853 --rc geninfo_all_blocks=1 00:04:40.853 --rc geninfo_unexecuted_blocks=1 00:04:40.853 00:04:40.853 ' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.853 --rc genhtml_branch_coverage=1 00:04:40.853 --rc genhtml_function_coverage=1 00:04:40.853 --rc genhtml_legend=1 00:04:40.853 --rc geninfo_all_blocks=1 00:04:40.853 --rc geninfo_unexecuted_blocks=1 00:04:40.853 00:04:40.853 ' 00:04:40.853 15:05:39 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:40.853 15:05:39 -- bdev/nbd_common.sh@6 -- # set -e 00:04:40.853 15:05:39 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:40.853 15:05:39 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:40.853 15:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.853 15:05:39 -- common/autotest_common.sh@10 -- # set +x 00:04:40.853 ************************************ 00:04:40.853 START TEST event_perf 00:04:40.853 ************************************ 00:04:40.853 15:05:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:40.853 Running I/O for 1 seconds...[2024-11-19 15:05:39.392403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.853 [2024-11-19 15:05:39.392468] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2644145 ] 00:04:41.111 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.111 [2024-11-19 15:05:39.453445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:41.111 [2024-11-19 15:05:39.570857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:41.111 [2024-11-19 15:05:39.570928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:41.111 [2024-11-19 15:05:39.571030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:41.111 [2024-11-19 15:05:39.571034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.485 Running I/O for 1 seconds... 00:04:42.485 lcore 0: 220596 00:04:42.485 lcore 1: 220596 00:04:42.485 lcore 2: 220595 00:04:42.485 lcore 3: 220596 00:04:42.485 done. 00:04:42.485 00:04:42.485 real 0m1.313s 00:04:42.485 user 0m4.222s 00:04:42.485 sys 0m0.085s 00:04:42.485 15:05:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.485 15:05:40 -- common/autotest_common.sh@10 -- # set +x 00:04:42.485 ************************************ 00:04:42.485 END TEST event_perf 00:04:42.485 ************************************ 00:04:42.485 15:05:40 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:42.485 15:05:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:42.485 15:05:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.485 15:05:40 -- common/autotest_common.sh@10 -- # set +x 00:04:42.485 ************************************ 00:04:42.485 START TEST event_reactor 00:04:42.485 ************************************ 00:04:42.485 15:05:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:42.485 [2024-11-19 15:05:40.732569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.485 [2024-11-19 15:05:40.732645] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2644306 ] 00:04:42.485 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.485 [2024-11-19 15:05:40.792669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.485 [2024-11-19 15:05:40.908801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.860 test_start 00:04:43.860 oneshot 00:04:43.860 tick 100 00:04:43.860 tick 100 00:04:43.860 tick 250 00:04:43.860 tick 100 00:04:43.860 tick 100 00:04:43.860 tick 100 00:04:43.860 tick 250 00:04:43.860 tick 500 00:04:43.860 tick 100 00:04:43.860 tick 100 00:04:43.860 tick 250 00:04:43.860 tick 100 00:04:43.860 tick 100 00:04:43.860 test_end 00:04:43.860 00:04:43.860 real 0m1.314s 00:04:43.860 user 0m1.228s 00:04:43.860 sys 0m0.080s 00:04:43.860 15:05:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.860 15:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:43.860 ************************************ 00:04:43.860 END TEST event_reactor 00:04:43.860 ************************************ 00:04:43.860 15:05:42 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:43.860 15:05:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:43.860 15:05:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.860 15:05:42 -- common/autotest_common.sh@10 -- # set +x 00:04:43.860 ************************************ 00:04:43.860 START TEST event_reactor_perf 00:04:43.860 ************************************ 00:04:43.860 15:05:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:43.860 [2024-11-19 15:05:42.077652] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.860 [2024-11-19 15:05:42.077772] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2644480 ] 00:04:43.860 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.860 [2024-11-19 15:05:42.143890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.860 [2024-11-19 15:05:42.263966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.235 test_start 00:04:45.235 test_end 00:04:45.235 Performance: 352333 events per second 00:04:45.235 00:04:45.235 real 0m1.322s 00:04:45.235 user 0m1.239s 00:04:45.235 sys 0m0.078s 00:04:45.235 15:05:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.235 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.235 ************************************ 00:04:45.235 END TEST event_reactor_perf 00:04:45.235 ************************************ 00:04:45.235 15:05:43 -- event/event.sh@49 -- # uname -s 00:04:45.235 15:05:43 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:45.235 15:05:43 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:45.235 15:05:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.235 15:05:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.235 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.235 ************************************ 00:04:45.235 START TEST event_scheduler 00:04:45.235 ************************************ 00:04:45.235 15:05:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:45.235 * Looking for test storage... 00:04:45.235 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:45.235 15:05:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:45.235 15:05:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:45.235 15:05:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:45.235 15:05:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:45.235 15:05:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:45.235 15:05:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:45.235 15:05:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:45.235 15:05:43 -- scripts/common.sh@335 -- # IFS=.-: 00:04:45.235 15:05:43 -- scripts/common.sh@335 -- # read -ra ver1 00:04:45.235 15:05:43 -- scripts/common.sh@336 -- # IFS=.-: 00:04:45.235 15:05:43 -- scripts/common.sh@336 -- # read -ra ver2 00:04:45.235 15:05:43 -- scripts/common.sh@337 -- # local 'op=<' 00:04:45.235 15:05:43 -- scripts/common.sh@339 -- # ver1_l=2 00:04:45.235 15:05:43 -- scripts/common.sh@340 -- # ver2_l=1 00:04:45.235 15:05:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:45.235 15:05:43 -- scripts/common.sh@343 -- # case "$op" in 00:04:45.235 15:05:43 -- scripts/common.sh@344 -- # : 1 00:04:45.235 15:05:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:45.235 15:05:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:45.235 15:05:43 -- scripts/common.sh@364 -- # decimal 1 00:04:45.235 15:05:43 -- scripts/common.sh@352 -- # local d=1 00:04:45.235 15:05:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:45.235 15:05:43 -- scripts/common.sh@354 -- # echo 1 00:04:45.235 15:05:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:45.235 15:05:43 -- scripts/common.sh@365 -- # decimal 2 00:04:45.235 15:05:43 -- scripts/common.sh@352 -- # local d=2 00:04:45.235 15:05:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:45.235 15:05:43 -- scripts/common.sh@354 -- # echo 2 00:04:45.235 15:05:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:45.235 15:05:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:45.235 15:05:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:45.235 15:05:43 -- scripts/common.sh@367 -- # return 0 00:04:45.235 15:05:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:45.235 15:05:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:45.235 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.235 --rc genhtml_branch_coverage=1 00:04:45.235 --rc genhtml_function_coverage=1 00:04:45.235 --rc genhtml_legend=1 00:04:45.235 --rc geninfo_all_blocks=1 00:04:45.235 --rc geninfo_unexecuted_blocks=1 00:04:45.235 00:04:45.235 ' 00:04:45.235 15:05:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:45.235 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.235 --rc genhtml_branch_coverage=1 00:04:45.235 --rc genhtml_function_coverage=1 00:04:45.235 --rc genhtml_legend=1 00:04:45.235 --rc geninfo_all_blocks=1 00:04:45.235 --rc geninfo_unexecuted_blocks=1 00:04:45.235 00:04:45.235 ' 00:04:45.235 15:05:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:45.235 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.235 --rc genhtml_branch_coverage=1 00:04:45.235 --rc genhtml_function_coverage=1 00:04:45.235 --rc genhtml_legend=1 00:04:45.236 --rc geninfo_all_blocks=1 00:04:45.236 --rc geninfo_unexecuted_blocks=1 00:04:45.236 00:04:45.236 ' 00:04:45.236 15:05:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:45.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.236 --rc genhtml_branch_coverage=1 00:04:45.236 --rc genhtml_function_coverage=1 00:04:45.236 --rc genhtml_legend=1 00:04:45.236 --rc geninfo_all_blocks=1 00:04:45.236 --rc geninfo_unexecuted_blocks=1 00:04:45.236 00:04:45.236 ' 00:04:45.236 15:05:43 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:45.236 15:05:43 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2644782 00:04:45.236 15:05:43 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:45.236 15:05:43 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:45.236 15:05:43 -- scheduler/scheduler.sh@37 -- # waitforlisten 2644782 00:04:45.236 15:05:43 -- common/autotest_common.sh@829 -- # '[' -z 2644782 ']' 00:04:45.236 15:05:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:45.236 15:05:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.236 15:05:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:45.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:45.236 15:05:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.236 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.236 [2024-11-19 15:05:43.595193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.236 [2024-11-19 15:05:43.595268] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2644782 ] 00:04:45.236 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.236 [2024-11-19 15:05:43.651924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:45.236 [2024-11-19 15:05:43.761095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.236 [2024-11-19 15:05:43.761153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.236 [2024-11-19 15:05:43.761221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:45.236 [2024-11-19 15:05:43.761224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:45.494 15:05:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.495 15:05:43 -- common/autotest_common.sh@862 -- # return 0 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 POWER: Env isn't set yet! 00:04:45.495 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:45.495 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:45.495 POWER: Cannot get available frequencies of lcore 0 00:04:45.495 POWER: Attempting to initialise PSTAT power management... 00:04:45.495 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:45.495 POWER: Initialized successfully for lcore 0 power management 00:04:45.495 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:45.495 POWER: Initialized successfully for lcore 1 power management 00:04:45.495 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:45.495 POWER: Initialized successfully for lcore 2 power management 00:04:45.495 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:45.495 POWER: Initialized successfully for lcore 3 power management 00:04:45.495 [2024-11-19 15:05:43.846892] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:45.495 [2024-11-19 15:05:43.846910] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:45.495 [2024-11-19 15:05:43.846920] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:45.495 15:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 [2024-11-19 15:05:43.951649] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:45.495 15:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:45.495 15:05:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.495 15:05:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 ************************************ 00:04:45.495 START TEST scheduler_create_thread 00:04:45.495 ************************************ 00:04:45.495 15:05:43 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 2 00:04:45.495 15:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 3 00:04:45.495 15:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 4 00:04:45.495 15:05:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:43 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:45.495 15:05:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:43 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 5 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 6 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 7 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 8 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 9 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.495 10 00:04:45.495 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.495 15:05:44 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:45.495 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.495 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.753 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.753 15:05:44 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:45.753 15:05:44 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:45.753 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.753 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:45.753 15:05:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.753 15:05:44 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:45.753 15:05:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:45.753 15:05:44 -- common/autotest_common.sh@10 -- # set +x 00:04:47.128 15:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.128 15:05:45 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:47.128 15:05:45 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:47.128 15:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.128 15:05:45 -- common/autotest_common.sh@10 -- # set +x 00:04:48.061 15:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.061 00:04:48.061 real 0m2.620s 00:04:48.061 user 0m0.012s 00:04:48.061 sys 0m0.003s 00:04:48.061 15:05:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.061 15:05:46 -- common/autotest_common.sh@10 -- # set +x 00:04:48.061 ************************************ 00:04:48.061 END TEST scheduler_create_thread 00:04:48.061 ************************************ 00:04:48.061 15:05:46 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:48.061 15:05:46 -- scheduler/scheduler.sh@46 -- # killprocess 2644782 00:04:48.061 15:05:46 -- common/autotest_common.sh@936 -- # '[' -z 2644782 ']' 00:04:48.061 15:05:46 -- common/autotest_common.sh@940 -- # kill -0 2644782 00:04:48.061 15:05:46 -- common/autotest_common.sh@941 -- # uname 00:04:48.061 15:05:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:48.061 15:05:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2644782 00:04:48.320 15:05:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:48.320 15:05:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:48.320 15:05:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2644782' 00:04:48.320 killing process with pid 2644782 00:04:48.320 15:05:46 -- common/autotest_common.sh@955 -- # kill 2644782 00:04:48.320 15:05:46 -- common/autotest_common.sh@960 -- # wait 2644782 00:04:48.578 [2024-11-19 15:05:47.058947] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:48.837 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:48.837 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:48.837 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:48.837 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:48.837 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:48.837 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:48.837 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:48.837 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:48.837 00:04:48.837 real 0m3.912s 00:04:48.837 user 0m5.866s 00:04:48.837 sys 0m0.329s 00:04:48.837 15:05:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.837 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:04:48.837 ************************************ 00:04:48.837 END TEST event_scheduler 00:04:48.837 ************************************ 00:04:48.837 15:05:47 -- event/event.sh@51 -- # modprobe -n nbd 00:04:48.837 15:05:47 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:48.837 15:05:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.837 15:05:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.837 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:04:48.837 ************************************ 00:04:48.837 START TEST app_repeat 00:04:48.837 ************************************ 00:04:48.837 15:05:47 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:48.837 15:05:47 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.837 15:05:47 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.837 15:05:47 -- event/event.sh@13 -- # local nbd_list 00:04:48.837 15:05:47 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:48.837 15:05:47 -- event/event.sh@14 -- # local bdev_list 00:04:48.837 15:05:47 -- event/event.sh@15 -- # local repeat_times=4 00:04:48.837 15:05:47 -- event/event.sh@17 -- # modprobe nbd 00:04:48.837 15:05:47 -- event/event.sh@19 -- # repeat_pid=2645244 00:04:48.837 15:05:47 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:48.837 15:05:47 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:48.837 15:05:47 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2645244' 00:04:48.837 Process app_repeat pid: 2645244 00:04:48.837 15:05:47 -- event/event.sh@23 -- # for i in {0..2} 00:04:48.837 15:05:47 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:48.837 spdk_app_start Round 0 00:04:48.837 15:05:47 -- event/event.sh@25 -- # waitforlisten 2645244 /var/tmp/spdk-nbd.sock 00:04:48.837 15:05:47 -- common/autotest_common.sh@829 -- # '[' -z 2645244 ']' 00:04:48.837 15:05:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:48.837 15:05:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.837 15:05:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:48.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:48.837 15:05:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.837 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:04:48.837 [2024-11-19 15:05:47.388793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.837 [2024-11-19 15:05:47.388875] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2645244 ] 00:04:49.101 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.101 [2024-11-19 15:05:47.451768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:49.101 [2024-11-19 15:05:47.565151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:49.101 [2024-11-19 15:05:47.565156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.036 15:05:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.036 15:05:48 -- common/autotest_common.sh@862 -- # return 0 00:04:50.036 15:05:48 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.294 Malloc0 00:04:50.294 15:05:48 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.553 Malloc1 00:04:50.553 15:05:48 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@12 -- # local i 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:50.553 15:05:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:50.810 /dev/nbd0 00:04:50.810 15:05:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:50.810 15:05:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:50.810 15:05:49 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:50.811 15:05:49 -- common/autotest_common.sh@867 -- # local i 00:04:50.811 15:05:49 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:50.811 15:05:49 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:50.811 15:05:49 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:50.811 15:05:49 -- common/autotest_common.sh@871 -- # break 00:04:50.811 15:05:49 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:50.811 15:05:49 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:50.811 15:05:49 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:50.811 1+0 records in 00:04:50.811 1+0 records out 00:04:50.811 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203085 s, 20.2 MB/s 00:04:50.811 15:05:49 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.811 15:05:49 -- common/autotest_common.sh@884 -- # size=4096 00:04:50.811 15:05:49 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.811 15:05:49 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:50.811 15:05:49 -- common/autotest_common.sh@887 -- # return 0 00:04:50.811 15:05:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:50.811 15:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:50.811 15:05:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:51.068 /dev/nbd1 00:04:51.068 15:05:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:51.068 15:05:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:51.068 15:05:49 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:51.068 15:05:49 -- common/autotest_common.sh@867 -- # local i 00:04:51.068 15:05:49 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:51.068 15:05:49 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:51.068 15:05:49 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:51.068 15:05:49 -- common/autotest_common.sh@871 -- # break 00:04:51.068 15:05:49 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:51.068 15:05:49 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:51.068 15:05:49 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:51.068 1+0 records in 00:04:51.068 1+0 records out 00:04:51.068 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000222647 s, 18.4 MB/s 00:04:51.069 15:05:49 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.069 15:05:49 -- common/autotest_common.sh@884 -- # size=4096 00:04:51.069 15:05:49 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:51.069 15:05:49 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:51.069 15:05:49 -- common/autotest_common.sh@887 -- # return 0 00:04:51.069 15:05:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:51.069 15:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.069 15:05:49 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:51.069 15:05:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.069 15:05:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:51.357 { 00:04:51.357 "nbd_device": "/dev/nbd0", 00:04:51.357 "bdev_name": "Malloc0" 00:04:51.357 }, 00:04:51.357 { 00:04:51.357 "nbd_device": "/dev/nbd1", 00:04:51.357 "bdev_name": "Malloc1" 00:04:51.357 } 00:04:51.357 ]' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:51.357 { 00:04:51.357 "nbd_device": "/dev/nbd0", 00:04:51.357 "bdev_name": "Malloc0" 00:04:51.357 }, 00:04:51.357 { 00:04:51.357 "nbd_device": "/dev/nbd1", 00:04:51.357 "bdev_name": "Malloc1" 00:04:51.357 } 00:04:51.357 ]' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:51.357 /dev/nbd1' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:51.357 /dev/nbd1' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@65 -- # count=2 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@95 -- # count=2 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:51.357 256+0 records in 00:04:51.357 256+0 records out 00:04:51.357 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00459471 s, 228 MB/s 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:51.357 256+0 records in 00:04:51.357 256+0 records out 00:04:51.357 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230453 s, 45.5 MB/s 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:51.357 256+0 records in 00:04:51.357 256+0 records out 00:04:51.357 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224213 s, 46.8 MB/s 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@51 -- # local i 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:51.357 15:05:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@41 -- # break 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@45 -- # return 0 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:51.641 15:05:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@41 -- # break 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@45 -- # return 0 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.899 15:05:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@65 -- # true 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@65 -- # count=0 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@104 -- # count=0 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:52.157 15:05:50 -- bdev/nbd_common.sh@109 -- # return 0 00:04:52.157 15:05:50 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:52.723 15:05:50 -- event/event.sh@35 -- # sleep 3 00:04:52.723 [2024-11-19 15:05:51.247647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:52.981 [2024-11-19 15:05:51.362422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.981 [2024-11-19 15:05:51.362423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:52.981 [2024-11-19 15:05:51.423946] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:52.981 [2024-11-19 15:05:51.424059] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:55.510 15:05:53 -- event/event.sh@23 -- # for i in {0..2} 00:04:55.510 15:05:53 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:55.510 spdk_app_start Round 1 00:04:55.510 15:05:53 -- event/event.sh@25 -- # waitforlisten 2645244 /var/tmp/spdk-nbd.sock 00:04:55.510 15:05:53 -- common/autotest_common.sh@829 -- # '[' -z 2645244 ']' 00:04:55.510 15:05:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:55.510 15:05:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:55.510 15:05:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:55.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:55.510 15:05:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:55.510 15:05:53 -- common/autotest_common.sh@10 -- # set +x 00:04:55.768 15:05:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:55.768 15:05:54 -- common/autotest_common.sh@862 -- # return 0 00:04:55.768 15:05:54 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.027 Malloc0 00:04:56.027 15:05:54 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:56.285 Malloc1 00:04:56.285 15:05:54 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@12 -- # local i 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:56.285 15:05:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.286 15:05:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:56.543 /dev/nbd0 00:04:56.543 15:05:55 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:56.544 15:05:55 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:56.544 15:05:55 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:56.544 15:05:55 -- common/autotest_common.sh@867 -- # local i 00:04:56.544 15:05:55 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:56.544 15:05:55 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:56.544 15:05:55 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:56.544 15:05:55 -- common/autotest_common.sh@871 -- # break 00:04:56.544 15:05:55 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:56.544 15:05:55 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:56.544 15:05:55 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:56.544 1+0 records in 00:04:56.544 1+0 records out 00:04:56.544 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000174161 s, 23.5 MB/s 00:04:56.544 15:05:55 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.544 15:05:55 -- common/autotest_common.sh@884 -- # size=4096 00:04:56.544 15:05:55 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.544 15:05:55 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:56.544 15:05:55 -- common/autotest_common.sh@887 -- # return 0 00:04:56.544 15:05:55 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:56.544 15:05:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.544 15:05:55 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:56.802 /dev/nbd1 00:04:56.802 15:05:55 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:56.802 15:05:55 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:56.802 15:05:55 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:56.802 15:05:55 -- common/autotest_common.sh@867 -- # local i 00:04:56.802 15:05:55 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:56.802 15:05:55 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:56.802 15:05:55 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:56.802 15:05:55 -- common/autotest_common.sh@871 -- # break 00:04:56.802 15:05:55 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:56.802 15:05:55 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:56.802 15:05:55 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.061 1+0 records in 00:04:57.061 1+0 records out 00:04:57.061 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204273 s, 20.1 MB/s 00:04:57.061 15:05:55 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.061 15:05:55 -- common/autotest_common.sh@884 -- # size=4096 00:04:57.061 15:05:55 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.061 15:05:55 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:57.061 15:05:55 -- common/autotest_common.sh@887 -- # return 0 00:04:57.061 15:05:55 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.061 15:05:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.061 15:05:55 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.061 15:05:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.061 15:05:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:57.320 { 00:04:57.320 "nbd_device": "/dev/nbd0", 00:04:57.320 "bdev_name": "Malloc0" 00:04:57.320 }, 00:04:57.320 { 00:04:57.320 "nbd_device": "/dev/nbd1", 00:04:57.320 "bdev_name": "Malloc1" 00:04:57.320 } 00:04:57.320 ]' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:57.320 { 00:04:57.320 "nbd_device": "/dev/nbd0", 00:04:57.320 "bdev_name": "Malloc0" 00:04:57.320 }, 00:04:57.320 { 00:04:57.320 "nbd_device": "/dev/nbd1", 00:04:57.320 "bdev_name": "Malloc1" 00:04:57.320 } 00:04:57.320 ]' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:57.320 /dev/nbd1' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:57.320 /dev/nbd1' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@65 -- # count=2 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@95 -- # count=2 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:57.320 256+0 records in 00:04:57.320 256+0 records out 00:04:57.320 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00535565 s, 196 MB/s 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:57.320 256+0 records in 00:04:57.320 256+0 records out 00:04:57.320 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221172 s, 47.4 MB/s 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:57.320 256+0 records in 00:04:57.320 256+0 records out 00:04:57.320 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246435 s, 42.5 MB/s 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.320 15:05:55 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:57.321 15:05:55 -- bdev/nbd_common.sh@51 -- # local i 00:04:57.321 15:05:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.321 15:05:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@41 -- # break 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.579 15:05:56 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@41 -- # break 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.836 15:05:56 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@65 -- # true 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@65 -- # count=0 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@104 -- # count=0 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:58.094 15:05:56 -- bdev/nbd_common.sh@109 -- # return 0 00:04:58.094 15:05:56 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:58.659 15:05:56 -- event/event.sh@35 -- # sleep 3 00:04:58.659 [2024-11-19 15:05:57.194884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:58.916 [2024-11-19 15:05:57.308957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:58.916 [2024-11-19 15:05:57.308962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.916 [2024-11-19 15:05:57.370343] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:58.916 [2024-11-19 15:05:57.370430] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:01.446 15:05:59 -- event/event.sh@23 -- # for i in {0..2} 00:05:01.446 15:05:59 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:01.446 spdk_app_start Round 2 00:05:01.446 15:05:59 -- event/event.sh@25 -- # waitforlisten 2645244 /var/tmp/spdk-nbd.sock 00:05:01.446 15:05:59 -- common/autotest_common.sh@829 -- # '[' -z 2645244 ']' 00:05:01.446 15:05:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:01.446 15:05:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.446 15:05:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:01.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:01.446 15:05:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.446 15:05:59 -- common/autotest_common.sh@10 -- # set +x 00:05:01.704 15:06:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:01.704 15:06:00 -- common/autotest_common.sh@862 -- # return 0 00:05:01.704 15:06:00 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:01.962 Malloc0 00:05:01.962 15:06:00 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.221 Malloc1 00:05:02.221 15:06:00 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@12 -- # local i 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.221 15:06:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:02.479 /dev/nbd0 00:05:02.479 15:06:01 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:02.479 15:06:01 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:02.479 15:06:01 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:02.479 15:06:01 -- common/autotest_common.sh@867 -- # local i 00:05:02.479 15:06:01 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:02.479 15:06:01 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:02.479 15:06:01 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:02.479 15:06:01 -- common/autotest_common.sh@871 -- # break 00:05:02.479 15:06:01 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:02.479 15:06:01 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:02.479 15:06:01 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.479 1+0 records in 00:05:02.479 1+0 records out 00:05:02.479 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204246 s, 20.1 MB/s 00:05:02.479 15:06:01 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.479 15:06:01 -- common/autotest_common.sh@884 -- # size=4096 00:05:02.479 15:06:01 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.737 15:06:01 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:02.737 15:06:01 -- common/autotest_common.sh@887 -- # return 0 00:05:02.737 15:06:01 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.737 15:06:01 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.737 15:06:01 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:02.994 /dev/nbd1 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:02.994 15:06:01 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:02.994 15:06:01 -- common/autotest_common.sh@867 -- # local i 00:05:02.994 15:06:01 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:02.994 15:06:01 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:02.994 15:06:01 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:02.994 15:06:01 -- common/autotest_common.sh@871 -- # break 00:05:02.994 15:06:01 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:02.994 15:06:01 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:02.994 15:06:01 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.994 1+0 records in 00:05:02.994 1+0 records out 00:05:02.994 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000214634 s, 19.1 MB/s 00:05:02.994 15:06:01 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.994 15:06:01 -- common/autotest_common.sh@884 -- # size=4096 00:05:02.994 15:06:01 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.994 15:06:01 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:02.994 15:06:01 -- common/autotest_common.sh@887 -- # return 0 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.994 15:06:01 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:03.252 { 00:05:03.252 "nbd_device": "/dev/nbd0", 00:05:03.252 "bdev_name": "Malloc0" 00:05:03.252 }, 00:05:03.252 { 00:05:03.252 "nbd_device": "/dev/nbd1", 00:05:03.252 "bdev_name": "Malloc1" 00:05:03.252 } 00:05:03.252 ]' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:03.252 { 00:05:03.252 "nbd_device": "/dev/nbd0", 00:05:03.252 "bdev_name": "Malloc0" 00:05:03.252 }, 00:05:03.252 { 00:05:03.252 "nbd_device": "/dev/nbd1", 00:05:03.252 "bdev_name": "Malloc1" 00:05:03.252 } 00:05:03.252 ]' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:03.252 /dev/nbd1' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:03.252 /dev/nbd1' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@65 -- # count=2 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@95 -- # count=2 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:03.252 256+0 records in 00:05:03.252 256+0 records out 00:05:03.252 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00493878 s, 212 MB/s 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.252 15:06:01 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:03.252 256+0 records in 00:05:03.253 256+0 records out 00:05:03.253 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234159 s, 44.8 MB/s 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:03.253 256+0 records in 00:05:03.253 256+0 records out 00:05:03.253 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243134 s, 43.1 MB/s 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@51 -- # local i 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.253 15:06:01 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@41 -- # break 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.510 15:06:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@41 -- # break 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.768 15:06:02 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:04.026 15:06:02 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:04.027 15:06:02 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:04.027 15:06:02 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@65 -- # true 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@65 -- # count=0 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@104 -- # count=0 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:04.285 15:06:02 -- bdev/nbd_common.sh@109 -- # return 0 00:05:04.285 15:06:02 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:04.543 15:06:02 -- event/event.sh@35 -- # sleep 3 00:05:04.802 [2024-11-19 15:06:03.173227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:04.802 [2024-11-19 15:06:03.286503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.802 [2024-11-19 15:06:03.286506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.802 [2024-11-19 15:06:03.347407] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:04.802 [2024-11-19 15:06:03.347483] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:08.085 15:06:05 -- event/event.sh@38 -- # waitforlisten 2645244 /var/tmp/spdk-nbd.sock 00:05:08.085 15:06:05 -- common/autotest_common.sh@829 -- # '[' -z 2645244 ']' 00:05:08.085 15:06:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:08.085 15:06:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.085 15:06:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:08.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:08.085 15:06:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.085 15:06:05 -- common/autotest_common.sh@10 -- # set +x 00:05:08.085 15:06:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.085 15:06:06 -- common/autotest_common.sh@862 -- # return 0 00:05:08.085 15:06:06 -- event/event.sh@39 -- # killprocess 2645244 00:05:08.085 15:06:06 -- common/autotest_common.sh@936 -- # '[' -z 2645244 ']' 00:05:08.085 15:06:06 -- common/autotest_common.sh@940 -- # kill -0 2645244 00:05:08.085 15:06:06 -- common/autotest_common.sh@941 -- # uname 00:05:08.085 15:06:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:08.085 15:06:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2645244 00:05:08.085 15:06:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:08.085 15:06:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:08.085 15:06:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2645244' 00:05:08.085 killing process with pid 2645244 00:05:08.085 15:06:06 -- common/autotest_common.sh@955 -- # kill 2645244 00:05:08.085 15:06:06 -- common/autotest_common.sh@960 -- # wait 2645244 00:05:08.085 spdk_app_start is called in Round 0. 00:05:08.085 Shutdown signal received, stop current app iteration 00:05:08.085 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:08.085 spdk_app_start is called in Round 1. 00:05:08.085 Shutdown signal received, stop current app iteration 00:05:08.085 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:08.085 spdk_app_start is called in Round 2. 00:05:08.085 Shutdown signal received, stop current app iteration 00:05:08.085 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:08.085 spdk_app_start is called in Round 3. 00:05:08.085 Shutdown signal received, stop current app iteration 00:05:08.085 15:06:06 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:08.085 15:06:06 -- event/event.sh@42 -- # return 0 00:05:08.085 00:05:08.085 real 0m19.084s 00:05:08.085 user 0m41.771s 00:05:08.085 sys 0m3.154s 00:05:08.085 15:06:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.085 15:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:08.085 ************************************ 00:05:08.085 END TEST app_repeat 00:05:08.085 ************************************ 00:05:08.085 15:06:06 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:08.085 15:06:06 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:08.085 15:06:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.085 15:06:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.085 15:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:08.085 ************************************ 00:05:08.085 START TEST cpu_locks 00:05:08.085 ************************************ 00:05:08.085 15:06:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:08.085 * Looking for test storage... 00:05:08.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:08.085 15:06:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:08.085 15:06:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:08.085 15:06:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:08.085 15:06:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:08.085 15:06:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:08.085 15:06:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:08.085 15:06:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:08.085 15:06:06 -- scripts/common.sh@335 -- # IFS=.-: 00:05:08.085 15:06:06 -- scripts/common.sh@335 -- # read -ra ver1 00:05:08.085 15:06:06 -- scripts/common.sh@336 -- # IFS=.-: 00:05:08.085 15:06:06 -- scripts/common.sh@336 -- # read -ra ver2 00:05:08.085 15:06:06 -- scripts/common.sh@337 -- # local 'op=<' 00:05:08.085 15:06:06 -- scripts/common.sh@339 -- # ver1_l=2 00:05:08.085 15:06:06 -- scripts/common.sh@340 -- # ver2_l=1 00:05:08.085 15:06:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:08.085 15:06:06 -- scripts/common.sh@343 -- # case "$op" in 00:05:08.085 15:06:06 -- scripts/common.sh@344 -- # : 1 00:05:08.085 15:06:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:08.085 15:06:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:08.085 15:06:06 -- scripts/common.sh@364 -- # decimal 1 00:05:08.085 15:06:06 -- scripts/common.sh@352 -- # local d=1 00:05:08.085 15:06:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:08.085 15:06:06 -- scripts/common.sh@354 -- # echo 1 00:05:08.085 15:06:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:08.085 15:06:06 -- scripts/common.sh@365 -- # decimal 2 00:05:08.085 15:06:06 -- scripts/common.sh@352 -- # local d=2 00:05:08.085 15:06:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:08.085 15:06:06 -- scripts/common.sh@354 -- # echo 2 00:05:08.085 15:06:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:08.085 15:06:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:08.085 15:06:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:08.085 15:06:06 -- scripts/common.sh@367 -- # return 0 00:05:08.085 15:06:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:08.085 15:06:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:08.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.085 --rc genhtml_branch_coverage=1 00:05:08.085 --rc genhtml_function_coverage=1 00:05:08.085 --rc genhtml_legend=1 00:05:08.085 --rc geninfo_all_blocks=1 00:05:08.085 --rc geninfo_unexecuted_blocks=1 00:05:08.085 00:05:08.085 ' 00:05:08.085 15:06:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:08.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.086 --rc genhtml_branch_coverage=1 00:05:08.086 --rc genhtml_function_coverage=1 00:05:08.086 --rc genhtml_legend=1 00:05:08.086 --rc geninfo_all_blocks=1 00:05:08.086 --rc geninfo_unexecuted_blocks=1 00:05:08.086 00:05:08.086 ' 00:05:08.086 15:06:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:08.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.086 --rc genhtml_branch_coverage=1 00:05:08.086 --rc genhtml_function_coverage=1 00:05:08.086 --rc genhtml_legend=1 00:05:08.086 --rc geninfo_all_blocks=1 00:05:08.086 --rc geninfo_unexecuted_blocks=1 00:05:08.086 00:05:08.086 ' 00:05:08.086 15:06:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:08.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:08.086 --rc genhtml_branch_coverage=1 00:05:08.086 --rc genhtml_function_coverage=1 00:05:08.086 --rc genhtml_legend=1 00:05:08.086 --rc geninfo_all_blocks=1 00:05:08.086 --rc geninfo_unexecuted_blocks=1 00:05:08.086 00:05:08.086 ' 00:05:08.086 15:06:06 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:08.086 15:06:06 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:08.086 15:06:06 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:08.086 15:06:06 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:08.086 15:06:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.086 15:06:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.086 15:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:08.086 ************************************ 00:05:08.086 START TEST default_locks 00:05:08.086 ************************************ 00:05:08.086 15:06:06 -- common/autotest_common.sh@1114 -- # default_locks 00:05:08.086 15:06:06 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2647914 00:05:08.086 15:06:06 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:08.086 15:06:06 -- event/cpu_locks.sh@47 -- # waitforlisten 2647914 00:05:08.086 15:06:06 -- common/autotest_common.sh@829 -- # '[' -z 2647914 ']' 00:05:08.086 15:06:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.086 15:06:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.086 15:06:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.086 15:06:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.086 15:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:08.344 [2024-11-19 15:06:06.672077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.344 [2024-11-19 15:06:06.672156] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2647914 ] 00:05:08.344 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.344 [2024-11-19 15:06:06.730454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.344 [2024-11-19 15:06:06.840783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:08.344 [2024-11-19 15:06:06.840936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.279 15:06:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:09.279 15:06:07 -- common/autotest_common.sh@862 -- # return 0 00:05:09.279 15:06:07 -- event/cpu_locks.sh@49 -- # locks_exist 2647914 00:05:09.279 15:06:07 -- event/cpu_locks.sh@22 -- # lslocks -p 2647914 00:05:09.279 15:06:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:09.537 lslocks: write error 00:05:09.537 15:06:07 -- event/cpu_locks.sh@50 -- # killprocess 2647914 00:05:09.537 15:06:07 -- common/autotest_common.sh@936 -- # '[' -z 2647914 ']' 00:05:09.537 15:06:07 -- common/autotest_common.sh@940 -- # kill -0 2647914 00:05:09.537 15:06:07 -- common/autotest_common.sh@941 -- # uname 00:05:09.537 15:06:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:09.537 15:06:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2647914 00:05:09.537 15:06:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:09.537 15:06:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:09.537 15:06:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2647914' 00:05:09.537 killing process with pid 2647914 00:05:09.537 15:06:07 -- common/autotest_common.sh@955 -- # kill 2647914 00:05:09.537 15:06:07 -- common/autotest_common.sh@960 -- # wait 2647914 00:05:10.105 15:06:08 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2647914 00:05:10.105 15:06:08 -- common/autotest_common.sh@650 -- # local es=0 00:05:10.105 15:06:08 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2647914 00:05:10.105 15:06:08 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:10.105 15:06:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:10.105 15:06:08 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:10.105 15:06:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:10.105 15:06:08 -- common/autotest_common.sh@653 -- # waitforlisten 2647914 00:05:10.105 15:06:08 -- common/autotest_common.sh@829 -- # '[' -z 2647914 ']' 00:05:10.105 15:06:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.105 15:06:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.105 15:06:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.105 15:06:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.105 15:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.105 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2647914) - No such process 00:05:10.105 ERROR: process (pid: 2647914) is no longer running 00:05:10.105 15:06:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.105 15:06:08 -- common/autotest_common.sh@862 -- # return 1 00:05:10.105 15:06:08 -- common/autotest_common.sh@653 -- # es=1 00:05:10.105 15:06:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:10.105 15:06:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:10.105 15:06:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:10.105 15:06:08 -- event/cpu_locks.sh@54 -- # no_locks 00:05:10.105 15:06:08 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:10.105 15:06:08 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:10.105 15:06:08 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:10.105 00:05:10.105 real 0m1.754s 00:05:10.105 user 0m1.935s 00:05:10.105 sys 0m0.559s 00:05:10.105 15:06:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.105 15:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.105 ************************************ 00:05:10.105 END TEST default_locks 00:05:10.105 ************************************ 00:05:10.105 15:06:08 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:10.105 15:06:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.105 15:06:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.105 15:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.105 ************************************ 00:05:10.105 START TEST default_locks_via_rpc 00:05:10.105 ************************************ 00:05:10.105 15:06:08 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:10.106 15:06:08 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2648596 00:05:10.106 15:06:08 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:10.106 15:06:08 -- event/cpu_locks.sh@63 -- # waitforlisten 2648596 00:05:10.106 15:06:08 -- common/autotest_common.sh@829 -- # '[' -z 2648596 ']' 00:05:10.106 15:06:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.106 15:06:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.106 15:06:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.106 15:06:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.106 15:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.106 [2024-11-19 15:06:08.450029] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.106 [2024-11-19 15:06:08.450127] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2648596 ] 00:05:10.106 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.106 [2024-11-19 15:06:08.513009] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.106 [2024-11-19 15:06:08.630517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.106 [2024-11-19 15:06:08.630726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.040 15:06:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.040 15:06:09 -- common/autotest_common.sh@862 -- # return 0 00:05:11.040 15:06:09 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:11.040 15:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.040 15:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:11.040 15:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.040 15:06:09 -- event/cpu_locks.sh@67 -- # no_locks 00:05:11.040 15:06:09 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:11.040 15:06:09 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:11.040 15:06:09 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:11.040 15:06:09 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:11.040 15:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.040 15:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:11.040 15:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.040 15:06:09 -- event/cpu_locks.sh@71 -- # locks_exist 2648596 00:05:11.040 15:06:09 -- event/cpu_locks.sh@22 -- # lslocks -p 2648596 00:05:11.040 15:06:09 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.298 15:06:09 -- event/cpu_locks.sh@73 -- # killprocess 2648596 00:05:11.298 15:06:09 -- common/autotest_common.sh@936 -- # '[' -z 2648596 ']' 00:05:11.298 15:06:09 -- common/autotest_common.sh@940 -- # kill -0 2648596 00:05:11.298 15:06:09 -- common/autotest_common.sh@941 -- # uname 00:05:11.298 15:06:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.298 15:06:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2648596 00:05:11.298 15:06:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.298 15:06:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.298 15:06:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2648596' 00:05:11.298 killing process with pid 2648596 00:05:11.298 15:06:09 -- common/autotest_common.sh@955 -- # kill 2648596 00:05:11.298 15:06:09 -- common/autotest_common.sh@960 -- # wait 2648596 00:05:11.864 00:05:11.864 real 0m1.806s 00:05:11.864 user 0m2.001s 00:05:11.864 sys 0m0.544s 00:05:11.864 15:06:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.864 15:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:11.864 ************************************ 00:05:11.864 END TEST default_locks_via_rpc 00:05:11.864 ************************************ 00:05:11.864 15:06:10 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:11.864 15:06:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.864 15:06:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.864 15:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:11.864 ************************************ 00:05:11.864 START TEST non_locking_app_on_locked_coremask 00:05:11.864 ************************************ 00:05:11.864 15:06:10 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:11.864 15:06:10 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2649004 00:05:11.864 15:06:10 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:11.864 15:06:10 -- event/cpu_locks.sh@81 -- # waitforlisten 2649004 /var/tmp/spdk.sock 00:05:11.864 15:06:10 -- common/autotest_common.sh@829 -- # '[' -z 2649004 ']' 00:05:11.864 15:06:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.864 15:06:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.864 15:06:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.864 15:06:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.864 15:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:11.864 [2024-11-19 15:06:10.283886] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.864 [2024-11-19 15:06:10.283987] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2649004 ] 00:05:11.864 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.864 [2024-11-19 15:06:10.344460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.123 [2024-11-19 15:06:10.459794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.123 [2024-11-19 15:06:10.459972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.057 15:06:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.057 15:06:11 -- common/autotest_common.sh@862 -- # return 0 00:05:13.057 15:06:11 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2649041 00:05:13.057 15:06:11 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:13.057 15:06:11 -- event/cpu_locks.sh@85 -- # waitforlisten 2649041 /var/tmp/spdk2.sock 00:05:13.057 15:06:11 -- common/autotest_common.sh@829 -- # '[' -z 2649041 ']' 00:05:13.057 15:06:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:13.057 15:06:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.057 15:06:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:13.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:13.057 15:06:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.057 15:06:11 -- common/autotest_common.sh@10 -- # set +x 00:05:13.057 [2024-11-19 15:06:11.309878] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.057 [2024-11-19 15:06:11.309956] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2649041 ] 00:05:13.057 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.057 [2024-11-19 15:06:11.403620] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:13.057 [2024-11-19 15:06:11.403655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.316 [2024-11-19 15:06:11.634968] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.316 [2024-11-19 15:06:11.635147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.882 15:06:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.882 15:06:12 -- common/autotest_common.sh@862 -- # return 0 00:05:13.882 15:06:12 -- event/cpu_locks.sh@87 -- # locks_exist 2649004 00:05:13.882 15:06:12 -- event/cpu_locks.sh@22 -- # lslocks -p 2649004 00:05:13.882 15:06:12 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:14.140 lslocks: write error 00:05:14.140 15:06:12 -- event/cpu_locks.sh@89 -- # killprocess 2649004 00:05:14.140 15:06:12 -- common/autotest_common.sh@936 -- # '[' -z 2649004 ']' 00:05:14.140 15:06:12 -- common/autotest_common.sh@940 -- # kill -0 2649004 00:05:14.140 15:06:12 -- common/autotest_common.sh@941 -- # uname 00:05:14.140 15:06:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:14.140 15:06:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2649004 00:05:14.140 15:06:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:14.140 15:06:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:14.140 15:06:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2649004' 00:05:14.140 killing process with pid 2649004 00:05:14.140 15:06:12 -- common/autotest_common.sh@955 -- # kill 2649004 00:05:14.140 15:06:12 -- common/autotest_common.sh@960 -- # wait 2649004 00:05:15.075 15:06:13 -- event/cpu_locks.sh@90 -- # killprocess 2649041 00:05:15.075 15:06:13 -- common/autotest_common.sh@936 -- # '[' -z 2649041 ']' 00:05:15.075 15:06:13 -- common/autotest_common.sh@940 -- # kill -0 2649041 00:05:15.075 15:06:13 -- common/autotest_common.sh@941 -- # uname 00:05:15.075 15:06:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.075 15:06:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2649041 00:05:15.075 15:06:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.075 15:06:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.075 15:06:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2649041' 00:05:15.075 killing process with pid 2649041 00:05:15.075 15:06:13 -- common/autotest_common.sh@955 -- # kill 2649041 00:05:15.075 15:06:13 -- common/autotest_common.sh@960 -- # wait 2649041 00:05:15.642 00:05:15.642 real 0m3.858s 00:05:15.642 user 0m4.235s 00:05:15.642 sys 0m1.071s 00:05:15.642 15:06:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:15.642 15:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:15.642 ************************************ 00:05:15.642 END TEST non_locking_app_on_locked_coremask 00:05:15.642 ************************************ 00:05:15.642 15:06:14 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:15.642 15:06:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.642 15:06:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.642 15:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:15.642 ************************************ 00:05:15.642 START TEST locking_app_on_unlocked_coremask 00:05:15.642 ************************************ 00:05:15.642 15:06:14 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:15.642 15:06:14 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2649468 00:05:15.642 15:06:14 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:15.642 15:06:14 -- event/cpu_locks.sh@99 -- # waitforlisten 2649468 /var/tmp/spdk.sock 00:05:15.642 15:06:14 -- common/autotest_common.sh@829 -- # '[' -z 2649468 ']' 00:05:15.642 15:06:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.642 15:06:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.642 15:06:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.642 15:06:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.642 15:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:15.642 [2024-11-19 15:06:14.168895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.642 [2024-11-19 15:06:14.168987] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2649468 ] 00:05:15.642 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.902 [2024-11-19 15:06:14.227070] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.902 [2024-11-19 15:06:14.227113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.902 [2024-11-19 15:06:14.334483] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.902 [2024-11-19 15:06:14.334654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.837 15:06:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.837 15:06:15 -- common/autotest_common.sh@862 -- # return 0 00:05:16.837 15:06:15 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2649608 00:05:16.837 15:06:15 -- event/cpu_locks.sh@103 -- # waitforlisten 2649608 /var/tmp/spdk2.sock 00:05:16.837 15:06:15 -- common/autotest_common.sh@829 -- # '[' -z 2649608 ']' 00:05:16.837 15:06:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:16.837 15:06:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.837 15:06:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:16.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:16.837 15:06:15 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:16.837 15:06:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.837 15:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:16.837 [2024-11-19 15:06:15.175749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.837 [2024-11-19 15:06:15.175838] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2649608 ] 00:05:16.837 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.837 [2024-11-19 15:06:15.272961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.096 [2024-11-19 15:06:15.504863] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.096 [2024-11-19 15:06:15.505067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.663 15:06:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:17.663 15:06:16 -- common/autotest_common.sh@862 -- # return 0 00:05:17.663 15:06:16 -- event/cpu_locks.sh@105 -- # locks_exist 2649608 00:05:17.663 15:06:16 -- event/cpu_locks.sh@22 -- # lslocks -p 2649608 00:05:17.663 15:06:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:18.229 lslocks: write error 00:05:18.229 15:06:16 -- event/cpu_locks.sh@107 -- # killprocess 2649468 00:05:18.229 15:06:16 -- common/autotest_common.sh@936 -- # '[' -z 2649468 ']' 00:05:18.229 15:06:16 -- common/autotest_common.sh@940 -- # kill -0 2649468 00:05:18.229 15:06:16 -- common/autotest_common.sh@941 -- # uname 00:05:18.229 15:06:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.229 15:06:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2649468 00:05:18.229 15:06:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.229 15:06:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.229 15:06:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2649468' 00:05:18.229 killing process with pid 2649468 00:05:18.229 15:06:16 -- common/autotest_common.sh@955 -- # kill 2649468 00:05:18.229 15:06:16 -- common/autotest_common.sh@960 -- # wait 2649468 00:05:19.183 15:06:17 -- event/cpu_locks.sh@108 -- # killprocess 2649608 00:05:19.183 15:06:17 -- common/autotest_common.sh@936 -- # '[' -z 2649608 ']' 00:05:19.183 15:06:17 -- common/autotest_common.sh@940 -- # kill -0 2649608 00:05:19.183 15:06:17 -- common/autotest_common.sh@941 -- # uname 00:05:19.183 15:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.183 15:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2649608 00:05:19.183 15:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:19.183 15:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:19.183 15:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2649608' 00:05:19.183 killing process with pid 2649608 00:05:19.183 15:06:17 -- common/autotest_common.sh@955 -- # kill 2649608 00:05:19.183 15:06:17 -- common/autotest_common.sh@960 -- # wait 2649608 00:05:19.755 00:05:19.755 real 0m3.958s 00:05:19.755 user 0m4.308s 00:05:19.755 sys 0m1.092s 00:05:19.755 15:06:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.755 15:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:19.755 ************************************ 00:05:19.755 END TEST locking_app_on_unlocked_coremask 00:05:19.755 ************************************ 00:05:19.755 15:06:18 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:19.755 15:06:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.755 15:06:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.755 15:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:19.755 ************************************ 00:05:19.755 START TEST locking_app_on_locked_coremask 00:05:19.755 ************************************ 00:05:19.755 15:06:18 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:19.755 15:06:18 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2650023 00:05:19.755 15:06:18 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:19.755 15:06:18 -- event/cpu_locks.sh@116 -- # waitforlisten 2650023 /var/tmp/spdk.sock 00:05:19.755 15:06:18 -- common/autotest_common.sh@829 -- # '[' -z 2650023 ']' 00:05:19.755 15:06:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.755 15:06:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.755 15:06:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.755 15:06:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.755 15:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:19.755 [2024-11-19 15:06:18.152442] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.755 [2024-11-19 15:06:18.152520] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650023 ] 00:05:19.755 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.755 [2024-11-19 15:06:18.207687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.755 [2024-11-19 15:06:18.314411] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.755 [2024-11-19 15:06:18.314574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.690 15:06:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.690 15:06:19 -- common/autotest_common.sh@862 -- # return 0 00:05:20.690 15:06:19 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2650068 00:05:20.690 15:06:19 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:20.690 15:06:19 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2650068 /var/tmp/spdk2.sock 00:05:20.690 15:06:19 -- common/autotest_common.sh@650 -- # local es=0 00:05:20.690 15:06:19 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2650068 /var/tmp/spdk2.sock 00:05:20.690 15:06:19 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:20.690 15:06:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.690 15:06:19 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:20.690 15:06:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.690 15:06:19 -- common/autotest_common.sh@653 -- # waitforlisten 2650068 /var/tmp/spdk2.sock 00:05:20.690 15:06:19 -- common/autotest_common.sh@829 -- # '[' -z 2650068 ']' 00:05:20.690 15:06:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:20.690 15:06:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.690 15:06:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:20.690 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:20.690 15:06:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.690 15:06:19 -- common/autotest_common.sh@10 -- # set +x 00:05:20.690 [2024-11-19 15:06:19.155318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.690 [2024-11-19 15:06:19.155385] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650068 ] 00:05:20.690 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.690 [2024-11-19 15:06:19.249077] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2650023 has claimed it. 00:05:20.690 [2024-11-19 15:06:19.249134] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:21.622 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2650068) - No such process 00:05:21.622 ERROR: process (pid: 2650068) is no longer running 00:05:21.622 15:06:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.622 15:06:19 -- common/autotest_common.sh@862 -- # return 1 00:05:21.622 15:06:19 -- common/autotest_common.sh@653 -- # es=1 00:05:21.622 15:06:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:21.622 15:06:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:21.622 15:06:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:21.622 15:06:19 -- event/cpu_locks.sh@122 -- # locks_exist 2650023 00:05:21.622 15:06:19 -- event/cpu_locks.sh@22 -- # lslocks -p 2650023 00:05:21.622 15:06:19 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:21.880 lslocks: write error 00:05:21.880 15:06:20 -- event/cpu_locks.sh@124 -- # killprocess 2650023 00:05:21.880 15:06:20 -- common/autotest_common.sh@936 -- # '[' -z 2650023 ']' 00:05:21.880 15:06:20 -- common/autotest_common.sh@940 -- # kill -0 2650023 00:05:21.880 15:06:20 -- common/autotest_common.sh@941 -- # uname 00:05:21.880 15:06:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.880 15:06:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2650023 00:05:21.880 15:06:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.880 15:06:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.880 15:06:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2650023' 00:05:21.880 killing process with pid 2650023 00:05:21.880 15:06:20 -- common/autotest_common.sh@955 -- # kill 2650023 00:05:21.880 15:06:20 -- common/autotest_common.sh@960 -- # wait 2650023 00:05:22.139 00:05:22.139 real 0m2.578s 00:05:22.139 user 0m2.974s 00:05:22.139 sys 0m0.659s 00:05:22.139 15:06:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.139 15:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:22.139 ************************************ 00:05:22.139 END TEST locking_app_on_locked_coremask 00:05:22.139 ************************************ 00:05:22.398 15:06:20 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:22.399 15:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.399 15:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.399 15:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:22.399 ************************************ 00:05:22.399 START TEST locking_overlapped_coremask 00:05:22.399 ************************************ 00:05:22.399 15:06:20 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:22.399 15:06:20 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2650364 00:05:22.399 15:06:20 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:22.399 15:06:20 -- event/cpu_locks.sh@133 -- # waitforlisten 2650364 /var/tmp/spdk.sock 00:05:22.399 15:06:20 -- common/autotest_common.sh@829 -- # '[' -z 2650364 ']' 00:05:22.399 15:06:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.399 15:06:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.399 15:06:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.399 15:06:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.399 15:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:22.399 [2024-11-19 15:06:20.761936] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.399 [2024-11-19 15:06:20.762052] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650364 ] 00:05:22.399 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.399 [2024-11-19 15:06:20.824336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:22.399 [2024-11-19 15:06:20.937360] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.399 [2024-11-19 15:06:20.937612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:22.399 [2024-11-19 15:06:20.937698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.399 [2024-11-19 15:06:20.937665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:23.332 15:06:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.332 15:06:21 -- common/autotest_common.sh@862 -- # return 0 00:05:23.332 15:06:21 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2650506 00:05:23.332 15:06:21 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:23.332 15:06:21 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2650506 /var/tmp/spdk2.sock 00:05:23.332 15:06:21 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.332 15:06:21 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2650506 /var/tmp/spdk2.sock 00:05:23.332 15:06:21 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:23.332 15:06:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.332 15:06:21 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:23.332 15:06:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.332 15:06:21 -- common/autotest_common.sh@653 -- # waitforlisten 2650506 /var/tmp/spdk2.sock 00:05:23.332 15:06:21 -- common/autotest_common.sh@829 -- # '[' -z 2650506 ']' 00:05:23.332 15:06:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:23.332 15:06:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.332 15:06:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:23.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:23.332 15:06:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.332 15:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:23.332 [2024-11-19 15:06:21.767095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.332 [2024-11-19 15:06:21.767203] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650506 ] 00:05:23.332 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.332 [2024-11-19 15:06:21.854840] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2650364 has claimed it. 00:05:23.332 [2024-11-19 15:06:21.854907] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:24.266 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2650506) - No such process 00:05:24.266 ERROR: process (pid: 2650506) is no longer running 00:05:24.266 15:06:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:24.266 15:06:22 -- common/autotest_common.sh@862 -- # return 1 00:05:24.266 15:06:22 -- common/autotest_common.sh@653 -- # es=1 00:05:24.266 15:06:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:24.266 15:06:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:24.266 15:06:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:24.266 15:06:22 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:24.266 15:06:22 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:24.266 15:06:22 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:24.266 15:06:22 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:24.266 15:06:22 -- event/cpu_locks.sh@141 -- # killprocess 2650364 00:05:24.266 15:06:22 -- common/autotest_common.sh@936 -- # '[' -z 2650364 ']' 00:05:24.266 15:06:22 -- common/autotest_common.sh@940 -- # kill -0 2650364 00:05:24.266 15:06:22 -- common/autotest_common.sh@941 -- # uname 00:05:24.266 15:06:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.266 15:06:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2650364 00:05:24.266 15:06:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.266 15:06:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.266 15:06:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2650364' 00:05:24.266 killing process with pid 2650364 00:05:24.266 15:06:22 -- common/autotest_common.sh@955 -- # kill 2650364 00:05:24.266 15:06:22 -- common/autotest_common.sh@960 -- # wait 2650364 00:05:24.525 00:05:24.525 real 0m2.233s 00:05:24.525 user 0m6.277s 00:05:24.525 sys 0m0.508s 00:05:24.525 15:06:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.525 15:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:24.525 ************************************ 00:05:24.525 END TEST locking_overlapped_coremask 00:05:24.525 ************************************ 00:05:24.525 15:06:22 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:24.525 15:06:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.525 15:06:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.525 15:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:24.525 ************************************ 00:05:24.525 START TEST locking_overlapped_coremask_via_rpc 00:05:24.525 ************************************ 00:05:24.525 15:06:22 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:24.525 15:06:22 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2650672 00:05:24.525 15:06:22 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:24.525 15:06:22 -- event/cpu_locks.sh@149 -- # waitforlisten 2650672 /var/tmp/spdk.sock 00:05:24.525 15:06:22 -- common/autotest_common.sh@829 -- # '[' -z 2650672 ']' 00:05:24.525 15:06:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.525 15:06:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.525 15:06:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.526 15:06:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.526 15:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:24.526 [2024-11-19 15:06:23.021340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.526 [2024-11-19 15:06:23.021426] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650672 ] 00:05:24.526 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.526 [2024-11-19 15:06:23.082396] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:24.526 [2024-11-19 15:06:23.082461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:24.784 [2024-11-19 15:06:23.202340] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.784 [2024-11-19 15:06:23.202579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:24.784 [2024-11-19 15:06:23.202636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:24.784 [2024-11-19 15:06:23.202654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.719 15:06:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.719 15:06:24 -- common/autotest_common.sh@862 -- # return 0 00:05:25.719 15:06:24 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2650814 00:05:25.719 15:06:24 -- event/cpu_locks.sh@153 -- # waitforlisten 2650814 /var/tmp/spdk2.sock 00:05:25.719 15:06:24 -- common/autotest_common.sh@829 -- # '[' -z 2650814 ']' 00:05:25.719 15:06:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:25.719 15:06:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.719 15:06:24 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:25.719 15:06:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:25.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:25.719 15:06:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.719 15:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:25.719 [2024-11-19 15:06:24.053089] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.719 [2024-11-19 15:06:24.053178] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2650814 ] 00:05:25.719 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.719 [2024-11-19 15:06:24.141161] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:25.719 [2024-11-19 15:06:24.141194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:25.978 [2024-11-19 15:06:24.358379] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.978 [2024-11-19 15:06:24.358612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:25.978 [2024-11-19 15:06:24.358717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:25.978 [2024-11-19 15:06:24.358684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:26.544 15:06:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.544 15:06:25 -- common/autotest_common.sh@862 -- # return 0 00:05:26.544 15:06:25 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:26.544 15:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.544 15:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:26.544 15:06:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.544 15:06:25 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:26.544 15:06:25 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.544 15:06:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:26.544 15:06:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:26.544 15:06:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.544 15:06:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:26.544 15:06:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.544 15:06:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:26.544 15:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.544 15:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:26.544 [2024-11-19 15:06:25.035795] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2650672 has claimed it. 00:05:26.544 request: 00:05:26.544 { 00:05:26.544 "method": "framework_enable_cpumask_locks", 00:05:26.544 "req_id": 1 00:05:26.544 } 00:05:26.544 Got JSON-RPC error response 00:05:26.544 response: 00:05:26.544 { 00:05:26.544 "code": -32603, 00:05:26.544 "message": "Failed to claim CPU core: 2" 00:05:26.544 } 00:05:26.544 15:06:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:26.544 15:06:25 -- common/autotest_common.sh@653 -- # es=1 00:05:26.544 15:06:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:26.544 15:06:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:26.544 15:06:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:26.544 15:06:25 -- event/cpu_locks.sh@158 -- # waitforlisten 2650672 /var/tmp/spdk.sock 00:05:26.544 15:06:25 -- common/autotest_common.sh@829 -- # '[' -z 2650672 ']' 00:05:26.544 15:06:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.544 15:06:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.544 15:06:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.544 15:06:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.545 15:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:26.803 15:06:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.803 15:06:25 -- common/autotest_common.sh@862 -- # return 0 00:05:26.803 15:06:25 -- event/cpu_locks.sh@159 -- # waitforlisten 2650814 /var/tmp/spdk2.sock 00:05:26.803 15:06:25 -- common/autotest_common.sh@829 -- # '[' -z 2650814 ']' 00:05:26.803 15:06:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.803 15:06:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.803 15:06:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.803 15:06:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.803 15:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:27.065 15:06:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.065 15:06:25 -- common/autotest_common.sh@862 -- # return 0 00:05:27.065 15:06:25 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:27.065 15:06:25 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:27.065 15:06:25 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:27.065 15:06:25 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:27.065 00:05:27.065 real 0m2.565s 00:05:27.065 user 0m1.276s 00:05:27.065 sys 0m0.216s 00:05:27.065 15:06:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.065 15:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:27.065 ************************************ 00:05:27.065 END TEST locking_overlapped_coremask_via_rpc 00:05:27.065 ************************************ 00:05:27.065 15:06:25 -- event/cpu_locks.sh@174 -- # cleanup 00:05:27.065 15:06:25 -- event/cpu_locks.sh@15 -- # [[ -z 2650672 ]] 00:05:27.065 15:06:25 -- event/cpu_locks.sh@15 -- # killprocess 2650672 00:05:27.065 15:06:25 -- common/autotest_common.sh@936 -- # '[' -z 2650672 ']' 00:05:27.065 15:06:25 -- common/autotest_common.sh@940 -- # kill -0 2650672 00:05:27.065 15:06:25 -- common/autotest_common.sh@941 -- # uname 00:05:27.065 15:06:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.065 15:06:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2650672 00:05:27.065 15:06:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.065 15:06:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.065 15:06:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2650672' 00:05:27.065 killing process with pid 2650672 00:05:27.065 15:06:25 -- common/autotest_common.sh@955 -- # kill 2650672 00:05:27.065 15:06:25 -- common/autotest_common.sh@960 -- # wait 2650672 00:05:27.633 15:06:26 -- event/cpu_locks.sh@16 -- # [[ -z 2650814 ]] 00:05:27.633 15:06:26 -- event/cpu_locks.sh@16 -- # killprocess 2650814 00:05:27.633 15:06:26 -- common/autotest_common.sh@936 -- # '[' -z 2650814 ']' 00:05:27.633 15:06:26 -- common/autotest_common.sh@940 -- # kill -0 2650814 00:05:27.633 15:06:26 -- common/autotest_common.sh@941 -- # uname 00:05:27.633 15:06:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.633 15:06:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2650814 00:05:27.633 15:06:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:27.633 15:06:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:27.633 15:06:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2650814' 00:05:27.633 killing process with pid 2650814 00:05:27.633 15:06:26 -- common/autotest_common.sh@955 -- # kill 2650814 00:05:27.633 15:06:26 -- common/autotest_common.sh@960 -- # wait 2650814 00:05:28.201 15:06:26 -- event/cpu_locks.sh@18 -- # rm -f 00:05:28.201 15:06:26 -- event/cpu_locks.sh@1 -- # cleanup 00:05:28.201 15:06:26 -- event/cpu_locks.sh@15 -- # [[ -z 2650672 ]] 00:05:28.201 15:06:26 -- event/cpu_locks.sh@15 -- # killprocess 2650672 00:05:28.201 15:06:26 -- common/autotest_common.sh@936 -- # '[' -z 2650672 ']' 00:05:28.201 15:06:26 -- common/autotest_common.sh@940 -- # kill -0 2650672 00:05:28.201 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2650672) - No such process 00:05:28.201 15:06:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2650672 is not found' 00:05:28.201 Process with pid 2650672 is not found 00:05:28.201 15:06:26 -- event/cpu_locks.sh@16 -- # [[ -z 2650814 ]] 00:05:28.201 15:06:26 -- event/cpu_locks.sh@16 -- # killprocess 2650814 00:05:28.201 15:06:26 -- common/autotest_common.sh@936 -- # '[' -z 2650814 ']' 00:05:28.201 15:06:26 -- common/autotest_common.sh@940 -- # kill -0 2650814 00:05:28.201 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2650814) - No such process 00:05:28.201 15:06:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2650814 is not found' 00:05:28.201 Process with pid 2650814 is not found 00:05:28.201 15:06:26 -- event/cpu_locks.sh@18 -- # rm -f 00:05:28.201 00:05:28.201 real 0m20.049s 00:05:28.201 user 0m35.764s 00:05:28.201 sys 0m5.498s 00:05:28.201 15:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.201 15:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.201 ************************************ 00:05:28.201 END TEST cpu_locks 00:05:28.201 ************************************ 00:05:28.201 00:05:28.201 real 0m47.324s 00:05:28.201 user 1m30.270s 00:05:28.201 sys 0m9.410s 00:05:28.201 15:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.201 15:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.201 ************************************ 00:05:28.201 END TEST event 00:05:28.201 ************************************ 00:05:28.201 15:06:26 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:28.201 15:06:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.201 15:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.201 15:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.201 ************************************ 00:05:28.201 START TEST thread 00:05:28.201 ************************************ 00:05:28.201 15:06:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:28.201 * Looking for test storage... 00:05:28.201 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:28.201 15:06:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:28.201 15:06:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:28.201 15:06:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:28.201 15:06:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:28.201 15:06:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:28.201 15:06:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:28.201 15:06:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:28.201 15:06:26 -- scripts/common.sh@335 -- # IFS=.-: 00:05:28.201 15:06:26 -- scripts/common.sh@335 -- # read -ra ver1 00:05:28.201 15:06:26 -- scripts/common.sh@336 -- # IFS=.-: 00:05:28.201 15:06:26 -- scripts/common.sh@336 -- # read -ra ver2 00:05:28.201 15:06:26 -- scripts/common.sh@337 -- # local 'op=<' 00:05:28.201 15:06:26 -- scripts/common.sh@339 -- # ver1_l=2 00:05:28.201 15:06:26 -- scripts/common.sh@340 -- # ver2_l=1 00:05:28.201 15:06:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:28.201 15:06:26 -- scripts/common.sh@343 -- # case "$op" in 00:05:28.201 15:06:26 -- scripts/common.sh@344 -- # : 1 00:05:28.201 15:06:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:28.201 15:06:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:28.201 15:06:26 -- scripts/common.sh@364 -- # decimal 1 00:05:28.201 15:06:26 -- scripts/common.sh@352 -- # local d=1 00:05:28.201 15:06:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:28.201 15:06:26 -- scripts/common.sh@354 -- # echo 1 00:05:28.201 15:06:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:28.201 15:06:26 -- scripts/common.sh@365 -- # decimal 2 00:05:28.201 15:06:26 -- scripts/common.sh@352 -- # local d=2 00:05:28.201 15:06:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:28.201 15:06:26 -- scripts/common.sh@354 -- # echo 2 00:05:28.201 15:06:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:28.201 15:06:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:28.201 15:06:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:28.201 15:06:26 -- scripts/common.sh@367 -- # return 0 00:05:28.201 15:06:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:28.201 15:06:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:28.201 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.201 --rc genhtml_branch_coverage=1 00:05:28.201 --rc genhtml_function_coverage=1 00:05:28.201 --rc genhtml_legend=1 00:05:28.201 --rc geninfo_all_blocks=1 00:05:28.202 --rc geninfo_unexecuted_blocks=1 00:05:28.202 00:05:28.202 ' 00:05:28.202 15:06:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:28.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.202 --rc genhtml_branch_coverage=1 00:05:28.202 --rc genhtml_function_coverage=1 00:05:28.202 --rc genhtml_legend=1 00:05:28.202 --rc geninfo_all_blocks=1 00:05:28.202 --rc geninfo_unexecuted_blocks=1 00:05:28.202 00:05:28.202 ' 00:05:28.202 15:06:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:28.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.202 --rc genhtml_branch_coverage=1 00:05:28.202 --rc genhtml_function_coverage=1 00:05:28.202 --rc genhtml_legend=1 00:05:28.202 --rc geninfo_all_blocks=1 00:05:28.202 --rc geninfo_unexecuted_blocks=1 00:05:28.202 00:05:28.202 ' 00:05:28.202 15:06:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:28.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:28.202 --rc genhtml_branch_coverage=1 00:05:28.202 --rc genhtml_function_coverage=1 00:05:28.202 --rc genhtml_legend=1 00:05:28.202 --rc geninfo_all_blocks=1 00:05:28.202 --rc geninfo_unexecuted_blocks=1 00:05:28.202 00:05:28.202 ' 00:05:28.202 15:06:26 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:28.202 15:06:26 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:28.202 15:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.202 15:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.202 ************************************ 00:05:28.202 START TEST thread_poller_perf 00:05:28.202 ************************************ 00:05:28.202 15:06:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:28.202 [2024-11-19 15:06:26.729360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.202 [2024-11-19 15:06:26.729462] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2651196 ] 00:05:28.202 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.460 [2024-11-19 15:06:26.790381] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.460 [2024-11-19 15:06:26.902276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.460 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:29.836 [2024-11-19T14:06:28.399Z] ====================================== 00:05:29.836 [2024-11-19T14:06:28.399Z] busy:2709663452 (cyc) 00:05:29.836 [2024-11-19T14:06:28.399Z] total_run_count: 278000 00:05:29.836 [2024-11-19T14:06:28.400Z] tsc_hz: 2700000000 (cyc) 00:05:29.837 [2024-11-19T14:06:28.400Z] ====================================== 00:05:29.837 [2024-11-19T14:06:28.400Z] poller_cost: 9746 (cyc), 3609 (nsec) 00:05:29.837 00:05:29.837 real 0m1.318s 00:05:29.837 user 0m1.237s 00:05:29.837 sys 0m0.074s 00:05:29.837 15:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.837 15:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:29.837 ************************************ 00:05:29.837 END TEST thread_poller_perf 00:05:29.837 ************************************ 00:05:29.837 15:06:28 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:29.837 15:06:28 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:29.837 15:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.837 15:06:28 -- common/autotest_common.sh@10 -- # set +x 00:05:29.837 ************************************ 00:05:29.837 START TEST thread_poller_perf 00:05:29.837 ************************************ 00:05:29.837 15:06:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:29.837 [2024-11-19 15:06:28.078384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.837 [2024-11-19 15:06:28.078477] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2651353 ] 00:05:29.837 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.837 [2024-11-19 15:06:28.142294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.837 [2024-11-19 15:06:28.260580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.837 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:31.213 [2024-11-19T14:06:29.776Z] ====================================== 00:05:31.213 [2024-11-19T14:06:29.776Z] busy:2703656427 (cyc) 00:05:31.213 [2024-11-19T14:06:29.776Z] total_run_count: 3825000 00:05:31.213 [2024-11-19T14:06:29.776Z] tsc_hz: 2700000000 (cyc) 00:05:31.213 [2024-11-19T14:06:29.776Z] ====================================== 00:05:31.213 [2024-11-19T14:06:29.776Z] poller_cost: 706 (cyc), 261 (nsec) 00:05:31.213 00:05:31.213 real 0m1.320s 00:05:31.213 user 0m1.226s 00:05:31.213 sys 0m0.087s 00:05:31.213 15:06:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.213 15:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:31.213 ************************************ 00:05:31.213 END TEST thread_poller_perf 00:05:31.213 ************************************ 00:05:31.213 15:06:29 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:31.213 00:05:31.213 real 0m2.835s 00:05:31.213 user 0m2.575s 00:05:31.213 sys 0m0.265s 00:05:31.213 15:06:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.213 15:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:31.213 ************************************ 00:05:31.213 END TEST thread 00:05:31.213 ************************************ 00:05:31.213 15:06:29 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:31.213 15:06:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.213 15:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:31.213 ************************************ 00:05:31.213 START TEST accel 00:05:31.213 ************************************ 00:05:31.213 15:06:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:31.213 * Looking for test storage... 00:05:31.213 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:31.213 15:06:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:31.213 15:06:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:31.213 15:06:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:31.213 15:06:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:31.213 15:06:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:31.213 15:06:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:31.213 15:06:29 -- scripts/common.sh@335 -- # IFS=.-: 00:05:31.213 15:06:29 -- scripts/common.sh@335 -- # read -ra ver1 00:05:31.213 15:06:29 -- scripts/common.sh@336 -- # IFS=.-: 00:05:31.213 15:06:29 -- scripts/common.sh@336 -- # read -ra ver2 00:05:31.213 15:06:29 -- scripts/common.sh@337 -- # local 'op=<' 00:05:31.213 15:06:29 -- scripts/common.sh@339 -- # ver1_l=2 00:05:31.213 15:06:29 -- scripts/common.sh@340 -- # ver2_l=1 00:05:31.213 15:06:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:31.213 15:06:29 -- scripts/common.sh@343 -- # case "$op" in 00:05:31.213 15:06:29 -- scripts/common.sh@344 -- # : 1 00:05:31.213 15:06:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:31.213 15:06:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:31.213 15:06:29 -- scripts/common.sh@364 -- # decimal 1 00:05:31.213 15:06:29 -- scripts/common.sh@352 -- # local d=1 00:05:31.213 15:06:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:31.213 15:06:29 -- scripts/common.sh@354 -- # echo 1 00:05:31.213 15:06:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:31.213 15:06:29 -- scripts/common.sh@365 -- # decimal 2 00:05:31.213 15:06:29 -- scripts/common.sh@352 -- # local d=2 00:05:31.213 15:06:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:31.213 15:06:29 -- scripts/common.sh@354 -- # echo 2 00:05:31.213 15:06:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:31.213 15:06:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:31.213 15:06:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:31.213 15:06:29 -- scripts/common.sh@367 -- # return 0 00:05:31.213 15:06:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:31.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.213 --rc genhtml_branch_coverage=1 00:05:31.213 --rc genhtml_function_coverage=1 00:05:31.213 --rc genhtml_legend=1 00:05:31.213 --rc geninfo_all_blocks=1 00:05:31.213 --rc geninfo_unexecuted_blocks=1 00:05:31.213 00:05:31.213 ' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:31.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.213 --rc genhtml_branch_coverage=1 00:05:31.213 --rc genhtml_function_coverage=1 00:05:31.213 --rc genhtml_legend=1 00:05:31.213 --rc geninfo_all_blocks=1 00:05:31.213 --rc geninfo_unexecuted_blocks=1 00:05:31.213 00:05:31.213 ' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:31.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.213 --rc genhtml_branch_coverage=1 00:05:31.213 --rc genhtml_function_coverage=1 00:05:31.213 --rc genhtml_legend=1 00:05:31.213 --rc geninfo_all_blocks=1 00:05:31.213 --rc geninfo_unexecuted_blocks=1 00:05:31.213 00:05:31.213 ' 00:05:31.213 15:06:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:31.214 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.214 --rc genhtml_branch_coverage=1 00:05:31.214 --rc genhtml_function_coverage=1 00:05:31.214 --rc genhtml_legend=1 00:05:31.214 --rc geninfo_all_blocks=1 00:05:31.214 --rc geninfo_unexecuted_blocks=1 00:05:31.214 00:05:31.214 ' 00:05:31.214 15:06:29 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:31.214 15:06:29 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:31.214 15:06:29 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:31.214 15:06:29 -- accel/accel.sh@59 -- # spdk_tgt_pid=2651679 00:05:31.214 15:06:29 -- accel/accel.sh@60 -- # waitforlisten 2651679 00:05:31.214 15:06:29 -- common/autotest_common.sh@829 -- # '[' -z 2651679 ']' 00:05:31.214 15:06:29 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:31.214 15:06:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:31.214 15:06:29 -- accel/accel.sh@58 -- # build_accel_config 00:05:31.214 15:06:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.214 15:06:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.214 15:06:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:31.214 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:31.214 15:06:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.214 15:06:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.214 15:06:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.214 15:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:31.214 15:06:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.214 15:06:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.214 15:06:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.214 15:06:29 -- accel/accel.sh@42 -- # jq -r . 00:05:31.214 [2024-11-19 15:06:29.606834] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.214 [2024-11-19 15:06:29.606918] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2651679 ] 00:05:31.214 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.214 [2024-11-19 15:06:29.667644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.472 [2024-11-19 15:06:29.785645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.472 [2024-11-19 15:06:29.785838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.038 15:06:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.038 15:06:30 -- common/autotest_common.sh@862 -- # return 0 00:05:32.297 15:06:30 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:32.297 15:06:30 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:32.297 15:06:30 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:32.297 15:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.297 15:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:32.297 15:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # IFS== 00:05:32.297 15:06:30 -- accel/accel.sh@64 -- # read -r opc module 00:05:32.297 15:06:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:32.297 15:06:30 -- accel/accel.sh@67 -- # killprocess 2651679 00:05:32.297 15:06:30 -- common/autotest_common.sh@936 -- # '[' -z 2651679 ']' 00:05:32.297 15:06:30 -- common/autotest_common.sh@940 -- # kill -0 2651679 00:05:32.297 15:06:30 -- common/autotest_common.sh@941 -- # uname 00:05:32.297 15:06:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.297 15:06:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2651679 00:05:32.297 15:06:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:32.297 15:06:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:32.297 15:06:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2651679' 00:05:32.297 killing process with pid 2651679 00:05:32.297 15:06:30 -- common/autotest_common.sh@955 -- # kill 2651679 00:05:32.297 15:06:30 -- common/autotest_common.sh@960 -- # wait 2651679 00:05:32.865 15:06:31 -- accel/accel.sh@68 -- # trap - ERR 00:05:32.865 15:06:31 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:32.865 15:06:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:32.865 15:06:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.865 15:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:32.865 15:06:31 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:32.865 15:06:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.865 15:06:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:32.865 15:06:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.865 15:06:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.865 15:06:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.865 15:06:31 -- accel/accel.sh@42 -- # jq -r . 00:05:32.865 15:06:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.865 15:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:32.865 15:06:31 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:32.865 15:06:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:32.865 15:06:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.865 15:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:32.865 ************************************ 00:05:32.865 START TEST accel_missing_filename 00:05:32.865 ************************************ 00:05:32.865 15:06:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:32.865 15:06:31 -- common/autotest_common.sh@650 -- # local es=0 00:05:32.865 15:06:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:32.865 15:06:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:32.865 15:06:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.865 15:06:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:32.865 15:06:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:32.865 15:06:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:32.865 15:06:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:32.865 15:06:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.865 15:06:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.865 15:06:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.865 15:06:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.865 15:06:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.865 15:06:31 -- accel/accel.sh@42 -- # jq -r . 00:05:32.865 [2024-11-19 15:06:31.233778] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.865 [2024-11-19 15:06:31.233852] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2651855 ] 00:05:32.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.865 [2024-11-19 15:06:31.295959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.865 [2024-11-19 15:06:31.410872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.123 [2024-11-19 15:06:31.472989] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:33.123 [2024-11-19 15:06:31.559359] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:33.124 A filename is required. 00:05:33.124 15:06:31 -- common/autotest_common.sh@653 -- # es=234 00:05:33.124 15:06:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:33.124 15:06:31 -- common/autotest_common.sh@662 -- # es=106 00:05:33.124 15:06:31 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:33.124 15:06:31 -- common/autotest_common.sh@670 -- # es=1 00:05:33.124 15:06:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:33.124 00:05:33.124 real 0m0.468s 00:05:33.124 user 0m0.354s 00:05:33.124 sys 0m0.148s 00:05:33.124 15:06:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.124 15:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:33.124 ************************************ 00:05:33.124 END TEST accel_missing_filename 00:05:33.124 ************************************ 00:05:33.382 15:06:31 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.382 15:06:31 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:33.382 15:06:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.382 15:06:31 -- common/autotest_common.sh@10 -- # set +x 00:05:33.382 ************************************ 00:05:33.382 START TEST accel_compress_verify 00:05:33.382 ************************************ 00:05:33.382 15:06:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.382 15:06:31 -- common/autotest_common.sh@650 -- # local es=0 00:05:33.382 15:06:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.382 15:06:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:33.382 15:06:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.382 15:06:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:33.382 15:06:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.382 15:06:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.382 15:06:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.382 15:06:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.382 15:06:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.382 15:06:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.382 15:06:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.382 15:06:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.382 15:06:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.382 15:06:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.382 15:06:31 -- accel/accel.sh@42 -- # jq -r . 00:05:33.382 [2024-11-19 15:06:31.724990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.382 [2024-11-19 15:06:31.725071] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652004 ] 00:05:33.382 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.382 [2024-11-19 15:06:31.785766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.382 [2024-11-19 15:06:31.901078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.641 [2024-11-19 15:06:31.963151] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:33.641 [2024-11-19 15:06:32.047968] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:33.641 00:05:33.641 Compression does not support the verify option, aborting. 00:05:33.641 15:06:32 -- common/autotest_common.sh@653 -- # es=161 00:05:33.641 15:06:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:33.641 15:06:32 -- common/autotest_common.sh@662 -- # es=33 00:05:33.641 15:06:32 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:33.641 15:06:32 -- common/autotest_common.sh@670 -- # es=1 00:05:33.641 15:06:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:33.641 00:05:33.641 real 0m0.464s 00:05:33.641 user 0m0.352s 00:05:33.641 sys 0m0.143s 00:05:33.641 15:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.641 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.641 ************************************ 00:05:33.641 END TEST accel_compress_verify 00:05:33.641 ************************************ 00:05:33.641 15:06:32 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:33.641 15:06:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:33.641 15:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.641 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.641 ************************************ 00:05:33.641 START TEST accel_wrong_workload 00:05:33.641 ************************************ 00:05:33.641 15:06:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:33.641 15:06:32 -- common/autotest_common.sh@650 -- # local es=0 00:05:33.641 15:06:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:33.641 15:06:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:33.641 15:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.641 15:06:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:33.641 15:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.641 15:06:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:33.641 15:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:33.641 15:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.641 15:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.641 15:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.641 15:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.641 15:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.641 15:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.641 15:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.641 15:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:33.900 Unsupported workload type: foobar 00:05:33.900 [2024-11-19 15:06:32.216524] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:33.900 accel_perf options: 00:05:33.900 [-h help message] 00:05:33.900 [-q queue depth per core] 00:05:33.901 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:33.901 [-T number of threads per core 00:05:33.901 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:33.901 [-t time in seconds] 00:05:33.901 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:33.901 [ dif_verify, , dif_generate, dif_generate_copy 00:05:33.901 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:33.901 [-l for compress/decompress workloads, name of uncompressed input file 00:05:33.901 [-S for crc32c workload, use this seed value (default 0) 00:05:33.901 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:33.901 [-f for fill workload, use this BYTE value (default 255) 00:05:33.901 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:33.901 [-y verify result if this switch is on] 00:05:33.901 [-a tasks to allocate per core (default: same value as -q)] 00:05:33.901 Can be used to spread operations across a wider range of memory. 00:05:33.901 15:06:32 -- common/autotest_common.sh@653 -- # es=1 00:05:33.901 15:06:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:33.901 15:06:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:33.901 15:06:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:33.901 00:05:33.901 real 0m0.023s 00:05:33.901 user 0m0.012s 00:05:33.901 sys 0m0.010s 00:05:33.901 15:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.901 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.901 ************************************ 00:05:33.901 END TEST accel_wrong_workload 00:05:33.901 ************************************ 00:05:33.901 Error: writing output failed: Broken pipe 00:05:33.901 15:06:32 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:33.901 15:06:32 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:33.901 15:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.901 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.901 ************************************ 00:05:33.901 START TEST accel_negative_buffers 00:05:33.901 ************************************ 00:05:33.901 15:06:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:33.901 15:06:32 -- common/autotest_common.sh@650 -- # local es=0 00:05:33.901 15:06:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:33.901 15:06:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:33.901 15:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.901 15:06:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:33.901 15:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:33.901 15:06:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:33.901 15:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:33.901 15:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.901 15:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.901 15:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.901 15:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.901 15:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:33.901 -x option must be non-negative. 00:05:33.901 [2024-11-19 15:06:32.261085] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:33.901 accel_perf options: 00:05:33.901 [-h help message] 00:05:33.901 [-q queue depth per core] 00:05:33.901 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:33.901 [-T number of threads per core 00:05:33.901 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:33.901 [-t time in seconds] 00:05:33.901 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:33.901 [ dif_verify, , dif_generate, dif_generate_copy 00:05:33.901 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:33.901 [-l for compress/decompress workloads, name of uncompressed input file 00:05:33.901 [-S for crc32c workload, use this seed value (default 0) 00:05:33.901 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:33.901 [-f for fill workload, use this BYTE value (default 255) 00:05:33.901 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:33.901 [-y verify result if this switch is on] 00:05:33.901 [-a tasks to allocate per core (default: same value as -q)] 00:05:33.901 Can be used to spread operations across a wider range of memory. 00:05:33.901 15:06:32 -- common/autotest_common.sh@653 -- # es=1 00:05:33.901 15:06:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:33.901 15:06:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:33.901 15:06:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:33.901 00:05:33.901 real 0m0.019s 00:05:33.901 user 0m0.011s 00:05:33.901 sys 0m0.008s 00:05:33.901 15:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.901 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.901 ************************************ 00:05:33.901 END TEST accel_negative_buffers 00:05:33.901 ************************************ 00:05:33.901 Error: writing output failed: Broken pipe 00:05:33.901 15:06:32 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:33.901 15:06:32 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:33.901 15:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.901 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:33.901 ************************************ 00:05:33.901 START TEST accel_crc32c 00:05:33.901 ************************************ 00:05:33.901 15:06:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:33.901 15:06:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:33.901 15:06:32 -- accel/accel.sh@17 -- # local accel_module 00:05:33.901 15:06:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:33.901 15:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:33.901 15:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.901 15:06:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.901 15:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.901 15:06:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.901 15:06:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.901 15:06:32 -- accel/accel.sh@42 -- # jq -r . 00:05:33.901 [2024-11-19 15:06:32.310666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.901 [2024-11-19 15:06:32.310760] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652064 ] 00:05:33.901 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.901 [2024-11-19 15:06:32.373910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.160 [2024-11-19 15:06:32.490604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.535 15:06:33 -- accel/accel.sh@18 -- # out=' 00:05:35.535 SPDK Configuration: 00:05:35.535 Core mask: 0x1 00:05:35.535 00:05:35.535 Accel Perf Configuration: 00:05:35.535 Workload Type: crc32c 00:05:35.535 CRC-32C seed: 32 00:05:35.535 Transfer size: 4096 bytes 00:05:35.535 Vector count 1 00:05:35.535 Module: software 00:05:35.535 Queue depth: 32 00:05:35.535 Allocate depth: 32 00:05:35.535 # threads/core: 1 00:05:35.535 Run time: 1 seconds 00:05:35.535 Verify: Yes 00:05:35.535 00:05:35.535 Running for 1 seconds... 00:05:35.535 00:05:35.535 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.535 ------------------------------------------------------------------------------------ 00:05:35.535 0,0 404128/s 1578 MiB/s 0 0 00:05:35.535 ==================================================================================== 00:05:35.535 Total 404128/s 1578 MiB/s 0 0' 00:05:35.535 15:06:33 -- accel/accel.sh@20 -- # IFS=: 00:05:35.535 15:06:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:35.535 15:06:33 -- accel/accel.sh@20 -- # read -r var val 00:05:35.535 15:06:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:35.535 15:06:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.535 15:06:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.535 15:06:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.535 15:06:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.535 15:06:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.535 15:06:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.535 15:06:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.535 15:06:33 -- accel/accel.sh@42 -- # jq -r . 00:05:35.535 [2024-11-19 15:06:33.778899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.535 [2024-11-19 15:06:33.778978] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652207 ] 00:05:35.535 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.535 [2024-11-19 15:06:33.840842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.535 [2024-11-19 15:06:33.955445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.535 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.535 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.535 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.535 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.535 15:06:34 -- accel/accel.sh@21 -- # val=0x1 00:05:35.535 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.535 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.535 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.535 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.535 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.535 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=crc32c 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=32 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=software 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=32 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=32 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=1 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val=Yes 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:35.536 15:06:34 -- accel/accel.sh@21 -- # val= 00:05:35.536 15:06:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # IFS=: 00:05:35.536 15:06:34 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@21 -- # val= 00:05:36.909 15:06:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # IFS=: 00:05:36.909 15:06:35 -- accel/accel.sh@20 -- # read -r var val 00:05:36.909 15:06:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:36.909 15:06:35 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:36.909 15:06:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:36.909 00:05:36.909 real 0m2.926s 00:05:36.909 user 0m2.631s 00:05:36.909 sys 0m0.289s 00:05:36.909 15:06:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.909 15:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:36.909 ************************************ 00:05:36.909 END TEST accel_crc32c 00:05:36.909 ************************************ 00:05:36.909 15:06:35 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:36.909 15:06:35 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:36.909 15:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.909 15:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:36.909 ************************************ 00:05:36.909 START TEST accel_crc32c_C2 00:05:36.909 ************************************ 00:05:36.909 15:06:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:36.909 15:06:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.909 15:06:35 -- accel/accel.sh@17 -- # local accel_module 00:05:36.909 15:06:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:36.909 15:06:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:36.909 15:06:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.909 15:06:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.909 15:06:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.909 15:06:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.909 15:06:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.909 15:06:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.909 15:06:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.909 15:06:35 -- accel/accel.sh@42 -- # jq -r . 00:05:36.909 [2024-11-19 15:06:35.264286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.909 [2024-11-19 15:06:35.264373] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652492 ] 00:05:36.909 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.910 [2024-11-19 15:06:35.327462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.910 [2024-11-19 15:06:35.440831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.280 15:06:36 -- accel/accel.sh@18 -- # out=' 00:05:38.280 SPDK Configuration: 00:05:38.280 Core mask: 0x1 00:05:38.280 00:05:38.280 Accel Perf Configuration: 00:05:38.280 Workload Type: crc32c 00:05:38.280 CRC-32C seed: 0 00:05:38.280 Transfer size: 4096 bytes 00:05:38.280 Vector count 2 00:05:38.280 Module: software 00:05:38.280 Queue depth: 32 00:05:38.280 Allocate depth: 32 00:05:38.280 # threads/core: 1 00:05:38.280 Run time: 1 seconds 00:05:38.280 Verify: Yes 00:05:38.280 00:05:38.280 Running for 1 seconds... 00:05:38.280 00:05:38.280 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.280 ------------------------------------------------------------------------------------ 00:05:38.280 0,0 315232/s 2462 MiB/s 0 0 00:05:38.280 ==================================================================================== 00:05:38.281 Total 315232/s 1231 MiB/s 0 0' 00:05:38.281 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 15:06:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:38.281 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 15:06:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:38.281 15:06:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.281 15:06:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.281 15:06:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.281 15:06:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.281 15:06:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.281 15:06:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.281 15:06:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.281 15:06:36 -- accel/accel.sh@42 -- # jq -r . 00:05:38.281 [2024-11-19 15:06:36.738484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.281 [2024-11-19 15:06:36.738566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652630 ] 00:05:38.281 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.281 [2024-11-19 15:06:36.801941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.539 [2024-11-19 15:06:36.918746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=0x1 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=crc32c 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=0 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=software 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=32 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=32 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=1 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val=Yes 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 15:06:36 -- accel/accel.sh@21 -- # val= 00:05:38.539 15:06:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 15:06:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@21 -- # val= 00:05:39.912 15:06:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # IFS=: 00:05:39.912 15:06:38 -- accel/accel.sh@20 -- # read -r var val 00:05:39.912 15:06:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.912 15:06:38 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:39.912 15:06:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.912 00:05:39.912 real 0m2.955s 00:05:39.912 user 0m2.665s 00:05:39.912 sys 0m0.281s 00:05:39.912 15:06:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.912 15:06:38 -- common/autotest_common.sh@10 -- # set +x 00:05:39.912 ************************************ 00:05:39.912 END TEST accel_crc32c_C2 00:05:39.912 ************************************ 00:05:39.912 15:06:38 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:39.912 15:06:38 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:39.912 15:06:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.912 15:06:38 -- common/autotest_common.sh@10 -- # set +x 00:05:39.912 ************************************ 00:05:39.912 START TEST accel_copy 00:05:39.912 ************************************ 00:05:39.912 15:06:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:39.912 15:06:38 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.912 15:06:38 -- accel/accel.sh@17 -- # local accel_module 00:05:39.912 15:06:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:39.912 15:06:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:39.912 15:06:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.912 15:06:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.913 15:06:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.913 15:06:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.913 15:06:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.913 15:06:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.913 15:06:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.913 15:06:38 -- accel/accel.sh@42 -- # jq -r . 00:05:39.913 [2024-11-19 15:06:38.241809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.913 [2024-11-19 15:06:38.241886] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2652795 ] 00:05:39.913 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.913 [2024-11-19 15:06:38.305772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.913 [2024-11-19 15:06:38.421651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.286 15:06:39 -- accel/accel.sh@18 -- # out=' 00:05:41.286 SPDK Configuration: 00:05:41.286 Core mask: 0x1 00:05:41.286 00:05:41.286 Accel Perf Configuration: 00:05:41.286 Workload Type: copy 00:05:41.286 Transfer size: 4096 bytes 00:05:41.286 Vector count 1 00:05:41.286 Module: software 00:05:41.286 Queue depth: 32 00:05:41.286 Allocate depth: 32 00:05:41.286 # threads/core: 1 00:05:41.286 Run time: 1 seconds 00:05:41.286 Verify: Yes 00:05:41.286 00:05:41.286 Running for 1 seconds... 00:05:41.286 00:05:41.286 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.286 ------------------------------------------------------------------------------------ 00:05:41.286 0,0 278176/s 1086 MiB/s 0 0 00:05:41.286 ==================================================================================== 00:05:41.286 Total 278176/s 1086 MiB/s 0 0' 00:05:41.286 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.286 15:06:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:41.286 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.286 15:06:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:41.286 15:06:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.286 15:06:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.286 15:06:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.286 15:06:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.286 15:06:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.286 15:06:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.286 15:06:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.286 15:06:39 -- accel/accel.sh@42 -- # jq -r . 00:05:41.286 [2024-11-19 15:06:39.712418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.286 [2024-11-19 15:06:39.712497] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653057 ] 00:05:41.286 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.286 [2024-11-19 15:06:39.780020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.544 [2024-11-19 15:06:39.899894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.544 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.544 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.544 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.544 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.544 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.544 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.544 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.544 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.544 15:06:39 -- accel/accel.sh@21 -- # val=0x1 00:05:41.544 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=copy 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=software 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=32 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=32 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=1 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val=Yes 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:41.545 15:06:39 -- accel/accel.sh@21 -- # val= 00:05:41.545 15:06:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # IFS=: 00:05:41.545 15:06:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.918 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@21 -- # val= 00:05:42.919 15:06:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # IFS=: 00:05:42.919 15:06:41 -- accel/accel.sh@20 -- # read -r var val 00:05:42.919 15:06:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.919 15:06:41 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:42.919 15:06:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.919 00:05:42.919 real 0m2.965s 00:05:42.919 user 0m2.666s 00:05:42.919 sys 0m0.289s 00:05:42.919 15:06:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.919 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:42.919 ************************************ 00:05:42.919 END TEST accel_copy 00:05:42.919 ************************************ 00:05:42.919 15:06:41 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.919 15:06:41 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:42.919 15:06:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.919 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:42.919 ************************************ 00:05:42.919 START TEST accel_fill 00:05:42.919 ************************************ 00:05:42.919 15:06:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.919 15:06:41 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.919 15:06:41 -- accel/accel.sh@17 -- # local accel_module 00:05:42.919 15:06:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.919 15:06:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:42.919 15:06:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.919 15:06:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.919 15:06:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.919 15:06:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.919 15:06:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.919 15:06:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.919 15:06:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.919 15:06:41 -- accel/accel.sh@42 -- # jq -r . 00:05:42.919 [2024-11-19 15:06:41.233063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.919 [2024-11-19 15:06:41.233146] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653219 ] 00:05:42.919 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.919 [2024-11-19 15:06:41.295763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.919 [2024-11-19 15:06:41.418494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.294 15:06:42 -- accel/accel.sh@18 -- # out=' 00:05:44.294 SPDK Configuration: 00:05:44.294 Core mask: 0x1 00:05:44.294 00:05:44.294 Accel Perf Configuration: 00:05:44.294 Workload Type: fill 00:05:44.294 Fill pattern: 0x80 00:05:44.294 Transfer size: 4096 bytes 00:05:44.294 Vector count 1 00:05:44.294 Module: software 00:05:44.294 Queue depth: 64 00:05:44.294 Allocate depth: 64 00:05:44.294 # threads/core: 1 00:05:44.294 Run time: 1 seconds 00:05:44.294 Verify: Yes 00:05:44.294 00:05:44.294 Running for 1 seconds... 00:05:44.294 00:05:44.294 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.294 ------------------------------------------------------------------------------------ 00:05:44.294 0,0 414784/s 1620 MiB/s 0 0 00:05:44.294 ==================================================================================== 00:05:44.294 Total 414784/s 1620 MiB/s 0 0' 00:05:44.294 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 15:06:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.294 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 15:06:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.294 15:06:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.294 15:06:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.294 15:06:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.294 15:06:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.294 15:06:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.294 15:06:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.294 15:06:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.294 15:06:42 -- accel/accel.sh@42 -- # jq -r . 00:05:44.294 [2024-11-19 15:06:42.722255] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.294 [2024-11-19 15:06:42.722347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653357 ] 00:05:44.294 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.294 [2024-11-19 15:06:42.784348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.553 [2024-11-19 15:06:42.903657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=0x1 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=fill 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=0x80 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=software 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=64 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=64 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=1 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val=Yes 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:44.553 15:06:42 -- accel/accel.sh@21 -- # val= 00:05:44.553 15:06:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # IFS=: 00:05:44.553 15:06:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@21 -- # val= 00:05:45.927 15:06:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # IFS=: 00:05:45.927 15:06:44 -- accel/accel.sh@20 -- # read -r var val 00:05:45.927 15:06:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.927 15:06:44 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:45.927 15:06:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.927 00:05:45.927 real 0m2.965s 00:05:45.927 user 0m2.663s 00:05:45.927 sys 0m0.293s 00:05:45.927 15:06:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.928 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:45.928 ************************************ 00:05:45.928 END TEST accel_fill 00:05:45.928 ************************************ 00:05:45.928 15:06:44 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:45.928 15:06:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:45.928 15:06:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.928 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:45.928 ************************************ 00:05:45.928 START TEST accel_copy_crc32c 00:05:45.928 ************************************ 00:05:45.928 15:06:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:45.928 15:06:44 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.928 15:06:44 -- accel/accel.sh@17 -- # local accel_module 00:05:45.928 15:06:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:45.928 15:06:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:45.928 15:06:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.928 15:06:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.928 15:06:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.928 15:06:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.928 15:06:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.928 15:06:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.928 15:06:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.928 15:06:44 -- accel/accel.sh@42 -- # jq -r . 00:05:45.928 [2024-11-19 15:06:44.225313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.928 [2024-11-19 15:06:44.225394] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653646 ] 00:05:45.928 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.928 [2024-11-19 15:06:44.286121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.928 [2024-11-19 15:06:44.405538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.362 15:06:45 -- accel/accel.sh@18 -- # out=' 00:05:47.362 SPDK Configuration: 00:05:47.362 Core mask: 0x1 00:05:47.362 00:05:47.362 Accel Perf Configuration: 00:05:47.362 Workload Type: copy_crc32c 00:05:47.362 CRC-32C seed: 0 00:05:47.362 Vector size: 4096 bytes 00:05:47.362 Transfer size: 4096 bytes 00:05:47.362 Vector count 1 00:05:47.362 Module: software 00:05:47.362 Queue depth: 32 00:05:47.362 Allocate depth: 32 00:05:47.362 # threads/core: 1 00:05:47.362 Run time: 1 seconds 00:05:47.362 Verify: Yes 00:05:47.362 00:05:47.362 Running for 1 seconds... 00:05:47.362 00:05:47.362 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.362 ------------------------------------------------------------------------------------ 00:05:47.362 0,0 217696/s 850 MiB/s 0 0 00:05:47.362 ==================================================================================== 00:05:47.362 Total 217696/s 850 MiB/s 0 0' 00:05:47.362 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.362 15:06:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:47.362 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.362 15:06:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:47.362 15:06:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.362 15:06:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.362 15:06:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.362 15:06:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.362 15:06:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.362 15:06:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.362 15:06:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.362 15:06:45 -- accel/accel.sh@42 -- # jq -r . 00:05:47.362 [2024-11-19 15:06:45.708448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.362 [2024-11-19 15:06:45.708532] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653788 ] 00:05:47.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.362 [2024-11-19 15:06:45.770131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.362 [2024-11-19 15:06:45.889976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val=0x1 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.621 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.621 15:06:45 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:47.621 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.621 15:06:45 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=0 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=software 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=32 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=32 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=1 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val=Yes 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:47.622 15:06:45 -- accel/accel.sh@21 -- # val= 00:05:47.622 15:06:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # IFS=: 00:05:47.622 15:06:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.996 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.996 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.996 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.996 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.996 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.996 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.996 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.996 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.997 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.997 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.997 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 15:06:47 -- accel/accel.sh@21 -- # val= 00:05:48.997 15:06:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 15:06:47 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 15:06:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.997 15:06:47 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:48.997 15:06:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.997 00:05:48.997 real 0m2.970s 00:05:48.997 user 0m2.667s 00:05:48.997 sys 0m0.295s 00:05:48.997 15:06:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.997 15:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:48.997 ************************************ 00:05:48.997 END TEST accel_copy_crc32c 00:05:48.997 ************************************ 00:05:48.997 15:06:47 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:48.997 15:06:47 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:48.997 15:06:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.997 15:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:48.997 ************************************ 00:05:48.997 START TEST accel_copy_crc32c_C2 00:05:48.997 ************************************ 00:05:48.997 15:06:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:48.997 15:06:47 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.997 15:06:47 -- accel/accel.sh@17 -- # local accel_module 00:05:48.997 15:06:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:48.997 15:06:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:48.997 15:06:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.997 15:06:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.997 15:06:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.997 15:06:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.997 15:06:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.997 15:06:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.997 15:06:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.997 15:06:47 -- accel/accel.sh@42 -- # jq -r . 00:05:48.997 [2024-11-19 15:06:47.219186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.997 [2024-11-19 15:06:47.219269] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653949 ] 00:05:48.997 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.997 [2024-11-19 15:06:47.284611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.997 [2024-11-19 15:06:47.404593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.372 15:06:48 -- accel/accel.sh@18 -- # out=' 00:05:50.372 SPDK Configuration: 00:05:50.372 Core mask: 0x1 00:05:50.372 00:05:50.372 Accel Perf Configuration: 00:05:50.372 Workload Type: copy_crc32c 00:05:50.372 CRC-32C seed: 0 00:05:50.372 Vector size: 4096 bytes 00:05:50.372 Transfer size: 8192 bytes 00:05:50.372 Vector count 2 00:05:50.372 Module: software 00:05:50.372 Queue depth: 32 00:05:50.372 Allocate depth: 32 00:05:50.372 # threads/core: 1 00:05:50.372 Run time: 1 seconds 00:05:50.372 Verify: Yes 00:05:50.372 00:05:50.372 Running for 1 seconds... 00:05:50.372 00:05:50.372 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.372 ------------------------------------------------------------------------------------ 00:05:50.372 0,0 155136/s 1212 MiB/s 0 0 00:05:50.372 ==================================================================================== 00:05:50.372 Total 155136/s 606 MiB/s 0 0' 00:05:50.372 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 15:06:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:50.372 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 15:06:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:50.372 15:06:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.372 15:06:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.372 15:06:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.372 15:06:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.372 15:06:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.372 15:06:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.372 15:06:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.372 15:06:48 -- accel/accel.sh@42 -- # jq -r . 00:05:50.372 [2024-11-19 15:06:48.695145] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.372 [2024-11-19 15:06:48.695241] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2654188 ] 00:05:50.372 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.372 [2024-11-19 15:06:48.760657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.372 [2024-11-19 15:06:48.878431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val=0x1 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val=0 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.630 15:06:48 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:50.630 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.630 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val=software 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val=32 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val=32 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val=1 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val=Yes 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:50.631 15:06:48 -- accel/accel.sh@21 -- # val= 00:05:50.631 15:06:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # IFS=: 00:05:50.631 15:06:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@21 -- # val= 00:05:52.017 15:06:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # IFS=: 00:05:52.017 15:06:50 -- accel/accel.sh@20 -- # read -r var val 00:05:52.017 15:06:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.017 15:06:50 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:52.017 15:06:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.017 00:05:52.017 real 0m2.958s 00:05:52.017 user 0m2.662s 00:05:52.017 sys 0m0.286s 00:05:52.017 15:06:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.017 15:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:52.017 ************************************ 00:05:52.017 END TEST accel_copy_crc32c_C2 00:05:52.017 ************************************ 00:05:52.017 15:06:50 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:52.017 15:06:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:52.017 15:06:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.017 15:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:52.017 ************************************ 00:05:52.017 START TEST accel_dualcast 00:05:52.017 ************************************ 00:05:52.017 15:06:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:52.017 15:06:50 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.017 15:06:50 -- accel/accel.sh@17 -- # local accel_module 00:05:52.017 15:06:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:52.017 15:06:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:52.017 15:06:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.017 15:06:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.017 15:06:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.017 15:06:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.017 15:06:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.017 15:06:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.017 15:06:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.017 15:06:50 -- accel/accel.sh@42 -- # jq -r . 00:05:52.017 [2024-11-19 15:06:50.202791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.017 [2024-11-19 15:06:50.202873] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2654377 ] 00:05:52.017 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.017 [2024-11-19 15:06:50.264578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.017 [2024-11-19 15:06:50.384926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.392 15:06:51 -- accel/accel.sh@18 -- # out=' 00:05:53.392 SPDK Configuration: 00:05:53.392 Core mask: 0x1 00:05:53.392 00:05:53.392 Accel Perf Configuration: 00:05:53.392 Workload Type: dualcast 00:05:53.392 Transfer size: 4096 bytes 00:05:53.392 Vector count 1 00:05:53.392 Module: software 00:05:53.392 Queue depth: 32 00:05:53.392 Allocate depth: 32 00:05:53.392 # threads/core: 1 00:05:53.392 Run time: 1 seconds 00:05:53.392 Verify: Yes 00:05:53.392 00:05:53.392 Running for 1 seconds... 00:05:53.392 00:05:53.392 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.392 ------------------------------------------------------------------------------------ 00:05:53.392 0,0 299072/s 1168 MiB/s 0 0 00:05:53.392 ==================================================================================== 00:05:53.392 Total 299072/s 1168 MiB/s 0 0' 00:05:53.392 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.392 15:06:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:53.392 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.392 15:06:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:53.392 15:06:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.392 15:06:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.392 15:06:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.393 15:06:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.393 15:06:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.393 15:06:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.393 15:06:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.393 15:06:51 -- accel/accel.sh@42 -- # jq -r . 00:05:53.393 [2024-11-19 15:06:51.688212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.393 [2024-11-19 15:06:51.688298] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2654515 ] 00:05:53.393 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.393 [2024-11-19 15:06:51.748964] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.393 [2024-11-19 15:06:51.869115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=0x1 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=dualcast 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=software 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=32 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=32 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=1 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val=Yes 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:53.393 15:06:51 -- accel/accel.sh@21 -- # val= 00:05:53.393 15:06:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # IFS=: 00:05:53.393 15:06:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@21 -- # val= 00:05:54.767 15:06:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # IFS=: 00:05:54.767 15:06:53 -- accel/accel.sh@20 -- # read -r var val 00:05:54.767 15:06:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.767 15:06:53 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:54.767 15:06:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.767 00:05:54.767 real 0m2.963s 00:05:54.767 user 0m2.669s 00:05:54.767 sys 0m0.285s 00:05:54.767 15:06:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.767 15:06:53 -- common/autotest_common.sh@10 -- # set +x 00:05:54.767 ************************************ 00:05:54.767 END TEST accel_dualcast 00:05:54.767 ************************************ 00:05:54.767 15:06:53 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:54.767 15:06:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:54.767 15:06:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.767 15:06:53 -- common/autotest_common.sh@10 -- # set +x 00:05:54.767 ************************************ 00:05:54.767 START TEST accel_compare 00:05:54.767 ************************************ 00:05:54.767 15:06:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:54.767 15:06:53 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.767 15:06:53 -- accel/accel.sh@17 -- # local accel_module 00:05:54.767 15:06:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:54.767 15:06:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:54.767 15:06:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.767 15:06:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.767 15:06:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.767 15:06:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.767 15:06:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.767 15:06:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.767 15:06:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.767 15:06:53 -- accel/accel.sh@42 -- # jq -r . 00:05:54.767 [2024-11-19 15:06:53.191254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.767 [2024-11-19 15:06:53.191333] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2654752 ] 00:05:54.767 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.767 [2024-11-19 15:06:53.257020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.025 [2024-11-19 15:06:53.375585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.490 15:06:54 -- accel/accel.sh@18 -- # out=' 00:05:56.490 SPDK Configuration: 00:05:56.490 Core mask: 0x1 00:05:56.490 00:05:56.490 Accel Perf Configuration: 00:05:56.490 Workload Type: compare 00:05:56.490 Transfer size: 4096 bytes 00:05:56.490 Vector count 1 00:05:56.490 Module: software 00:05:56.490 Queue depth: 32 00:05:56.490 Allocate depth: 32 00:05:56.490 # threads/core: 1 00:05:56.490 Run time: 1 seconds 00:05:56.490 Verify: Yes 00:05:56.490 00:05:56.490 Running for 1 seconds... 00:05:56.490 00:05:56.490 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.490 ------------------------------------------------------------------------------------ 00:05:56.490 0,0 398560/s 1556 MiB/s 0 0 00:05:56.490 ==================================================================================== 00:05:56.490 Total 398560/s 1556 MiB/s 0 0' 00:05:56.490 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.490 15:06:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:56.490 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.490 15:06:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:56.490 15:06:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.490 15:06:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.490 15:06:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.490 15:06:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.490 15:06:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.490 15:06:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.490 15:06:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.490 15:06:54 -- accel/accel.sh@42 -- # jq -r . 00:05:56.490 [2024-11-19 15:06:54.665159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.490 [2024-11-19 15:06:54.665244] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2654944 ] 00:05:56.490 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.490 [2024-11-19 15:06:54.728805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.490 [2024-11-19 15:06:54.848996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.490 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.490 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.490 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.490 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.490 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.490 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.490 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=0x1 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=compare 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=software 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=32 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=32 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=1 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val=Yes 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:56.491 15:06:54 -- accel/accel.sh@21 -- # val= 00:05:56.491 15:06:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # IFS=: 00:05:56.491 15:06:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@21 -- # val= 00:05:57.866 15:06:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # IFS=: 00:05:57.866 15:06:56 -- accel/accel.sh@20 -- # read -r var val 00:05:57.866 15:06:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.866 15:06:56 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:57.866 15:06:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.866 00:05:57.866 real 0m2.962s 00:05:57.866 user 0m2.660s 00:05:57.866 sys 0m0.293s 00:05:57.866 15:06:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.866 15:06:56 -- common/autotest_common.sh@10 -- # set +x 00:05:57.866 ************************************ 00:05:57.866 END TEST accel_compare 00:05:57.866 ************************************ 00:05:57.866 15:06:56 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:57.866 15:06:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:57.866 15:06:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.866 15:06:56 -- common/autotest_common.sh@10 -- # set +x 00:05:57.866 ************************************ 00:05:57.866 START TEST accel_xor 00:05:57.866 ************************************ 00:05:57.866 15:06:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:57.866 15:06:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.866 15:06:56 -- accel/accel.sh@17 -- # local accel_module 00:05:57.866 15:06:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:57.866 15:06:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:57.866 15:06:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.866 15:06:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.866 15:06:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.866 15:06:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.866 15:06:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.866 15:06:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.866 15:06:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.866 15:06:56 -- accel/accel.sh@42 -- # jq -r . 00:05:57.866 [2024-11-19 15:06:56.180549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.866 [2024-11-19 15:06:56.180632] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2655105 ] 00:05:57.866 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.866 [2024-11-19 15:06:56.246014] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.866 [2024-11-19 15:06:56.367345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.241 15:06:57 -- accel/accel.sh@18 -- # out=' 00:05:59.241 SPDK Configuration: 00:05:59.241 Core mask: 0x1 00:05:59.241 00:05:59.241 Accel Perf Configuration: 00:05:59.241 Workload Type: xor 00:05:59.241 Source buffers: 2 00:05:59.241 Transfer size: 4096 bytes 00:05:59.241 Vector count 1 00:05:59.241 Module: software 00:05:59.241 Queue depth: 32 00:05:59.241 Allocate depth: 32 00:05:59.241 # threads/core: 1 00:05:59.241 Run time: 1 seconds 00:05:59.241 Verify: Yes 00:05:59.241 00:05:59.241 Running for 1 seconds... 00:05:59.241 00:05:59.241 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.241 ------------------------------------------------------------------------------------ 00:05:59.241 0,0 191648/s 748 MiB/s 0 0 00:05:59.241 ==================================================================================== 00:05:59.241 Total 191648/s 748 MiB/s 0 0' 00:05:59.241 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.241 15:06:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:59.241 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.241 15:06:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:59.241 15:06:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.241 15:06:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.241 15:06:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.241 15:06:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.241 15:06:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.241 15:06:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.241 15:06:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.241 15:06:57 -- accel/accel.sh@42 -- # jq -r . 00:05:59.241 [2024-11-19 15:06:57.668558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.241 [2024-11-19 15:06:57.668633] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2655250 ] 00:05:59.241 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.241 [2024-11-19 15:06:57.731981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.500 [2024-11-19 15:06:57.849861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=0x1 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=xor 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=2 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=software 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=32 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=32 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=1 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val=Yes 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:05:59.500 15:06:57 -- accel/accel.sh@21 -- # val= 00:05:59.500 15:06:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # IFS=: 00:05:59.500 15:06:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@21 -- # val= 00:06:00.874 15:06:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # IFS=: 00:06:00.874 15:06:59 -- accel/accel.sh@20 -- # read -r var val 00:06:00.874 15:06:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.874 15:06:59 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:00.874 15:06:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.874 00:06:00.874 real 0m2.958s 00:06:00.874 user 0m2.652s 00:06:00.874 sys 0m0.298s 00:06:00.874 15:06:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.874 15:06:59 -- common/autotest_common.sh@10 -- # set +x 00:06:00.874 ************************************ 00:06:00.874 END TEST accel_xor 00:06:00.874 ************************************ 00:06:00.874 15:06:59 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:00.874 15:06:59 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:00.874 15:06:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.874 15:06:59 -- common/autotest_common.sh@10 -- # set +x 00:06:00.874 ************************************ 00:06:00.874 START TEST accel_xor 00:06:00.874 ************************************ 00:06:00.874 15:06:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:00.874 15:06:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.874 15:06:59 -- accel/accel.sh@17 -- # local accel_module 00:06:00.874 15:06:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:00.874 15:06:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:00.874 15:06:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.874 15:06:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.874 15:06:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.874 15:06:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.874 15:06:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.874 15:06:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.874 15:06:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.874 15:06:59 -- accel/accel.sh@42 -- # jq -r . 00:06:00.874 [2024-11-19 15:06:59.167413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.874 [2024-11-19 15:06:59.167505] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2655533 ] 00:06:00.874 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.874 [2024-11-19 15:06:59.231256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.874 [2024-11-19 15:06:59.349875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.248 15:07:00 -- accel/accel.sh@18 -- # out=' 00:06:02.248 SPDK Configuration: 00:06:02.248 Core mask: 0x1 00:06:02.248 00:06:02.248 Accel Perf Configuration: 00:06:02.248 Workload Type: xor 00:06:02.248 Source buffers: 3 00:06:02.248 Transfer size: 4096 bytes 00:06:02.248 Vector count 1 00:06:02.248 Module: software 00:06:02.248 Queue depth: 32 00:06:02.248 Allocate depth: 32 00:06:02.248 # threads/core: 1 00:06:02.248 Run time: 1 seconds 00:06:02.248 Verify: Yes 00:06:02.248 00:06:02.248 Running for 1 seconds... 00:06:02.248 00:06:02.248 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.248 ------------------------------------------------------------------------------------ 00:06:02.248 0,0 181664/s 709 MiB/s 0 0 00:06:02.248 ==================================================================================== 00:06:02.248 Total 181664/s 709 MiB/s 0 0' 00:06:02.248 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.248 15:07:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:02.248 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.248 15:07:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:02.248 15:07:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.248 15:07:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.248 15:07:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.248 15:07:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.248 15:07:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.248 15:07:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.248 15:07:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.248 15:07:00 -- accel/accel.sh@42 -- # jq -r . 00:06:02.248 [2024-11-19 15:07:00.653250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.248 [2024-11-19 15:07:00.653333] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2655671 ] 00:06:02.248 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.248 [2024-11-19 15:07:00.718977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.507 [2024-11-19 15:07:00.839484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=0x1 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=xor 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=3 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=software 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=32 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=32 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=1 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val=Yes 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:02.507 15:07:00 -- accel/accel.sh@21 -- # val= 00:06:02.507 15:07:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # IFS=: 00:06:02.507 15:07:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@21 -- # val= 00:06:03.883 15:07:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # IFS=: 00:06:03.883 15:07:02 -- accel/accel.sh@20 -- # read -r var val 00:06:03.883 15:07:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.883 15:07:02 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:03.883 15:07:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.883 00:06:03.883 real 0m2.978s 00:06:03.883 user 0m2.668s 00:06:03.883 sys 0m0.302s 00:06:03.883 15:07:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.883 15:07:02 -- common/autotest_common.sh@10 -- # set +x 00:06:03.883 ************************************ 00:06:03.883 END TEST accel_xor 00:06:03.883 ************************************ 00:06:03.883 15:07:02 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:03.883 15:07:02 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:03.883 15:07:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.883 15:07:02 -- common/autotest_common.sh@10 -- # set +x 00:06:03.883 ************************************ 00:06:03.883 START TEST accel_dif_verify 00:06:03.883 ************************************ 00:06:03.883 15:07:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:03.883 15:07:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.883 15:07:02 -- accel/accel.sh@17 -- # local accel_module 00:06:03.883 15:07:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:03.883 15:07:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:03.883 15:07:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.883 15:07:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.883 15:07:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.883 15:07:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.883 15:07:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.883 15:07:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.883 15:07:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.883 15:07:02 -- accel/accel.sh@42 -- # jq -r . 00:06:03.883 [2024-11-19 15:07:02.172710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.883 [2024-11-19 15:07:02.172801] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2655834 ] 00:06:03.883 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.883 [2024-11-19 15:07:02.238908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.883 [2024-11-19 15:07:02.358622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.256 15:07:03 -- accel/accel.sh@18 -- # out=' 00:06:05.256 SPDK Configuration: 00:06:05.256 Core mask: 0x1 00:06:05.256 00:06:05.256 Accel Perf Configuration: 00:06:05.256 Workload Type: dif_verify 00:06:05.256 Vector size: 4096 bytes 00:06:05.256 Transfer size: 4096 bytes 00:06:05.256 Block size: 512 bytes 00:06:05.256 Metadata size: 8 bytes 00:06:05.256 Vector count 1 00:06:05.256 Module: software 00:06:05.256 Queue depth: 32 00:06:05.256 Allocate depth: 32 00:06:05.256 # threads/core: 1 00:06:05.256 Run time: 1 seconds 00:06:05.256 Verify: No 00:06:05.256 00:06:05.256 Running for 1 seconds... 00:06:05.256 00:06:05.256 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.256 ------------------------------------------------------------------------------------ 00:06:05.256 0,0 82016/s 325 MiB/s 0 0 00:06:05.256 ==================================================================================== 00:06:05.256 Total 82016/s 320 MiB/s 0 0' 00:06:05.256 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.256 15:07:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:05.256 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.256 15:07:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:05.256 15:07:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.256 15:07:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.256 15:07:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.256 15:07:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.256 15:07:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.256 15:07:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.256 15:07:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.256 15:07:03 -- accel/accel.sh@42 -- # jq -r . 00:06:05.256 [2024-11-19 15:07:03.645424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.256 [2024-11-19 15:07:03.645508] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656098 ] 00:06:05.256 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.256 [2024-11-19 15:07:03.707143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.514 [2024-11-19 15:07:03.827936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=0x1 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=dif_verify 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=software 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=32 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=32 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=1 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val=No 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:05.514 15:07:03 -- accel/accel.sh@21 -- # val= 00:06:05.514 15:07:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # IFS=: 00:06:05.514 15:07:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@21 -- # val= 00:06:06.884 15:07:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # IFS=: 00:06:06.884 15:07:05 -- accel/accel.sh@20 -- # read -r var val 00:06:06.884 15:07:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.884 15:07:05 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:06.884 15:07:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.884 00:06:06.884 real 0m2.959s 00:06:06.884 user 0m2.656s 00:06:06.884 sys 0m0.297s 00:06:06.884 15:07:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.884 15:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:06.884 ************************************ 00:06:06.884 END TEST accel_dif_verify 00:06:06.884 ************************************ 00:06:06.884 15:07:05 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:06.884 15:07:05 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:06.884 15:07:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.884 15:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:06.884 ************************************ 00:06:06.884 START TEST accel_dif_generate 00:06:06.884 ************************************ 00:06:06.884 15:07:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:06.884 15:07:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.884 15:07:05 -- accel/accel.sh@17 -- # local accel_module 00:06:06.884 15:07:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:06.884 15:07:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:06.884 15:07:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.884 15:07:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.884 15:07:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.884 15:07:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.884 15:07:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.884 15:07:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.884 15:07:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.884 15:07:05 -- accel/accel.sh@42 -- # jq -r . 00:06:06.884 [2024-11-19 15:07:05.161478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.884 [2024-11-19 15:07:05.161570] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656254 ] 00:06:06.884 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.884 [2024-11-19 15:07:05.226868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.884 [2024-11-19 15:07:05.345858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.259 15:07:06 -- accel/accel.sh@18 -- # out=' 00:06:08.259 SPDK Configuration: 00:06:08.259 Core mask: 0x1 00:06:08.259 00:06:08.259 Accel Perf Configuration: 00:06:08.259 Workload Type: dif_generate 00:06:08.259 Vector size: 4096 bytes 00:06:08.259 Transfer size: 4096 bytes 00:06:08.259 Block size: 512 bytes 00:06:08.259 Metadata size: 8 bytes 00:06:08.259 Vector count 1 00:06:08.259 Module: software 00:06:08.259 Queue depth: 32 00:06:08.259 Allocate depth: 32 00:06:08.259 # threads/core: 1 00:06:08.259 Run time: 1 seconds 00:06:08.259 Verify: No 00:06:08.259 00:06:08.259 Running for 1 seconds... 00:06:08.259 00:06:08.259 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.259 ------------------------------------------------------------------------------------ 00:06:08.259 0,0 96320/s 382 MiB/s 0 0 00:06:08.259 ==================================================================================== 00:06:08.259 Total 96320/s 376 MiB/s 0 0' 00:06:08.259 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.259 15:07:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:08.259 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.260 15:07:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:08.260 15:07:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.260 15:07:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.260 15:07:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.260 15:07:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.260 15:07:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.260 15:07:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.260 15:07:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.260 15:07:06 -- accel/accel.sh@42 -- # jq -r . 00:06:08.260 [2024-11-19 15:07:06.649890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.260 [2024-11-19 15:07:06.649972] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656398 ] 00:06:08.260 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.260 [2024-11-19 15:07:06.712564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.518 [2024-11-19 15:07:06.831700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val=0x1 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val=dif_generate 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.518 15:07:06 -- accel/accel.sh@21 -- # val=software 00:06:08.518 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.518 15:07:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.518 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val=32 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val=32 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val=1 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val=No 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:08.519 15:07:06 -- accel/accel.sh@21 -- # val= 00:06:08.519 15:07:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # IFS=: 00:06:08.519 15:07:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@21 -- # val= 00:06:09.894 15:07:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # IFS=: 00:06:09.894 15:07:08 -- accel/accel.sh@20 -- # read -r var val 00:06:09.894 15:07:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.894 15:07:08 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:09.894 15:07:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.894 00:06:09.894 real 0m2.962s 00:06:09.894 user 0m2.657s 00:06:09.894 sys 0m0.298s 00:06:09.894 15:07:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.894 15:07:08 -- common/autotest_common.sh@10 -- # set +x 00:06:09.894 ************************************ 00:06:09.894 END TEST accel_dif_generate 00:06:09.894 ************************************ 00:06:09.894 15:07:08 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:09.894 15:07:08 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:09.894 15:07:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.894 15:07:08 -- common/autotest_common.sh@10 -- # set +x 00:06:09.894 ************************************ 00:06:09.894 START TEST accel_dif_generate_copy 00:06:09.894 ************************************ 00:06:09.894 15:07:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:09.894 15:07:08 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.894 15:07:08 -- accel/accel.sh@17 -- # local accel_module 00:06:09.894 15:07:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:09.894 15:07:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:09.894 15:07:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.894 15:07:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.894 15:07:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.894 15:07:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.894 15:07:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.894 15:07:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.894 15:07:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.894 15:07:08 -- accel/accel.sh@42 -- # jq -r . 00:06:09.894 [2024-11-19 15:07:08.149704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.894 [2024-11-19 15:07:08.149787] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656681 ] 00:06:09.894 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.894 [2024-11-19 15:07:08.210377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.894 [2024-11-19 15:07:08.330571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.267 15:07:09 -- accel/accel.sh@18 -- # out=' 00:06:11.267 SPDK Configuration: 00:06:11.267 Core mask: 0x1 00:06:11.267 00:06:11.267 Accel Perf Configuration: 00:06:11.267 Workload Type: dif_generate_copy 00:06:11.267 Vector size: 4096 bytes 00:06:11.267 Transfer size: 4096 bytes 00:06:11.267 Vector count 1 00:06:11.267 Module: software 00:06:11.267 Queue depth: 32 00:06:11.267 Allocate depth: 32 00:06:11.267 # threads/core: 1 00:06:11.267 Run time: 1 seconds 00:06:11.267 Verify: No 00:06:11.267 00:06:11.267 Running for 1 seconds... 00:06:11.267 00:06:11.267 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.267 ------------------------------------------------------------------------------------ 00:06:11.267 0,0 76096/s 301 MiB/s 0 0 00:06:11.267 ==================================================================================== 00:06:11.267 Total 76096/s 297 MiB/s 0 0' 00:06:11.267 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.267 15:07:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:11.267 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.267 15:07:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:11.267 15:07:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.267 15:07:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.267 15:07:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.267 15:07:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.267 15:07:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.267 15:07:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.267 15:07:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.267 15:07:09 -- accel/accel.sh@42 -- # jq -r . 00:06:11.267 [2024-11-19 15:07:09.633320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.267 [2024-11-19 15:07:09.633404] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656826 ] 00:06:11.267 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.267 [2024-11-19 15:07:09.698923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.267 [2024-11-19 15:07:09.819189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=0x1 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=software 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=32 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=32 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=1 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val=No 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.526 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.526 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.526 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:11.527 15:07:09 -- accel/accel.sh@21 -- # val= 00:06:11.527 15:07:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.527 15:07:09 -- accel/accel.sh@20 -- # IFS=: 00:06:11.527 15:07:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@21 -- # val= 00:06:12.902 15:07:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # IFS=: 00:06:12.902 15:07:11 -- accel/accel.sh@20 -- # read -r var val 00:06:12.902 15:07:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.902 15:07:11 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:12.902 15:07:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.902 00:06:12.902 real 0m2.976s 00:06:12.902 user 0m2.675s 00:06:12.902 sys 0m0.291s 00:06:12.902 15:07:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.902 15:07:11 -- common/autotest_common.sh@10 -- # set +x 00:06:12.902 ************************************ 00:06:12.902 END TEST accel_dif_generate_copy 00:06:12.902 ************************************ 00:06:12.902 15:07:11 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:12.902 15:07:11 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.902 15:07:11 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:12.902 15:07:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.902 15:07:11 -- common/autotest_common.sh@10 -- # set +x 00:06:12.902 ************************************ 00:06:12.902 START TEST accel_comp 00:06:12.902 ************************************ 00:06:12.902 15:07:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.902 15:07:11 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.902 15:07:11 -- accel/accel.sh@17 -- # local accel_module 00:06:12.902 15:07:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.902 15:07:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.902 15:07:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.902 15:07:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.902 15:07:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.902 15:07:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.902 15:07:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.902 15:07:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.902 15:07:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.902 15:07:11 -- accel/accel.sh@42 -- # jq -r . 00:06:12.902 [2024-11-19 15:07:11.152230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.902 [2024-11-19 15:07:11.152313] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2656981 ] 00:06:12.902 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.902 [2024-11-19 15:07:11.214280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.902 [2024-11-19 15:07:11.336284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.273 15:07:12 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:14.273 00:06:14.273 SPDK Configuration: 00:06:14.273 Core mask: 0x1 00:06:14.273 00:06:14.273 Accel Perf Configuration: 00:06:14.273 Workload Type: compress 00:06:14.273 Transfer size: 4096 bytes 00:06:14.273 Vector count 1 00:06:14.273 Module: software 00:06:14.273 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.273 Queue depth: 32 00:06:14.273 Allocate depth: 32 00:06:14.273 # threads/core: 1 00:06:14.273 Run time: 1 seconds 00:06:14.273 Verify: No 00:06:14.273 00:06:14.273 Running for 1 seconds... 00:06:14.273 00:06:14.273 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.273 ------------------------------------------------------------------------------------ 00:06:14.273 0,0 31520/s 131 MiB/s 0 0 00:06:14.273 ==================================================================================== 00:06:14.273 Total 31520/s 123 MiB/s 0 0' 00:06:14.273 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.273 15:07:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.273 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.273 15:07:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.273 15:07:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.273 15:07:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.273 15:07:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.273 15:07:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.273 15:07:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.273 15:07:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.273 15:07:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.273 15:07:12 -- accel/accel.sh@42 -- # jq -r . 00:06:14.273 [2024-11-19 15:07:12.632210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.273 [2024-11-19 15:07:12.632293] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2657249 ] 00:06:14.273 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.273 [2024-11-19 15:07:12.694501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.273 [2024-11-19 15:07:12.811565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.531 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.531 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.531 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.531 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.531 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.531 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.531 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.531 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.531 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.531 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.531 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=0x1 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=compress 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=software 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=32 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=32 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=1 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val=No 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:14.532 15:07:12 -- accel/accel.sh@21 -- # val= 00:06:14.532 15:07:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # IFS=: 00:06:14.532 15:07:12 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@21 -- # val= 00:06:15.904 15:07:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # IFS=: 00:06:15.904 15:07:14 -- accel/accel.sh@20 -- # read -r var val 00:06:15.904 15:07:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.904 15:07:14 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:15.904 15:07:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.904 00:06:15.904 real 0m2.954s 00:06:15.904 user 0m2.666s 00:06:15.904 sys 0m0.281s 00:06:15.904 15:07:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.904 15:07:14 -- common/autotest_common.sh@10 -- # set +x 00:06:15.904 ************************************ 00:06:15.904 END TEST accel_comp 00:06:15.904 ************************************ 00:06:15.904 15:07:14 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:15.904 15:07:14 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:15.904 15:07:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.904 15:07:14 -- common/autotest_common.sh@10 -- # set +x 00:06:15.904 ************************************ 00:06:15.904 START TEST accel_decomp 00:06:15.904 ************************************ 00:06:15.904 15:07:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:15.904 15:07:14 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.904 15:07:14 -- accel/accel.sh@17 -- # local accel_module 00:06:15.904 15:07:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:15.904 15:07:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:15.904 15:07:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.904 15:07:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.904 15:07:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.904 15:07:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.904 15:07:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.904 15:07:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.904 15:07:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.904 15:07:14 -- accel/accel.sh@42 -- # jq -r . 00:06:15.904 [2024-11-19 15:07:14.131677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.904 [2024-11-19 15:07:14.131771] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2657410 ] 00:06:15.904 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.904 [2024-11-19 15:07:14.198749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.904 [2024-11-19 15:07:14.319127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.279 15:07:15 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.279 00:06:17.279 SPDK Configuration: 00:06:17.279 Core mask: 0x1 00:06:17.279 00:06:17.279 Accel Perf Configuration: 00:06:17.279 Workload Type: decompress 00:06:17.279 Transfer size: 4096 bytes 00:06:17.279 Vector count 1 00:06:17.279 Module: software 00:06:17.279 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.279 Queue depth: 32 00:06:17.279 Allocate depth: 32 00:06:17.279 # threads/core: 1 00:06:17.279 Run time: 1 seconds 00:06:17.279 Verify: Yes 00:06:17.279 00:06:17.279 Running for 1 seconds... 00:06:17.279 00:06:17.279 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.279 ------------------------------------------------------------------------------------ 00:06:17.279 0,0 55424/s 102 MiB/s 0 0 00:06:17.279 ==================================================================================== 00:06:17.279 Total 55424/s 216 MiB/s 0 0' 00:06:17.279 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.279 15:07:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.279 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.279 15:07:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.279 15:07:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.279 15:07:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.279 15:07:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.279 15:07:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.279 15:07:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.279 15:07:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.279 15:07:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.279 15:07:15 -- accel/accel.sh@42 -- # jq -r . 00:06:17.279 [2024-11-19 15:07:15.625483] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.279 [2024-11-19 15:07:15.625567] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2657554 ] 00:06:17.279 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.279 [2024-11-19 15:07:15.690234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.279 [2024-11-19 15:07:15.810388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=0x1 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=decompress 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=software 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=32 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=32 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=1 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val=Yes 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:17.538 15:07:15 -- accel/accel.sh@21 -- # val= 00:06:17.538 15:07:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # IFS=: 00:06:17.538 15:07:15 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@21 -- # val= 00:06:18.913 15:07:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # IFS=: 00:06:18.913 15:07:17 -- accel/accel.sh@20 -- # read -r var val 00:06:18.913 15:07:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.913 15:07:17 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:18.913 15:07:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.913 00:06:18.913 real 0m2.979s 00:06:18.913 user 0m2.666s 00:06:18.913 sys 0m0.305s 00:06:18.913 15:07:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.913 15:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:18.913 ************************************ 00:06:18.913 END TEST accel_decomp 00:06:18.913 ************************************ 00:06:18.913 15:07:17 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:18.913 15:07:17 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:18.913 15:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.913 15:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:18.913 ************************************ 00:06:18.913 START TEST accel_decmop_full 00:06:18.913 ************************************ 00:06:18.913 15:07:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:18.913 15:07:17 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.913 15:07:17 -- accel/accel.sh@17 -- # local accel_module 00:06:18.913 15:07:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:18.913 15:07:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:18.913 15:07:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.913 15:07:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.913 15:07:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.913 15:07:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.913 15:07:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.913 15:07:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.913 15:07:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.913 15:07:17 -- accel/accel.sh@42 -- # jq -r . 00:06:18.913 [2024-11-19 15:07:17.136624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.913 [2024-11-19 15:07:17.136817] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2657829 ] 00:06:18.913 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.913 [2024-11-19 15:07:17.203172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.913 [2024-11-19 15:07:17.322662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.287 15:07:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:20.287 00:06:20.287 SPDK Configuration: 00:06:20.287 Core mask: 0x1 00:06:20.287 00:06:20.287 Accel Perf Configuration: 00:06:20.287 Workload Type: decompress 00:06:20.287 Transfer size: 111250 bytes 00:06:20.287 Vector count 1 00:06:20.287 Module: software 00:06:20.287 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.287 Queue depth: 32 00:06:20.287 Allocate depth: 32 00:06:20.287 # threads/core: 1 00:06:20.287 Run time: 1 seconds 00:06:20.287 Verify: Yes 00:06:20.287 00:06:20.287 Running for 1 seconds... 00:06:20.287 00:06:20.287 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:20.287 ------------------------------------------------------------------------------------ 00:06:20.287 0,0 3808/s 157 MiB/s 0 0 00:06:20.287 ==================================================================================== 00:06:20.287 Total 3808/s 404 MiB/s 0 0' 00:06:20.287 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.287 15:07:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.287 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.287 15:07:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.287 15:07:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.287 15:07:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.288 15:07:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.288 15:07:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.288 15:07:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.288 15:07:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.288 15:07:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.288 15:07:18 -- accel/accel.sh@42 -- # jq -r . 00:06:20.288 [2024-11-19 15:07:18.636665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.288 [2024-11-19 15:07:18.636754] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2657981 ] 00:06:20.288 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.288 [2024-11-19 15:07:18.697590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.288 [2024-11-19 15:07:18.815947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=0x1 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=decompress 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=software 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=32 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=32 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=1 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val=Yes 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:20.547 15:07:18 -- accel/accel.sh@21 -- # val= 00:06:20.547 15:07:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # IFS=: 00:06:20.547 15:07:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@21 -- # val= 00:06:21.929 15:07:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # IFS=: 00:06:21.929 15:07:20 -- accel/accel.sh@20 -- # read -r var val 00:06:21.929 15:07:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.929 15:07:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.929 15:07:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.929 00:06:21.929 real 0m3.004s 00:06:21.929 user 0m2.697s 00:06:21.929 sys 0m0.299s 00:06:21.929 15:07:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.929 15:07:20 -- common/autotest_common.sh@10 -- # set +x 00:06:21.929 ************************************ 00:06:21.929 END TEST accel_decmop_full 00:06:21.929 ************************************ 00:06:21.929 15:07:20 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:21.929 15:07:20 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:21.929 15:07:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.929 15:07:20 -- common/autotest_common.sh@10 -- # set +x 00:06:21.929 ************************************ 00:06:21.929 START TEST accel_decomp_mcore 00:06:21.929 ************************************ 00:06:21.929 15:07:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:21.929 15:07:20 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.929 15:07:20 -- accel/accel.sh@17 -- # local accel_module 00:06:21.929 15:07:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:21.929 15:07:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:21.929 15:07:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.929 15:07:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.929 15:07:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.929 15:07:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.929 15:07:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.929 15:07:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.929 15:07:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.929 15:07:20 -- accel/accel.sh@42 -- # jq -r . 00:06:21.929 [2024-11-19 15:07:20.167374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.929 [2024-11-19 15:07:20.167459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2658137 ] 00:06:21.929 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.929 [2024-11-19 15:07:20.233596] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.929 [2024-11-19 15:07:20.357364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.929 [2024-11-19 15:07:20.357420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.929 [2024-11-19 15:07:20.357475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.929 [2024-11-19 15:07:20.357478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.305 15:07:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:23.305 00:06:23.305 SPDK Configuration: 00:06:23.305 Core mask: 0xf 00:06:23.305 00:06:23.305 Accel Perf Configuration: 00:06:23.305 Workload Type: decompress 00:06:23.305 Transfer size: 4096 bytes 00:06:23.305 Vector count 1 00:06:23.305 Module: software 00:06:23.305 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.305 Queue depth: 32 00:06:23.305 Allocate depth: 32 00:06:23.305 # threads/core: 1 00:06:23.305 Run time: 1 seconds 00:06:23.305 Verify: Yes 00:06:23.305 00:06:23.305 Running for 1 seconds... 00:06:23.305 00:06:23.305 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:23.305 ------------------------------------------------------------------------------------ 00:06:23.305 0,0 50112/s 92 MiB/s 0 0 00:06:23.305 3,0 50528/s 93 MiB/s 0 0 00:06:23.305 2,0 50496/s 93 MiB/s 0 0 00:06:23.305 1,0 50400/s 92 MiB/s 0 0 00:06:23.305 ==================================================================================== 00:06:23.305 Total 201536/s 787 MiB/s 0 0' 00:06:23.305 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.305 15:07:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.305 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.305 15:07:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.305 15:07:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.305 15:07:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.305 15:07:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.305 15:07:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.305 15:07:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.305 15:07:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.305 15:07:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.305 15:07:21 -- accel/accel.sh@42 -- # jq -r . 00:06:23.305 [2024-11-19 15:07:21.666134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.305 [2024-11-19 15:07:21.666219] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2658388 ] 00:06:23.305 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.305 [2024-11-19 15:07:21.728300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.305 [2024-11-19 15:07:21.850746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.305 [2024-11-19 15:07:21.850803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.305 [2024-11-19 15:07:21.850859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:23.305 [2024-11-19 15:07:21.850862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=0xf 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=decompress 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=software 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=32 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=32 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=1 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val=Yes 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:23.564 15:07:21 -- accel/accel.sh@21 -- # val= 00:06:23.564 15:07:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # IFS=: 00:06:23.564 15:07:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@21 -- # val= 00:06:24.942 15:07:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # IFS=: 00:06:24.942 15:07:23 -- accel/accel.sh@20 -- # read -r var val 00:06:24.942 15:07:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.942 15:07:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.942 15:07:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.942 00:06:24.942 real 0m2.988s 00:06:24.942 user 0m9.588s 00:06:24.942 sys 0m0.314s 00:06:24.942 15:07:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.942 15:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:24.942 ************************************ 00:06:24.942 END TEST accel_decomp_mcore 00:06:24.942 ************************************ 00:06:24.942 15:07:23 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:24.942 15:07:23 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:24.942 15:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.942 15:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:24.942 ************************************ 00:06:24.942 START TEST accel_decomp_full_mcore 00:06:24.942 ************************************ 00:06:24.942 15:07:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:24.942 15:07:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.942 15:07:23 -- accel/accel.sh@17 -- # local accel_module 00:06:24.942 15:07:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:24.942 15:07:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:24.942 15:07:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.942 15:07:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.942 15:07:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.942 15:07:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.942 15:07:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.942 15:07:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.942 15:07:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.942 15:07:23 -- accel/accel.sh@42 -- # jq -r . 00:06:24.942 [2024-11-19 15:07:23.181833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.942 [2024-11-19 15:07:23.181917] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2658566 ] 00:06:24.942 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.942 [2024-11-19 15:07:23.248141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:24.942 [2024-11-19 15:07:23.369023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.942 [2024-11-19 15:07:23.369071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.942 [2024-11-19 15:07:23.369126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.942 [2024-11-19 15:07:23.369130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.318 15:07:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:26.318 00:06:26.318 SPDK Configuration: 00:06:26.318 Core mask: 0xf 00:06:26.318 00:06:26.318 Accel Perf Configuration: 00:06:26.318 Workload Type: decompress 00:06:26.318 Transfer size: 111250 bytes 00:06:26.318 Vector count 1 00:06:26.318 Module: software 00:06:26.318 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.318 Queue depth: 32 00:06:26.318 Allocate depth: 32 00:06:26.318 # threads/core: 1 00:06:26.318 Run time: 1 seconds 00:06:26.318 Verify: Yes 00:06:26.318 00:06:26.318 Running for 1 seconds... 00:06:26.318 00:06:26.318 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.318 ------------------------------------------------------------------------------------ 00:06:26.318 0,0 3776/s 155 MiB/s 0 0 00:06:26.318 3,0 3776/s 155 MiB/s 0 0 00:06:26.318 2,0 3776/s 155 MiB/s 0 0 00:06:26.318 1,0 3776/s 155 MiB/s 0 0 00:06:26.318 ==================================================================================== 00:06:26.318 Total 15104/s 1602 MiB/s 0 0' 00:06:26.319 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.319 15:07:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.319 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.319 15:07:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.319 15:07:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.319 15:07:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.319 15:07:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.319 15:07:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.319 15:07:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.319 15:07:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.319 15:07:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.319 15:07:24 -- accel/accel.sh@42 -- # jq -r . 00:06:26.319 [2024-11-19 15:07:24.674556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.319 [2024-11-19 15:07:24.674642] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2658718 ] 00:06:26.319 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.319 [2024-11-19 15:07:24.737397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.319 [2024-11-19 15:07:24.860668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.319 [2024-11-19 15:07:24.860725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.319 [2024-11-19 15:07:24.860761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.319 [2024-11-19 15:07:24.860764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=0xf 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=decompress 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=software 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=32 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=32 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=1 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val=Yes 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:26.578 15:07:24 -- accel/accel.sh@21 -- # val= 00:06:26.578 15:07:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # IFS=: 00:06:26.578 15:07:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.954 15:07:26 -- accel/accel.sh@21 -- # val= 00:06:27.954 15:07:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.954 15:07:26 -- accel/accel.sh@20 -- # IFS=: 00:06:27.955 15:07:26 -- accel/accel.sh@20 -- # read -r var val 00:06:27.955 15:07:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.955 15:07:26 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.955 15:07:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.955 00:06:27.955 real 0m3.003s 00:06:27.955 user 0m9.651s 00:06:27.955 sys 0m0.318s 00:06:27.955 15:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.955 15:07:26 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 ************************************ 00:06:27.955 END TEST accel_decomp_full_mcore 00:06:27.955 ************************************ 00:06:27.955 15:07:26 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:27.955 15:07:26 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:27.955 15:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.955 15:07:26 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 ************************************ 00:06:27.955 START TEST accel_decomp_mthread 00:06:27.955 ************************************ 00:06:27.955 15:07:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:27.955 15:07:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.955 15:07:26 -- accel/accel.sh@17 -- # local accel_module 00:06:27.955 15:07:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:27.955 15:07:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:27.955 15:07:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.955 15:07:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.955 15:07:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.955 15:07:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.955 15:07:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.955 15:07:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.955 15:07:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.955 15:07:26 -- accel/accel.sh@42 -- # jq -r . 00:06:27.955 [2024-11-19 15:07:26.212461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.955 [2024-11-19 15:07:26.212543] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2658959 ] 00:06:27.955 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.955 [2024-11-19 15:07:26.279583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.955 [2024-11-19 15:07:26.400036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.330 15:07:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:29.330 00:06:29.330 SPDK Configuration: 00:06:29.330 Core mask: 0x1 00:06:29.330 00:06:29.330 Accel Perf Configuration: 00:06:29.330 Workload Type: decompress 00:06:29.330 Transfer size: 4096 bytes 00:06:29.330 Vector count 1 00:06:29.330 Module: software 00:06:29.330 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.330 Queue depth: 32 00:06:29.330 Allocate depth: 32 00:06:29.330 # threads/core: 2 00:06:29.330 Run time: 1 seconds 00:06:29.330 Verify: Yes 00:06:29.330 00:06:29.330 Running for 1 seconds... 00:06:29.330 00:06:29.330 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.330 ------------------------------------------------------------------------------------ 00:06:29.330 0,1 28064/s 51 MiB/s 0 0 00:06:29.330 0,0 27968/s 51 MiB/s 0 0 00:06:29.330 ==================================================================================== 00:06:29.330 Total 56032/s 218 MiB/s 0 0' 00:06:29.330 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.330 15:07:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.330 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.330 15:07:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.330 15:07:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.330 15:07:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.330 15:07:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.330 15:07:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.330 15:07:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.330 15:07:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.330 15:07:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.330 15:07:27 -- accel/accel.sh@42 -- # jq -r . 00:06:29.330 [2024-11-19 15:07:27.705048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.330 [2024-11-19 15:07:27.705134] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659143 ] 00:06:29.330 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.330 [2024-11-19 15:07:27.767444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.330 [2024-11-19 15:07:27.887259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=0x1 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=decompress 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=software 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=32 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=32 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=2 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val=Yes 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:29.589 15:07:27 -- accel/accel.sh@21 -- # val= 00:06:29.589 15:07:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # IFS=: 00:06:29.589 15:07:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@21 -- # val= 00:06:30.965 15:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # IFS=: 00:06:30.965 15:07:29 -- accel/accel.sh@20 -- # read -r var val 00:06:30.965 15:07:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.965 15:07:29 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.965 15:07:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.965 00:06:30.965 real 0m2.985s 00:06:30.965 user 0m2.671s 00:06:30.965 sys 0m0.305s 00:06:30.965 15:07:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.965 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:06:30.965 ************************************ 00:06:30.965 END TEST accel_decomp_mthread 00:06:30.965 ************************************ 00:06:30.965 15:07:29 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:30.965 15:07:29 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:30.965 15:07:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.965 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:06:30.965 ************************************ 00:06:30.965 START TEST accel_deomp_full_mthread 00:06:30.965 ************************************ 00:06:30.965 15:07:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:30.965 15:07:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.965 15:07:29 -- accel/accel.sh@17 -- # local accel_module 00:06:30.965 15:07:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:30.965 15:07:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:30.965 15:07:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.965 15:07:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.965 15:07:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.965 15:07:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.965 15:07:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.965 15:07:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.965 15:07:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.965 15:07:29 -- accel/accel.sh@42 -- # jq -r . 00:06:30.965 [2024-11-19 15:07:29.221895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.965 [2024-11-19 15:07:29.221976] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659303 ] 00:06:30.965 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.965 [2024-11-19 15:07:29.287743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.965 [2024-11-19 15:07:29.406775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.342 15:07:30 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:32.342 00:06:32.342 SPDK Configuration: 00:06:32.342 Core mask: 0x1 00:06:32.342 00:06:32.342 Accel Perf Configuration: 00:06:32.342 Workload Type: decompress 00:06:32.342 Transfer size: 111250 bytes 00:06:32.342 Vector count 1 00:06:32.342 Module: software 00:06:32.342 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.342 Queue depth: 32 00:06:32.342 Allocate depth: 32 00:06:32.342 # threads/core: 2 00:06:32.342 Run time: 1 seconds 00:06:32.342 Verify: Yes 00:06:32.342 00:06:32.342 Running for 1 seconds... 00:06:32.342 00:06:32.342 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:32.342 ------------------------------------------------------------------------------------ 00:06:32.342 0,1 1952/s 80 MiB/s 0 0 00:06:32.342 0,0 1920/s 79 MiB/s 0 0 00:06:32.342 ==================================================================================== 00:06:32.342 Total 3872/s 410 MiB/s 0 0' 00:06:32.342 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.342 15:07:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.342 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.342 15:07:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.342 15:07:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.342 15:07:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.342 15:07:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.342 15:07:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.342 15:07:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.342 15:07:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.342 15:07:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.342 15:07:30 -- accel/accel.sh@42 -- # jq -r . 00:06:32.342 [2024-11-19 15:07:30.748399] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.342 [2024-11-19 15:07:30.748493] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659500 ] 00:06:32.342 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.342 [2024-11-19 15:07:30.811876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.601 [2024-11-19 15:07:30.933038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val=0x1 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val=decompress 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:30 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:30 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:30 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:32.601 15:07:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=software 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=32 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=32 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=2 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val=Yes 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:32.601 15:07:31 -- accel/accel.sh@21 -- # val= 00:06:32.601 15:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # IFS=: 00:06:32.601 15:07:31 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@21 -- # val= 00:06:33.976 15:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # IFS=: 00:06:33.976 15:07:32 -- accel/accel.sh@20 -- # read -r var val 00:06:33.976 15:07:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.976 15:07:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.976 15:07:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.976 00:06:33.976 real 0m3.053s 00:06:33.976 user 0m2.755s 00:06:33.976 sys 0m0.290s 00:06:33.976 15:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.976 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:33.976 ************************************ 00:06:33.976 END TEST accel_deomp_full_mthread 00:06:33.976 ************************************ 00:06:33.976 15:07:32 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:33.976 15:07:32 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:33.976 15:07:32 -- accel/accel.sh@129 -- # build_accel_config 00:06:33.976 15:07:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:33.976 15:07:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.976 15:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.976 15:07:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.976 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:33.976 15:07:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.976 15:07:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.976 15:07:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.976 15:07:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.976 15:07:32 -- accel/accel.sh@42 -- # jq -r . 00:06:33.976 ************************************ 00:06:33.976 START TEST accel_dif_functional_tests 00:06:33.976 ************************************ 00:06:33.976 15:07:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:33.976 [2024-11-19 15:07:32.325068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.976 [2024-11-19 15:07:32.325159] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659727 ] 00:06:33.977 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.977 [2024-11-19 15:07:32.392572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:33.977 [2024-11-19 15:07:32.515050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:33.977 [2024-11-19 15:07:32.515104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:33.977 [2024-11-19 15:07:32.515107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.236 00:06:34.236 00:06:34.236 CUnit - A unit testing framework for C - Version 2.1-3 00:06:34.236 http://cunit.sourceforge.net/ 00:06:34.236 00:06:34.236 00:06:34.236 Suite: accel_dif 00:06:34.236 Test: verify: DIF generated, GUARD check ...passed 00:06:34.236 Test: verify: DIF generated, APPTAG check ...passed 00:06:34.236 Test: verify: DIF generated, REFTAG check ...passed 00:06:34.236 Test: verify: DIF not generated, GUARD check ...[2024-11-19 15:07:32.618002] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:34.236 [2024-11-19 15:07:32.618076] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:34.236 passed 00:06:34.236 Test: verify: DIF not generated, APPTAG check ...[2024-11-19 15:07:32.618118] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:34.236 [2024-11-19 15:07:32.618149] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:34.236 passed 00:06:34.236 Test: verify: DIF not generated, REFTAG check ...[2024-11-19 15:07:32.618183] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:34.236 [2024-11-19 15:07:32.618211] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:34.236 passed 00:06:34.236 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:34.236 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-19 15:07:32.618283] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:34.236 passed 00:06:34.236 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:34.236 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:34.236 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:34.236 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-19 15:07:32.618443] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:34.236 passed 00:06:34.236 Test: generate copy: DIF generated, GUARD check ...passed 00:06:34.236 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:34.236 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:34.236 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:34.236 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:34.236 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:34.236 Test: generate copy: iovecs-len validate ...[2024-11-19 15:07:32.618714] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:34.236 passed 00:06:34.236 Test: generate copy: buffer alignment validate ...passed 00:06:34.236 00:06:34.236 Run Summary: Type Total Ran Passed Failed Inactive 00:06:34.236 suites 1 1 n/a 0 0 00:06:34.236 tests 20 20 20 0 0 00:06:34.236 asserts 204 204 204 0 n/a 00:06:34.236 00:06:34.236 Elapsed time = 0.003 seconds 00:06:34.496 00:06:34.496 real 0m0.591s 00:06:34.496 user 0m0.900s 00:06:34.496 sys 0m0.179s 00:06:34.496 15:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.496 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:34.496 ************************************ 00:06:34.496 END TEST accel_dif_functional_tests 00:06:34.496 ************************************ 00:06:34.496 00:06:34.496 real 1m3.472s 00:06:34.496 user 1m11.189s 00:06:34.496 sys 0m7.379s 00:06:34.496 15:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.496 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:34.496 ************************************ 00:06:34.496 END TEST accel 00:06:34.496 ************************************ 00:06:34.496 15:07:32 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:34.496 15:07:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.496 15:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.496 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:34.496 ************************************ 00:06:34.496 START TEST accel_rpc 00:06:34.496 ************************************ 00:06:34.496 15:07:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:34.496 * Looking for test storage... 00:06:34.496 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:34.496 15:07:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:34.496 15:07:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:34.496 15:07:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:34.755 15:07:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:34.755 15:07:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:34.755 15:07:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:34.755 15:07:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:34.755 15:07:33 -- scripts/common.sh@335 -- # IFS=.-: 00:06:34.755 15:07:33 -- scripts/common.sh@335 -- # read -ra ver1 00:06:34.755 15:07:33 -- scripts/common.sh@336 -- # IFS=.-: 00:06:34.755 15:07:33 -- scripts/common.sh@336 -- # read -ra ver2 00:06:34.755 15:07:33 -- scripts/common.sh@337 -- # local 'op=<' 00:06:34.755 15:07:33 -- scripts/common.sh@339 -- # ver1_l=2 00:06:34.755 15:07:33 -- scripts/common.sh@340 -- # ver2_l=1 00:06:34.755 15:07:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:34.755 15:07:33 -- scripts/common.sh@343 -- # case "$op" in 00:06:34.755 15:07:33 -- scripts/common.sh@344 -- # : 1 00:06:34.755 15:07:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:34.755 15:07:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:34.755 15:07:33 -- scripts/common.sh@364 -- # decimal 1 00:06:34.755 15:07:33 -- scripts/common.sh@352 -- # local d=1 00:06:34.755 15:07:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:34.755 15:07:33 -- scripts/common.sh@354 -- # echo 1 00:06:34.755 15:07:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:34.755 15:07:33 -- scripts/common.sh@365 -- # decimal 2 00:06:34.755 15:07:33 -- scripts/common.sh@352 -- # local d=2 00:06:34.755 15:07:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:34.755 15:07:33 -- scripts/common.sh@354 -- # echo 2 00:06:34.755 15:07:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:34.755 15:07:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:34.755 15:07:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:34.755 15:07:33 -- scripts/common.sh@367 -- # return 0 00:06:34.755 15:07:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:34.755 15:07:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:34.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.755 --rc genhtml_branch_coverage=1 00:06:34.755 --rc genhtml_function_coverage=1 00:06:34.755 --rc genhtml_legend=1 00:06:34.755 --rc geninfo_all_blocks=1 00:06:34.755 --rc geninfo_unexecuted_blocks=1 00:06:34.755 00:06:34.755 ' 00:06:34.755 15:07:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:34.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.755 --rc genhtml_branch_coverage=1 00:06:34.755 --rc genhtml_function_coverage=1 00:06:34.755 --rc genhtml_legend=1 00:06:34.755 --rc geninfo_all_blocks=1 00:06:34.755 --rc geninfo_unexecuted_blocks=1 00:06:34.755 00:06:34.755 ' 00:06:34.755 15:07:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:34.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.755 --rc genhtml_branch_coverage=1 00:06:34.755 --rc genhtml_function_coverage=1 00:06:34.755 --rc genhtml_legend=1 00:06:34.755 --rc geninfo_all_blocks=1 00:06:34.755 --rc geninfo_unexecuted_blocks=1 00:06:34.755 00:06:34.755 ' 00:06:34.755 15:07:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:34.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.755 --rc genhtml_branch_coverage=1 00:06:34.755 --rc genhtml_function_coverage=1 00:06:34.755 --rc genhtml_legend=1 00:06:34.755 --rc geninfo_all_blocks=1 00:06:34.755 --rc geninfo_unexecuted_blocks=1 00:06:34.755 00:06:34.755 ' 00:06:34.755 15:07:33 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:34.755 15:07:33 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2659920 00:06:34.755 15:07:33 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:34.755 15:07:33 -- accel/accel_rpc.sh@15 -- # waitforlisten 2659920 00:06:34.755 15:07:33 -- common/autotest_common.sh@829 -- # '[' -z 2659920 ']' 00:06:34.755 15:07:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.755 15:07:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.755 15:07:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.755 15:07:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.755 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:34.755 [2024-11-19 15:07:33.125293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.755 [2024-11-19 15:07:33.125373] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659920 ] 00:06:34.755 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.755 [2024-11-19 15:07:33.180791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.755 [2024-11-19 15:07:33.291666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.755 [2024-11-19 15:07:33.291871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.014 15:07:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.014 15:07:33 -- common/autotest_common.sh@862 -- # return 0 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:35.014 15:07:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.014 15:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.014 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.014 ************************************ 00:06:35.014 START TEST accel_assign_opcode 00:06:35.014 ************************************ 00:06:35.014 15:07:33 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:35.014 15:07:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.014 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.014 [2024-11-19 15:07:33.396565] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:35.014 15:07:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:35.014 15:07:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.014 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.014 [2024-11-19 15:07:33.404578] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:35.014 15:07:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.014 15:07:33 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:35.014 15:07:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.014 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.273 15:07:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.273 15:07:33 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:35.273 15:07:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.273 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.273 15:07:33 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:35.273 15:07:33 -- accel/accel_rpc.sh@42 -- # grep software 00:06:35.273 15:07:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.273 software 00:06:35.273 00:06:35.273 real 0m0.307s 00:06:35.273 user 0m0.039s 00:06:35.273 sys 0m0.008s 00:06:35.273 15:07:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.273 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:35.273 ************************************ 00:06:35.273 END TEST accel_assign_opcode 00:06:35.273 ************************************ 00:06:35.273 15:07:33 -- accel/accel_rpc.sh@55 -- # killprocess 2659920 00:06:35.273 15:07:33 -- common/autotest_common.sh@936 -- # '[' -z 2659920 ']' 00:06:35.273 15:07:33 -- common/autotest_common.sh@940 -- # kill -0 2659920 00:06:35.273 15:07:33 -- common/autotest_common.sh@941 -- # uname 00:06:35.273 15:07:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.273 15:07:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2659920 00:06:35.273 15:07:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.273 15:07:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.273 15:07:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2659920' 00:06:35.273 killing process with pid 2659920 00:06:35.273 15:07:33 -- common/autotest_common.sh@955 -- # kill 2659920 00:06:35.273 15:07:33 -- common/autotest_common.sh@960 -- # wait 2659920 00:06:35.909 00:06:35.909 real 0m1.309s 00:06:35.909 user 0m1.261s 00:06:35.909 sys 0m0.456s 00:06:35.909 15:07:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.909 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:35.909 ************************************ 00:06:35.909 END TEST accel_rpc 00:06:35.909 ************************************ 00:06:35.909 15:07:34 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:35.909 15:07:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.909 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:35.909 ************************************ 00:06:35.909 START TEST app_cmdline 00:06:35.909 ************************************ 00:06:35.909 15:07:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:35.909 * Looking for test storage... 00:06:35.909 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:35.909 15:07:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:35.909 15:07:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:35.909 15:07:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:35.909 15:07:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:35.909 15:07:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:35.909 15:07:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:35.909 15:07:34 -- scripts/common.sh@335 -- # IFS=.-: 00:06:35.909 15:07:34 -- scripts/common.sh@335 -- # read -ra ver1 00:06:35.909 15:07:34 -- scripts/common.sh@336 -- # IFS=.-: 00:06:35.909 15:07:34 -- scripts/common.sh@336 -- # read -ra ver2 00:06:35.909 15:07:34 -- scripts/common.sh@337 -- # local 'op=<' 00:06:35.909 15:07:34 -- scripts/common.sh@339 -- # ver1_l=2 00:06:35.909 15:07:34 -- scripts/common.sh@340 -- # ver2_l=1 00:06:35.909 15:07:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:35.909 15:07:34 -- scripts/common.sh@343 -- # case "$op" in 00:06:35.909 15:07:34 -- scripts/common.sh@344 -- # : 1 00:06:35.909 15:07:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:35.909 15:07:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:35.909 15:07:34 -- scripts/common.sh@364 -- # decimal 1 00:06:35.909 15:07:34 -- scripts/common.sh@352 -- # local d=1 00:06:35.909 15:07:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:35.909 15:07:34 -- scripts/common.sh@354 -- # echo 1 00:06:35.909 15:07:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:35.909 15:07:34 -- scripts/common.sh@365 -- # decimal 2 00:06:35.909 15:07:34 -- scripts/common.sh@352 -- # local d=2 00:06:35.909 15:07:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:35.909 15:07:34 -- scripts/common.sh@354 -- # echo 2 00:06:35.909 15:07:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:35.909 15:07:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:35.909 15:07:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:35.909 15:07:34 -- scripts/common.sh@367 -- # return 0 00:06:35.909 15:07:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:35.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.909 --rc genhtml_branch_coverage=1 00:06:35.909 --rc genhtml_function_coverage=1 00:06:35.909 --rc genhtml_legend=1 00:06:35.909 --rc geninfo_all_blocks=1 00:06:35.909 --rc geninfo_unexecuted_blocks=1 00:06:35.909 00:06:35.909 ' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:35.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.909 --rc genhtml_branch_coverage=1 00:06:35.909 --rc genhtml_function_coverage=1 00:06:35.909 --rc genhtml_legend=1 00:06:35.909 --rc geninfo_all_blocks=1 00:06:35.909 --rc geninfo_unexecuted_blocks=1 00:06:35.909 00:06:35.909 ' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:35.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.909 --rc genhtml_branch_coverage=1 00:06:35.909 --rc genhtml_function_coverage=1 00:06:35.909 --rc genhtml_legend=1 00:06:35.909 --rc geninfo_all_blocks=1 00:06:35.909 --rc geninfo_unexecuted_blocks=1 00:06:35.909 00:06:35.909 ' 00:06:35.909 15:07:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:35.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.909 --rc genhtml_branch_coverage=1 00:06:35.909 --rc genhtml_function_coverage=1 00:06:35.909 --rc genhtml_legend=1 00:06:35.909 --rc geninfo_all_blocks=1 00:06:35.909 --rc geninfo_unexecuted_blocks=1 00:06:35.909 00:06:35.909 ' 00:06:35.909 15:07:34 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:35.909 15:07:34 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2660135 00:06:35.909 15:07:34 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:35.909 15:07:34 -- app/cmdline.sh@18 -- # waitforlisten 2660135 00:06:35.909 15:07:34 -- common/autotest_common.sh@829 -- # '[' -z 2660135 ']' 00:06:35.909 15:07:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.909 15:07:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:35.909 15:07:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.909 15:07:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:35.909 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:35.909 [2024-11-19 15:07:34.468663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.910 [2024-11-19 15:07:34.468770] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2660135 ] 00:06:36.168 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.168 [2024-11-19 15:07:34.525827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.168 [2024-11-19 15:07:34.630865] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.168 [2024-11-19 15:07:34.631044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.105 15:07:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.105 15:07:35 -- common/autotest_common.sh@862 -- # return 0 00:06:37.105 15:07:35 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:37.363 { 00:06:37.363 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:37.363 "fields": { 00:06:37.363 "major": 24, 00:06:37.363 "minor": 1, 00:06:37.363 "patch": 1, 00:06:37.363 "suffix": "-pre", 00:06:37.363 "commit": "c13c99a5e" 00:06:37.363 } 00:06:37.363 } 00:06:37.363 15:07:35 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:37.363 15:07:35 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:37.363 15:07:35 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:37.363 15:07:35 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:37.363 15:07:35 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:37.363 15:07:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.363 15:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:37.363 15:07:35 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:37.363 15:07:35 -- app/cmdline.sh@26 -- # sort 00:06:37.363 15:07:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.363 15:07:35 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:37.363 15:07:35 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:37.363 15:07:35 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:37.363 15:07:35 -- common/autotest_common.sh@650 -- # local es=0 00:06:37.363 15:07:35 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:37.363 15:07:35 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:37.363 15:07:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.363 15:07:35 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:37.363 15:07:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.363 15:07:35 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:37.363 15:07:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:37.363 15:07:35 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:37.363 15:07:35 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:37.363 15:07:35 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:37.621 request: 00:06:37.621 { 00:06:37.621 "method": "env_dpdk_get_mem_stats", 00:06:37.621 "req_id": 1 00:06:37.622 } 00:06:37.622 Got JSON-RPC error response 00:06:37.622 response: 00:06:37.622 { 00:06:37.622 "code": -32601, 00:06:37.622 "message": "Method not found" 00:06:37.622 } 00:06:37.622 15:07:35 -- common/autotest_common.sh@653 -- # es=1 00:06:37.622 15:07:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:37.622 15:07:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:37.622 15:07:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:37.622 15:07:35 -- app/cmdline.sh@1 -- # killprocess 2660135 00:06:37.622 15:07:35 -- common/autotest_common.sh@936 -- # '[' -z 2660135 ']' 00:06:37.622 15:07:35 -- common/autotest_common.sh@940 -- # kill -0 2660135 00:06:37.622 15:07:35 -- common/autotest_common.sh@941 -- # uname 00:06:37.622 15:07:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.622 15:07:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2660135 00:06:37.622 15:07:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.622 15:07:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.622 15:07:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2660135' 00:06:37.622 killing process with pid 2660135 00:06:37.622 15:07:36 -- common/autotest_common.sh@955 -- # kill 2660135 00:06:37.622 15:07:36 -- common/autotest_common.sh@960 -- # wait 2660135 00:06:38.190 00:06:38.190 real 0m2.231s 00:06:38.190 user 0m2.788s 00:06:38.190 sys 0m0.513s 00:06:38.190 15:07:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.190 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.190 ************************************ 00:06:38.190 END TEST app_cmdline 00:06:38.190 ************************************ 00:06:38.190 15:07:36 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:38.190 15:07:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.190 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.190 ************************************ 00:06:38.190 START TEST version 00:06:38.190 ************************************ 00:06:38.190 15:07:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:38.190 * Looking for test storage... 00:06:38.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:38.190 15:07:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:38.190 15:07:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:38.190 15:07:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.190 15:07:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.190 15:07:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.190 15:07:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.190 15:07:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.190 15:07:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.190 15:07:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.190 15:07:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.190 15:07:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.190 15:07:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.190 15:07:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.190 15:07:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.190 15:07:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.190 15:07:36 -- scripts/common.sh@344 -- # : 1 00:06:38.190 15:07:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.190 15:07:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.190 15:07:36 -- scripts/common.sh@364 -- # decimal 1 00:06:38.190 15:07:36 -- scripts/common.sh@352 -- # local d=1 00:06:38.190 15:07:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.190 15:07:36 -- scripts/common.sh@354 -- # echo 1 00:06:38.190 15:07:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.190 15:07:36 -- scripts/common.sh@365 -- # decimal 2 00:06:38.190 15:07:36 -- scripts/common.sh@352 -- # local d=2 00:06:38.190 15:07:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.190 15:07:36 -- scripts/common.sh@354 -- # echo 2 00:06:38.190 15:07:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.190 15:07:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.190 15:07:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.190 15:07:36 -- scripts/common.sh@367 -- # return 0 00:06:38.190 15:07:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.190 --rc genhtml_branch_coverage=1 00:06:38.190 --rc genhtml_function_coverage=1 00:06:38.190 --rc genhtml_legend=1 00:06:38.190 --rc geninfo_all_blocks=1 00:06:38.190 --rc geninfo_unexecuted_blocks=1 00:06:38.190 00:06:38.190 ' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.190 --rc genhtml_branch_coverage=1 00:06:38.190 --rc genhtml_function_coverage=1 00:06:38.190 --rc genhtml_legend=1 00:06:38.190 --rc geninfo_all_blocks=1 00:06:38.190 --rc geninfo_unexecuted_blocks=1 00:06:38.190 00:06:38.190 ' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.190 --rc genhtml_branch_coverage=1 00:06:38.190 --rc genhtml_function_coverage=1 00:06:38.190 --rc genhtml_legend=1 00:06:38.190 --rc geninfo_all_blocks=1 00:06:38.190 --rc geninfo_unexecuted_blocks=1 00:06:38.190 00:06:38.190 ' 00:06:38.190 15:07:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.190 --rc genhtml_branch_coverage=1 00:06:38.190 --rc genhtml_function_coverage=1 00:06:38.190 --rc genhtml_legend=1 00:06:38.190 --rc geninfo_all_blocks=1 00:06:38.190 --rc geninfo_unexecuted_blocks=1 00:06:38.190 00:06:38.190 ' 00:06:38.190 15:07:36 -- app/version.sh@17 -- # get_header_version major 00:06:38.190 15:07:36 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:38.190 15:07:36 -- app/version.sh@14 -- # cut -f2 00:06:38.190 15:07:36 -- app/version.sh@14 -- # tr -d '"' 00:06:38.190 15:07:36 -- app/version.sh@17 -- # major=24 00:06:38.190 15:07:36 -- app/version.sh@18 -- # get_header_version minor 00:06:38.190 15:07:36 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:38.190 15:07:36 -- app/version.sh@14 -- # cut -f2 00:06:38.190 15:07:36 -- app/version.sh@14 -- # tr -d '"' 00:06:38.190 15:07:36 -- app/version.sh@18 -- # minor=1 00:06:38.190 15:07:36 -- app/version.sh@19 -- # get_header_version patch 00:06:38.190 15:07:36 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:38.190 15:07:36 -- app/version.sh@14 -- # cut -f2 00:06:38.190 15:07:36 -- app/version.sh@14 -- # tr -d '"' 00:06:38.190 15:07:36 -- app/version.sh@19 -- # patch=1 00:06:38.190 15:07:36 -- app/version.sh@20 -- # get_header_version suffix 00:06:38.190 15:07:36 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:38.190 15:07:36 -- app/version.sh@14 -- # cut -f2 00:06:38.190 15:07:36 -- app/version.sh@14 -- # tr -d '"' 00:06:38.190 15:07:36 -- app/version.sh@20 -- # suffix=-pre 00:06:38.190 15:07:36 -- app/version.sh@22 -- # version=24.1 00:06:38.190 15:07:36 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:38.190 15:07:36 -- app/version.sh@25 -- # version=24.1.1 00:06:38.190 15:07:36 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:38.190 15:07:36 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:38.190 15:07:36 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:38.190 15:07:36 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:38.190 15:07:36 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:38.190 00:06:38.190 real 0m0.203s 00:06:38.190 user 0m0.130s 00:06:38.190 sys 0m0.099s 00:06:38.190 15:07:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.190 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.190 ************************************ 00:06:38.190 END TEST version 00:06:38.190 ************************************ 00:06:38.190 15:07:36 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:38.190 15:07:36 -- spdk/autotest.sh@191 -- # uname -s 00:06:38.190 15:07:36 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:38.190 15:07:36 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:38.190 15:07:36 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:38.190 15:07:36 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:38.190 15:07:36 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:38.190 15:07:36 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:38.190 15:07:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:38.190 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.450 15:07:36 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:38.450 15:07:36 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:38.450 15:07:36 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:38.450 15:07:36 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:38.450 15:07:36 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:38.450 15:07:36 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:38.450 15:07:36 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:38.450 15:07:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.450 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.450 ************************************ 00:06:38.450 START TEST nvmf_tcp 00:06:38.450 ************************************ 00:06:38.450 15:07:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:38.450 * Looking for test storage... 00:06:38.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:38.450 15:07:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:38.450 15:07:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:38.450 15:07:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.450 15:07:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.450 15:07:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.450 15:07:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.450 15:07:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.450 15:07:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.450 15:07:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.450 15:07:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.450 15:07:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.450 15:07:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.450 15:07:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.450 15:07:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.450 15:07:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.450 15:07:36 -- scripts/common.sh@344 -- # : 1 00:06:38.450 15:07:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.450 15:07:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.450 15:07:36 -- scripts/common.sh@364 -- # decimal 1 00:06:38.450 15:07:36 -- scripts/common.sh@352 -- # local d=1 00:06:38.450 15:07:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.450 15:07:36 -- scripts/common.sh@354 -- # echo 1 00:06:38.450 15:07:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.450 15:07:36 -- scripts/common.sh@365 -- # decimal 2 00:06:38.450 15:07:36 -- scripts/common.sh@352 -- # local d=2 00:06:38.450 15:07:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.450 15:07:36 -- scripts/common.sh@354 -- # echo 2 00:06:38.450 15:07:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.450 15:07:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.450 15:07:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.450 15:07:36 -- scripts/common.sh@367 -- # return 0 00:06:38.450 15:07:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.450 --rc genhtml_branch_coverage=1 00:06:38.450 --rc genhtml_function_coverage=1 00:06:38.450 --rc genhtml_legend=1 00:06:38.450 --rc geninfo_all_blocks=1 00:06:38.450 --rc geninfo_unexecuted_blocks=1 00:06:38.450 00:06:38.450 ' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.450 --rc genhtml_branch_coverage=1 00:06:38.450 --rc genhtml_function_coverage=1 00:06:38.450 --rc genhtml_legend=1 00:06:38.450 --rc geninfo_all_blocks=1 00:06:38.450 --rc geninfo_unexecuted_blocks=1 00:06:38.450 00:06:38.450 ' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.450 --rc genhtml_branch_coverage=1 00:06:38.450 --rc genhtml_function_coverage=1 00:06:38.450 --rc genhtml_legend=1 00:06:38.450 --rc geninfo_all_blocks=1 00:06:38.450 --rc geninfo_unexecuted_blocks=1 00:06:38.450 00:06:38.450 ' 00:06:38.450 15:07:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.450 --rc genhtml_branch_coverage=1 00:06:38.450 --rc genhtml_function_coverage=1 00:06:38.450 --rc genhtml_legend=1 00:06:38.450 --rc geninfo_all_blocks=1 00:06:38.450 --rc geninfo_unexecuted_blocks=1 00:06:38.450 00:06:38.450 ' 00:06:38.450 15:07:36 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:38.450 15:07:36 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:38.450 15:07:36 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:38.450 15:07:36 -- nvmf/common.sh@7 -- # uname -s 00:06:38.450 15:07:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:38.450 15:07:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:38.450 15:07:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:38.450 15:07:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:38.450 15:07:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:38.450 15:07:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:38.450 15:07:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:38.450 15:07:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:38.450 15:07:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:38.450 15:07:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:38.450 15:07:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:38.450 15:07:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:38.450 15:07:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:38.450 15:07:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:38.450 15:07:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:38.450 15:07:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:38.450 15:07:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:38.450 15:07:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:38.450 15:07:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:38.450 15:07:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.450 15:07:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.450 15:07:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.451 15:07:36 -- paths/export.sh@5 -- # export PATH 00:06:38.451 15:07:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.451 15:07:36 -- nvmf/common.sh@46 -- # : 0 00:06:38.451 15:07:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:38.451 15:07:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:38.451 15:07:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:38.451 15:07:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:38.451 15:07:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:38.451 15:07:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:38.451 15:07:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:38.451 15:07:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:38.451 15:07:36 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:38.451 15:07:36 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:38.451 15:07:36 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:38.451 15:07:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:38.451 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.451 15:07:36 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:38.451 15:07:36 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:38.451 15:07:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:38.451 15:07:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.451 15:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:38.451 ************************************ 00:06:38.451 START TEST nvmf_example 00:06:38.451 ************************************ 00:06:38.451 15:07:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:38.451 * Looking for test storage... 00:06:38.451 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:38.451 15:07:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:38.451 15:07:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:38.451 15:07:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.710 15:07:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.710 15:07:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.710 15:07:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.710 15:07:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.710 15:07:37 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.710 15:07:37 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.710 15:07:37 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.710 15:07:37 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.710 15:07:37 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.710 15:07:37 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.710 15:07:37 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.710 15:07:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.710 15:07:37 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.710 15:07:37 -- scripts/common.sh@344 -- # : 1 00:06:38.710 15:07:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.710 15:07:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.710 15:07:37 -- scripts/common.sh@364 -- # decimal 1 00:06:38.710 15:07:37 -- scripts/common.sh@352 -- # local d=1 00:06:38.710 15:07:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.710 15:07:37 -- scripts/common.sh@354 -- # echo 1 00:06:38.710 15:07:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.710 15:07:37 -- scripts/common.sh@365 -- # decimal 2 00:06:38.710 15:07:37 -- scripts/common.sh@352 -- # local d=2 00:06:38.710 15:07:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.710 15:07:37 -- scripts/common.sh@354 -- # echo 2 00:06:38.710 15:07:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.710 15:07:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.710 15:07:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.710 15:07:37 -- scripts/common.sh@367 -- # return 0 00:06:38.710 15:07:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.710 15:07:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.710 --rc genhtml_branch_coverage=1 00:06:38.710 --rc genhtml_function_coverage=1 00:06:38.710 --rc genhtml_legend=1 00:06:38.710 --rc geninfo_all_blocks=1 00:06:38.710 --rc geninfo_unexecuted_blocks=1 00:06:38.710 00:06:38.710 ' 00:06:38.710 15:07:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.710 --rc genhtml_branch_coverage=1 00:06:38.710 --rc genhtml_function_coverage=1 00:06:38.710 --rc genhtml_legend=1 00:06:38.710 --rc geninfo_all_blocks=1 00:06:38.710 --rc geninfo_unexecuted_blocks=1 00:06:38.710 00:06:38.710 ' 00:06:38.710 15:07:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.710 --rc genhtml_branch_coverage=1 00:06:38.710 --rc genhtml_function_coverage=1 00:06:38.710 --rc genhtml_legend=1 00:06:38.710 --rc geninfo_all_blocks=1 00:06:38.710 --rc geninfo_unexecuted_blocks=1 00:06:38.710 00:06:38.710 ' 00:06:38.710 15:07:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.710 --rc genhtml_branch_coverage=1 00:06:38.710 --rc genhtml_function_coverage=1 00:06:38.710 --rc genhtml_legend=1 00:06:38.710 --rc geninfo_all_blocks=1 00:06:38.710 --rc geninfo_unexecuted_blocks=1 00:06:38.710 00:06:38.710 ' 00:06:38.710 15:07:37 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:38.710 15:07:37 -- nvmf/common.sh@7 -- # uname -s 00:06:38.710 15:07:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:38.710 15:07:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:38.710 15:07:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:38.710 15:07:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:38.710 15:07:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:38.710 15:07:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:38.710 15:07:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:38.710 15:07:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:38.710 15:07:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:38.710 15:07:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:38.710 15:07:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:38.710 15:07:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:38.710 15:07:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:38.710 15:07:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:38.710 15:07:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:38.710 15:07:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:38.710 15:07:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:38.710 15:07:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:38.710 15:07:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:38.710 15:07:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.710 15:07:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.710 15:07:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.710 15:07:37 -- paths/export.sh@5 -- # export PATH 00:06:38.710 15:07:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:38.710 15:07:37 -- nvmf/common.sh@46 -- # : 0 00:06:38.710 15:07:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:38.710 15:07:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:38.710 15:07:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:38.710 15:07:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:38.711 15:07:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:38.711 15:07:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:38.711 15:07:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:38.711 15:07:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:38.711 15:07:37 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:38.711 15:07:37 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:38.711 15:07:37 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:38.711 15:07:37 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:38.711 15:07:37 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:38.711 15:07:37 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:38.711 15:07:37 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:38.711 15:07:37 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:38.711 15:07:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:38.711 15:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:38.711 15:07:37 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:38.711 15:07:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:38.711 15:07:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:38.711 15:07:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:38.711 15:07:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:38.711 15:07:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:38.711 15:07:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:38.711 15:07:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:38.711 15:07:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:38.711 15:07:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:38.711 15:07:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:38.711 15:07:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:38.711 15:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:40.615 15:07:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:40.615 15:07:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:40.615 15:07:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:40.615 15:07:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:40.615 15:07:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:40.615 15:07:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:40.615 15:07:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:40.615 15:07:39 -- nvmf/common.sh@294 -- # net_devs=() 00:06:40.615 15:07:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:40.615 15:07:39 -- nvmf/common.sh@295 -- # e810=() 00:06:40.615 15:07:39 -- nvmf/common.sh@295 -- # local -ga e810 00:06:40.615 15:07:39 -- nvmf/common.sh@296 -- # x722=() 00:06:40.615 15:07:39 -- nvmf/common.sh@296 -- # local -ga x722 00:06:40.615 15:07:39 -- nvmf/common.sh@297 -- # mlx=() 00:06:40.615 15:07:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:40.615 15:07:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:40.615 15:07:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:40.615 15:07:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:40.615 15:07:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:40.615 15:07:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:40.615 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:40.615 15:07:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:40.615 15:07:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:40.615 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:40.615 15:07:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:40.615 15:07:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:40.615 15:07:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:40.615 15:07:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:40.615 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:40.615 15:07:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:40.615 15:07:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:40.615 15:07:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:40.615 15:07:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:40.615 15:07:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:40.615 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:40.615 15:07:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:40.615 15:07:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:40.615 15:07:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:40.615 15:07:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:40.615 15:07:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:40.615 15:07:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:40.615 15:07:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:40.615 15:07:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:40.615 15:07:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:40.615 15:07:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:40.615 15:07:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:40.615 15:07:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:40.615 15:07:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:40.615 15:07:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:40.615 15:07:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:40.615 15:07:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:40.615 15:07:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:40.874 15:07:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:40.874 15:07:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:40.874 15:07:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:40.874 15:07:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:40.874 15:07:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:40.874 15:07:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:40.874 15:07:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:40.874 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:40.874 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:06:40.874 00:06:40.874 --- 10.0.0.2 ping statistics --- 00:06:40.874 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:40.874 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:06:40.874 15:07:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:40.874 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:40.874 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:06:40.874 00:06:40.874 --- 10.0.0.1 ping statistics --- 00:06:40.874 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:40.874 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:06:40.874 15:07:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:40.874 15:07:39 -- nvmf/common.sh@410 -- # return 0 00:06:40.874 15:07:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:40.874 15:07:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:40.874 15:07:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:40.874 15:07:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:40.874 15:07:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:40.874 15:07:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:40.874 15:07:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:40.874 15:07:39 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:40.874 15:07:39 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:40.874 15:07:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.874 15:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:40.874 15:07:39 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:40.874 15:07:39 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:40.874 15:07:39 -- target/nvmf_example.sh@34 -- # nvmfpid=2662201 00:06:40.874 15:07:39 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:40.874 15:07:39 -- target/nvmf_example.sh@36 -- # waitforlisten 2662201 00:06:40.874 15:07:39 -- common/autotest_common.sh@829 -- # '[' -z 2662201 ']' 00:06:40.874 15:07:39 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:40.874 15:07:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:40.874 15:07:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.874 15:07:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:40.874 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:40.874 15:07:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.874 15:07:39 -- common/autotest_common.sh@10 -- # set +x 00:06:40.874 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.249 15:07:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.249 15:07:40 -- common/autotest_common.sh@862 -- # return 0 00:06:42.249 15:07:40 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:42.249 15:07:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:42.249 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.249 15:07:40 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:42.249 15:07:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.249 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.249 15:07:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.249 15:07:40 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:42.249 15:07:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.249 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.249 15:07:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.249 15:07:40 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:42.249 15:07:40 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:42.250 15:07:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.250 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.250 15:07:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.250 15:07:40 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:42.250 15:07:40 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:42.250 15:07:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.250 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.250 15:07:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.250 15:07:40 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:42.250 15:07:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.250 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:42.250 15:07:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.250 15:07:40 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:42.250 15:07:40 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:42.250 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.229 Initializing NVMe Controllers 00:06:52.229 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:52.229 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:52.229 Initialization complete. Launching workers. 00:06:52.229 ======================================================== 00:06:52.229 Latency(us) 00:06:52.229 Device Information : IOPS MiB/s Average min max 00:06:52.229 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15567.19 60.81 4111.05 772.05 16319.38 00:06:52.229 ======================================================== 00:06:52.229 Total : 15567.19 60.81 4111.05 772.05 16319.38 00:06:52.229 00:06:52.229 15:07:50 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:52.229 15:07:50 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:52.229 15:07:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:52.229 15:07:50 -- nvmf/common.sh@116 -- # sync 00:06:52.229 15:07:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:52.229 15:07:50 -- nvmf/common.sh@119 -- # set +e 00:06:52.229 15:07:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:52.229 15:07:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:52.229 rmmod nvme_tcp 00:06:52.229 rmmod nvme_fabrics 00:06:52.229 rmmod nvme_keyring 00:06:52.229 15:07:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:52.229 15:07:50 -- nvmf/common.sh@123 -- # set -e 00:06:52.229 15:07:50 -- nvmf/common.sh@124 -- # return 0 00:06:52.229 15:07:50 -- nvmf/common.sh@477 -- # '[' -n 2662201 ']' 00:06:52.229 15:07:50 -- nvmf/common.sh@478 -- # killprocess 2662201 00:06:52.229 15:07:50 -- common/autotest_common.sh@936 -- # '[' -z 2662201 ']' 00:06:52.229 15:07:50 -- common/autotest_common.sh@940 -- # kill -0 2662201 00:06:52.229 15:07:50 -- common/autotest_common.sh@941 -- # uname 00:06:52.229 15:07:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:52.230 15:07:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2662201 00:06:52.230 15:07:50 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:52.230 15:07:50 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:52.230 15:07:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2662201' 00:06:52.230 killing process with pid 2662201 00:06:52.230 15:07:50 -- common/autotest_common.sh@955 -- # kill 2662201 00:06:52.230 15:07:50 -- common/autotest_common.sh@960 -- # wait 2662201 00:06:52.489 nvmf threads initialize successfully 00:06:52.489 bdev subsystem init successfully 00:06:52.489 created a nvmf target service 00:06:52.489 create targets's poll groups done 00:06:52.489 all subsystems of target started 00:06:52.489 nvmf target is running 00:06:52.489 all subsystems of target stopped 00:06:52.489 destroy targets's poll groups done 00:06:52.489 destroyed the nvmf target service 00:06:52.489 bdev subsystem finish successfully 00:06:52.489 nvmf threads destroy successfully 00:06:52.489 15:07:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:52.489 15:07:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:52.489 15:07:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:52.489 15:07:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:52.489 15:07:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:52.489 15:07:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:52.489 15:07:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:52.489 15:07:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:55.035 15:07:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:55.035 15:07:53 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:55.035 15:07:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:55.035 15:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:55.035 00:06:55.035 real 0m16.150s 00:06:55.035 user 0m45.564s 00:06:55.035 sys 0m3.341s 00:06:55.035 15:07:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.035 15:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:55.035 ************************************ 00:06:55.035 END TEST nvmf_example 00:06:55.035 ************************************ 00:06:55.035 15:07:53 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:55.035 15:07:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.035 15:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:55.035 ************************************ 00:06:55.035 START TEST nvmf_filesystem 00:06:55.035 ************************************ 00:06:55.035 15:07:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:55.035 * Looking for test storage... 00:06:55.035 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.035 15:07:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:55.035 15:07:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:55.035 15:07:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:55.035 15:07:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:55.035 15:07:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:55.035 15:07:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:55.035 15:07:53 -- scripts/common.sh@335 -- # IFS=.-: 00:06:55.035 15:07:53 -- scripts/common.sh@335 -- # read -ra ver1 00:06:55.035 15:07:53 -- scripts/common.sh@336 -- # IFS=.-: 00:06:55.035 15:07:53 -- scripts/common.sh@336 -- # read -ra ver2 00:06:55.035 15:07:53 -- scripts/common.sh@337 -- # local 'op=<' 00:06:55.035 15:07:53 -- scripts/common.sh@339 -- # ver1_l=2 00:06:55.035 15:07:53 -- scripts/common.sh@340 -- # ver2_l=1 00:06:55.035 15:07:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:55.035 15:07:53 -- scripts/common.sh@343 -- # case "$op" in 00:06:55.035 15:07:53 -- scripts/common.sh@344 -- # : 1 00:06:55.035 15:07:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:55.035 15:07:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:55.035 15:07:53 -- scripts/common.sh@364 -- # decimal 1 00:06:55.035 15:07:53 -- scripts/common.sh@352 -- # local d=1 00:06:55.035 15:07:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:55.035 15:07:53 -- scripts/common.sh@354 -- # echo 1 00:06:55.035 15:07:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:55.035 15:07:53 -- scripts/common.sh@365 -- # decimal 2 00:06:55.035 15:07:53 -- scripts/common.sh@352 -- # local d=2 00:06:55.035 15:07:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:55.035 15:07:53 -- scripts/common.sh@354 -- # echo 2 00:06:55.035 15:07:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:55.035 15:07:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:55.035 15:07:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:55.035 15:07:53 -- scripts/common.sh@367 -- # return 0 00:06:55.035 15:07:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:55.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.035 --rc genhtml_branch_coverage=1 00:06:55.035 --rc genhtml_function_coverage=1 00:06:55.035 --rc genhtml_legend=1 00:06:55.035 --rc geninfo_all_blocks=1 00:06:55.035 --rc geninfo_unexecuted_blocks=1 00:06:55.035 00:06:55.035 ' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:55.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.035 --rc genhtml_branch_coverage=1 00:06:55.035 --rc genhtml_function_coverage=1 00:06:55.035 --rc genhtml_legend=1 00:06:55.035 --rc geninfo_all_blocks=1 00:06:55.035 --rc geninfo_unexecuted_blocks=1 00:06:55.035 00:06:55.035 ' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:55.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.035 --rc genhtml_branch_coverage=1 00:06:55.035 --rc genhtml_function_coverage=1 00:06:55.035 --rc genhtml_legend=1 00:06:55.035 --rc geninfo_all_blocks=1 00:06:55.035 --rc geninfo_unexecuted_blocks=1 00:06:55.035 00:06:55.035 ' 00:06:55.035 15:07:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:55.035 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.035 --rc genhtml_branch_coverage=1 00:06:55.035 --rc genhtml_function_coverage=1 00:06:55.035 --rc genhtml_legend=1 00:06:55.035 --rc geninfo_all_blocks=1 00:06:55.035 --rc geninfo_unexecuted_blocks=1 00:06:55.035 00:06:55.035 ' 00:06:55.035 15:07:53 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:55.035 15:07:53 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:55.035 15:07:53 -- common/autotest_common.sh@34 -- # set -e 00:06:55.035 15:07:53 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:55.035 15:07:53 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:55.035 15:07:53 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:55.036 15:07:53 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:55.036 15:07:53 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:55.036 15:07:53 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:55.036 15:07:53 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:55.036 15:07:53 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:55.036 15:07:53 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:55.036 15:07:53 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:55.036 15:07:53 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:55.036 15:07:53 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:55.036 15:07:53 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:55.036 15:07:53 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:55.036 15:07:53 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:55.036 15:07:53 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:55.036 15:07:53 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:55.036 15:07:53 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:55.036 15:07:53 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:55.036 15:07:53 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:55.036 15:07:53 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:55.036 15:07:53 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:55.036 15:07:53 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:55.036 15:07:53 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:55.036 15:07:53 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:55.036 15:07:53 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:55.036 15:07:53 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:55.036 15:07:53 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:55.036 15:07:53 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:55.036 15:07:53 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:55.036 15:07:53 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:55.036 15:07:53 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:55.036 15:07:53 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:55.036 15:07:53 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:55.036 15:07:53 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:55.036 15:07:53 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:55.036 15:07:53 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:55.036 15:07:53 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:55.036 15:07:53 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:55.036 15:07:53 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:55.036 15:07:53 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:55.036 15:07:53 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:55.036 15:07:53 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:55.036 15:07:53 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:55.036 15:07:53 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:55.036 15:07:53 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:55.036 15:07:53 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:55.036 15:07:53 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:55.036 15:07:53 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:55.036 15:07:53 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:55.036 15:07:53 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:55.036 15:07:53 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:55.036 15:07:53 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:55.036 15:07:53 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:55.036 15:07:53 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:55.036 15:07:53 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:55.036 15:07:53 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:55.036 15:07:53 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:55.036 15:07:53 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:55.036 15:07:53 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:55.036 15:07:53 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:55.036 15:07:53 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:55.036 15:07:53 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:55.036 15:07:53 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:55.036 15:07:53 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:55.036 15:07:53 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:55.036 15:07:53 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:55.036 15:07:53 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:55.036 15:07:53 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:55.036 15:07:53 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:55.036 15:07:53 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:55.036 15:07:53 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:55.036 15:07:53 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:55.036 15:07:53 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:55.036 15:07:53 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:55.036 15:07:53 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:55.036 15:07:53 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:55.036 15:07:53 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:55.036 15:07:53 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:55.036 15:07:53 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:55.036 15:07:53 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:55.036 15:07:53 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:55.036 15:07:53 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:55.036 15:07:53 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:55.036 15:07:53 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:55.036 15:07:53 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:55.036 15:07:53 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:55.036 15:07:53 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:55.036 15:07:53 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:55.036 15:07:53 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:55.036 15:07:53 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:55.036 15:07:53 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:55.036 15:07:53 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:55.036 #define SPDK_CONFIG_H 00:06:55.036 #define SPDK_CONFIG_APPS 1 00:06:55.036 #define SPDK_CONFIG_ARCH native 00:06:55.036 #undef SPDK_CONFIG_ASAN 00:06:55.036 #undef SPDK_CONFIG_AVAHI 00:06:55.036 #undef SPDK_CONFIG_CET 00:06:55.036 #define SPDK_CONFIG_COVERAGE 1 00:06:55.036 #define SPDK_CONFIG_CROSS_PREFIX 00:06:55.036 #undef SPDK_CONFIG_CRYPTO 00:06:55.036 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:55.036 #undef SPDK_CONFIG_CUSTOMOCF 00:06:55.036 #undef SPDK_CONFIG_DAOS 00:06:55.036 #define SPDK_CONFIG_DAOS_DIR 00:06:55.036 #define SPDK_CONFIG_DEBUG 1 00:06:55.036 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:55.036 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:55.036 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:55.036 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:55.036 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:55.036 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:55.036 #define SPDK_CONFIG_EXAMPLES 1 00:06:55.036 #undef SPDK_CONFIG_FC 00:06:55.036 #define SPDK_CONFIG_FC_PATH 00:06:55.036 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:55.036 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:55.036 #undef SPDK_CONFIG_FUSE 00:06:55.036 #undef SPDK_CONFIG_FUZZER 00:06:55.036 #define SPDK_CONFIG_FUZZER_LIB 00:06:55.036 #undef SPDK_CONFIG_GOLANG 00:06:55.036 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:55.036 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:55.036 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:55.036 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:55.036 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:55.036 #define SPDK_CONFIG_IDXD 1 00:06:55.036 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:55.036 #undef SPDK_CONFIG_IPSEC_MB 00:06:55.036 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:55.036 #define SPDK_CONFIG_ISAL 1 00:06:55.036 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:55.036 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:55.036 #define SPDK_CONFIG_LIBDIR 00:06:55.036 #undef SPDK_CONFIG_LTO 00:06:55.036 #define SPDK_CONFIG_MAX_LCORES 00:06:55.036 #define SPDK_CONFIG_NVME_CUSE 1 00:06:55.036 #undef SPDK_CONFIG_OCF 00:06:55.036 #define SPDK_CONFIG_OCF_PATH 00:06:55.036 #define SPDK_CONFIG_OPENSSL_PATH 00:06:55.036 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:55.036 #undef SPDK_CONFIG_PGO_USE 00:06:55.036 #define SPDK_CONFIG_PREFIX /usr/local 00:06:55.036 #undef SPDK_CONFIG_RAID5F 00:06:55.036 #undef SPDK_CONFIG_RBD 00:06:55.036 #define SPDK_CONFIG_RDMA 1 00:06:55.036 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:55.036 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:55.036 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:55.036 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:55.036 #define SPDK_CONFIG_SHARED 1 00:06:55.036 #undef SPDK_CONFIG_SMA 00:06:55.036 #define SPDK_CONFIG_TESTS 1 00:06:55.036 #undef SPDK_CONFIG_TSAN 00:06:55.036 #define SPDK_CONFIG_UBLK 1 00:06:55.036 #define SPDK_CONFIG_UBSAN 1 00:06:55.036 #undef SPDK_CONFIG_UNIT_TESTS 00:06:55.036 #undef SPDK_CONFIG_URING 00:06:55.036 #define SPDK_CONFIG_URING_PATH 00:06:55.036 #undef SPDK_CONFIG_URING_ZNS 00:06:55.036 #undef SPDK_CONFIG_USDT 00:06:55.036 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:55.037 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:55.037 #undef SPDK_CONFIG_VFIO_USER 00:06:55.037 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:55.037 #define SPDK_CONFIG_VHOST 1 00:06:55.037 #define SPDK_CONFIG_VIRTIO 1 00:06:55.037 #undef SPDK_CONFIG_VTUNE 00:06:55.037 #define SPDK_CONFIG_VTUNE_DIR 00:06:55.037 #define SPDK_CONFIG_WERROR 1 00:06:55.037 #define SPDK_CONFIG_WPDK_DIR 00:06:55.037 #undef SPDK_CONFIG_XNVME 00:06:55.037 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:55.037 15:07:53 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:55.037 15:07:53 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:55.037 15:07:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:55.037 15:07:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:55.037 15:07:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:55.037 15:07:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.037 15:07:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.037 15:07:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.037 15:07:53 -- paths/export.sh@5 -- # export PATH 00:06:55.037 15:07:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.037 15:07:53 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:55.037 15:07:53 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:55.037 15:07:53 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:55.037 15:07:53 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:55.037 15:07:53 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:55.037 15:07:53 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:55.037 15:07:53 -- pm/common@16 -- # TEST_TAG=N/A 00:06:55.037 15:07:53 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:55.037 15:07:53 -- common/autotest_common.sh@52 -- # : 1 00:06:55.037 15:07:53 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:55.037 15:07:53 -- common/autotest_common.sh@56 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:55.037 15:07:53 -- common/autotest_common.sh@58 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:55.037 15:07:53 -- common/autotest_common.sh@60 -- # : 1 00:06:55.037 15:07:53 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:55.037 15:07:53 -- common/autotest_common.sh@62 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:55.037 15:07:53 -- common/autotest_common.sh@64 -- # : 00:06:55.037 15:07:53 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:55.037 15:07:53 -- common/autotest_common.sh@66 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:55.037 15:07:53 -- common/autotest_common.sh@68 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:55.037 15:07:53 -- common/autotest_common.sh@70 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:55.037 15:07:53 -- common/autotest_common.sh@72 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:55.037 15:07:53 -- common/autotest_common.sh@74 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:55.037 15:07:53 -- common/autotest_common.sh@76 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:55.037 15:07:53 -- common/autotest_common.sh@78 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:55.037 15:07:53 -- common/autotest_common.sh@80 -- # : 1 00:06:55.037 15:07:53 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:55.037 15:07:53 -- common/autotest_common.sh@82 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:55.037 15:07:53 -- common/autotest_common.sh@84 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:55.037 15:07:53 -- common/autotest_common.sh@86 -- # : 1 00:06:55.037 15:07:53 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:55.037 15:07:53 -- common/autotest_common.sh@88 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:55.037 15:07:53 -- common/autotest_common.sh@90 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:55.037 15:07:53 -- common/autotest_common.sh@92 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:55.037 15:07:53 -- common/autotest_common.sh@94 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:55.037 15:07:53 -- common/autotest_common.sh@96 -- # : tcp 00:06:55.037 15:07:53 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:55.037 15:07:53 -- common/autotest_common.sh@98 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:55.037 15:07:53 -- common/autotest_common.sh@100 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:55.037 15:07:53 -- common/autotest_common.sh@102 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:55.037 15:07:53 -- common/autotest_common.sh@104 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:55.037 15:07:53 -- common/autotest_common.sh@106 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:55.037 15:07:53 -- common/autotest_common.sh@108 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:55.037 15:07:53 -- common/autotest_common.sh@110 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:55.037 15:07:53 -- common/autotest_common.sh@112 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:55.037 15:07:53 -- common/autotest_common.sh@114 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:55.037 15:07:53 -- common/autotest_common.sh@116 -- # : 1 00:06:55.037 15:07:53 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:55.037 15:07:53 -- common/autotest_common.sh@118 -- # : 00:06:55.037 15:07:53 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:55.037 15:07:53 -- common/autotest_common.sh@120 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:55.037 15:07:53 -- common/autotest_common.sh@122 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:55.037 15:07:53 -- common/autotest_common.sh@124 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:55.037 15:07:53 -- common/autotest_common.sh@126 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:55.037 15:07:53 -- common/autotest_common.sh@128 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:55.037 15:07:53 -- common/autotest_common.sh@130 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:55.037 15:07:53 -- common/autotest_common.sh@132 -- # : 00:06:55.037 15:07:53 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:55.037 15:07:53 -- common/autotest_common.sh@134 -- # : true 00:06:55.037 15:07:53 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:55.037 15:07:53 -- common/autotest_common.sh@136 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:55.037 15:07:53 -- common/autotest_common.sh@138 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:55.037 15:07:53 -- common/autotest_common.sh@140 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:55.037 15:07:53 -- common/autotest_common.sh@142 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:55.037 15:07:53 -- common/autotest_common.sh@144 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:55.037 15:07:53 -- common/autotest_common.sh@146 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:55.037 15:07:53 -- common/autotest_common.sh@148 -- # : e810 00:06:55.037 15:07:53 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:55.037 15:07:53 -- common/autotest_common.sh@150 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:55.037 15:07:53 -- common/autotest_common.sh@152 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:55.037 15:07:53 -- common/autotest_common.sh@154 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:55.037 15:07:53 -- common/autotest_common.sh@156 -- # : 0 00:06:55.037 15:07:53 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:55.037 15:07:53 -- common/autotest_common.sh@158 -- # : 0 00:06:55.038 15:07:53 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:55.038 15:07:53 -- common/autotest_common.sh@160 -- # : 0 00:06:55.038 15:07:53 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:55.038 15:07:53 -- common/autotest_common.sh@163 -- # : 00:06:55.038 15:07:53 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:55.038 15:07:53 -- common/autotest_common.sh@165 -- # : 0 00:06:55.038 15:07:53 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:55.038 15:07:53 -- common/autotest_common.sh@167 -- # : 0 00:06:55.038 15:07:53 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:55.038 15:07:53 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:55.038 15:07:53 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:55.038 15:07:53 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:55.038 15:07:53 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:55.038 15:07:53 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:55.038 15:07:53 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:55.038 15:07:53 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:55.038 15:07:53 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:55.038 15:07:53 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:55.038 15:07:53 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:55.038 15:07:53 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:55.038 15:07:53 -- common/autotest_common.sh@196 -- # cat 00:06:55.038 15:07:53 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:55.038 15:07:53 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:55.038 15:07:53 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:55.038 15:07:53 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:55.038 15:07:53 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:55.038 15:07:53 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:55.038 15:07:53 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:55.038 15:07:53 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:55.038 15:07:53 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:55.038 15:07:53 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:55.038 15:07:53 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:55.038 15:07:53 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:55.038 15:07:53 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:55.038 15:07:53 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:55.038 15:07:53 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:55.038 15:07:53 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:55.038 15:07:53 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:55.038 15:07:53 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:55.038 15:07:53 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:55.038 15:07:53 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:55.038 15:07:53 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:55.038 15:07:53 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:55.038 15:07:53 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:55.038 15:07:53 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:55.038 15:07:53 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:55.038 15:07:53 -- common/autotest_common.sh@259 -- # valgrind= 00:06:55.038 15:07:53 -- common/autotest_common.sh@265 -- # uname -s 00:06:55.038 15:07:53 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:55.038 15:07:53 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:55.038 15:07:53 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:55.038 15:07:53 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:55.038 15:07:53 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:55.038 15:07:53 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:55.038 15:07:53 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:55.038 15:07:53 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:55.038 15:07:53 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:55.038 15:07:53 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:55.038 15:07:53 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:55.038 15:07:53 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:55.038 15:07:53 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:55.038 15:07:53 -- common/autotest_common.sh@319 -- # [[ -z 2663956 ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@319 -- # kill -0 2663956 00:06:55.038 15:07:53 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:55.038 15:07:53 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:55.038 15:07:53 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:55.038 15:07:53 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:55.038 15:07:53 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:55.038 15:07:53 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:55.038 15:07:53 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:55.038 15:07:53 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.QfGJKL 00:06:55.038 15:07:53 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:55.038 15:07:53 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:55.038 15:07:53 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.QfGJKL/tests/target /tmp/spdk.QfGJKL 00:06:55.038 15:07:53 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:55.038 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.038 15:07:53 -- common/autotest_common.sh@328 -- # df -T 00:06:55.038 15:07:53 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:55.038 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:55.038 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:55.038 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:55.038 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:55.038 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:55.038 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.038 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:55.038 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:55.038 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:55.038 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:55.038 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=55277281280 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:06:55.039 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=6711238656 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991667200 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:55.039 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:55.039 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993854464 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:55.039 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=405504 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:55.039 15:07:53 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:55.039 15:07:53 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:55.039 15:07:53 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:55.039 15:07:53 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:55.039 * Looking for test storage... 00:06:55.039 15:07:53 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:55.039 15:07:53 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:55.039 15:07:53 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.039 15:07:53 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:55.039 15:07:53 -- common/autotest_common.sh@373 -- # mount=/ 00:06:55.039 15:07:53 -- common/autotest_common.sh@375 -- # target_space=55277281280 00:06:55.039 15:07:53 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:55.039 15:07:53 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:55.039 15:07:53 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@382 -- # new_size=8925831168 00:06:55.039 15:07:53 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:55.039 15:07:53 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.039 15:07:53 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.039 15:07:53 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.039 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:55.039 15:07:53 -- common/autotest_common.sh@390 -- # return 0 00:06:55.039 15:07:53 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:55.039 15:07:53 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:55.039 15:07:53 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:55.039 15:07:53 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1682 -- # true 00:06:55.039 15:07:53 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:55.039 15:07:53 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@27 -- # exec 00:06:55.039 15:07:53 -- common/autotest_common.sh@29 -- # exec 00:06:55.039 15:07:53 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:55.039 15:07:53 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:55.039 15:07:53 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:55.039 15:07:53 -- common/autotest_common.sh@18 -- # set -x 00:06:55.039 15:07:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:55.039 15:07:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:55.039 15:07:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:55.039 15:07:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:55.039 15:07:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:55.039 15:07:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:55.039 15:07:53 -- scripts/common.sh@335 -- # IFS=.-: 00:06:55.039 15:07:53 -- scripts/common.sh@335 -- # read -ra ver1 00:06:55.039 15:07:53 -- scripts/common.sh@336 -- # IFS=.-: 00:06:55.039 15:07:53 -- scripts/common.sh@336 -- # read -ra ver2 00:06:55.039 15:07:53 -- scripts/common.sh@337 -- # local 'op=<' 00:06:55.039 15:07:53 -- scripts/common.sh@339 -- # ver1_l=2 00:06:55.039 15:07:53 -- scripts/common.sh@340 -- # ver2_l=1 00:06:55.039 15:07:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:55.039 15:07:53 -- scripts/common.sh@343 -- # case "$op" in 00:06:55.039 15:07:53 -- scripts/common.sh@344 -- # : 1 00:06:55.039 15:07:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:55.039 15:07:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:55.039 15:07:53 -- scripts/common.sh@364 -- # decimal 1 00:06:55.039 15:07:53 -- scripts/common.sh@352 -- # local d=1 00:06:55.039 15:07:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:55.039 15:07:53 -- scripts/common.sh@354 -- # echo 1 00:06:55.039 15:07:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:55.039 15:07:53 -- scripts/common.sh@365 -- # decimal 2 00:06:55.039 15:07:53 -- scripts/common.sh@352 -- # local d=2 00:06:55.039 15:07:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:55.039 15:07:53 -- scripts/common.sh@354 -- # echo 2 00:06:55.039 15:07:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:55.039 15:07:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:55.039 15:07:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:55.039 15:07:53 -- scripts/common.sh@367 -- # return 0 00:06:55.039 15:07:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:55.039 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.039 --rc genhtml_branch_coverage=1 00:06:55.039 --rc genhtml_function_coverage=1 00:06:55.039 --rc genhtml_legend=1 00:06:55.039 --rc geninfo_all_blocks=1 00:06:55.039 --rc geninfo_unexecuted_blocks=1 00:06:55.039 00:06:55.039 ' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:55.039 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.039 --rc genhtml_branch_coverage=1 00:06:55.039 --rc genhtml_function_coverage=1 00:06:55.039 --rc genhtml_legend=1 00:06:55.039 --rc geninfo_all_blocks=1 00:06:55.039 --rc geninfo_unexecuted_blocks=1 00:06:55.039 00:06:55.039 ' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:55.039 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.039 --rc genhtml_branch_coverage=1 00:06:55.039 --rc genhtml_function_coverage=1 00:06:55.039 --rc genhtml_legend=1 00:06:55.039 --rc geninfo_all_blocks=1 00:06:55.039 --rc geninfo_unexecuted_blocks=1 00:06:55.039 00:06:55.039 ' 00:06:55.039 15:07:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:55.039 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:55.039 --rc genhtml_branch_coverage=1 00:06:55.039 --rc genhtml_function_coverage=1 00:06:55.039 --rc genhtml_legend=1 00:06:55.039 --rc geninfo_all_blocks=1 00:06:55.039 --rc geninfo_unexecuted_blocks=1 00:06:55.039 00:06:55.039 ' 00:06:55.039 15:07:53 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:55.039 15:07:53 -- nvmf/common.sh@7 -- # uname -s 00:06:55.039 15:07:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:55.039 15:07:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:55.039 15:07:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:55.039 15:07:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:55.039 15:07:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:55.039 15:07:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:55.039 15:07:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:55.039 15:07:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:55.039 15:07:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:55.039 15:07:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:55.039 15:07:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:55.039 15:07:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:55.039 15:07:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:55.039 15:07:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:55.039 15:07:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:55.039 15:07:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:55.039 15:07:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:55.039 15:07:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:55.039 15:07:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:55.040 15:07:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.040 15:07:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.040 15:07:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.040 15:07:53 -- paths/export.sh@5 -- # export PATH 00:06:55.040 15:07:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:55.040 15:07:53 -- nvmf/common.sh@46 -- # : 0 00:06:55.040 15:07:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:55.040 15:07:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:55.040 15:07:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:55.040 15:07:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:55.040 15:07:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:55.040 15:07:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:55.040 15:07:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:55.040 15:07:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:55.040 15:07:53 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:55.040 15:07:53 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:55.040 15:07:53 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:55.040 15:07:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:55.040 15:07:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:55.040 15:07:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:55.040 15:07:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:55.040 15:07:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:55.040 15:07:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:55.040 15:07:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:55.040 15:07:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:55.040 15:07:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:55.040 15:07:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:55.040 15:07:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:55.040 15:07:53 -- common/autotest_common.sh@10 -- # set +x 00:06:57.110 15:07:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:57.110 15:07:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:57.110 15:07:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:57.110 15:07:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:57.110 15:07:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:57.110 15:07:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:57.110 15:07:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:57.110 15:07:55 -- nvmf/common.sh@294 -- # net_devs=() 00:06:57.110 15:07:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:57.110 15:07:55 -- nvmf/common.sh@295 -- # e810=() 00:06:57.110 15:07:55 -- nvmf/common.sh@295 -- # local -ga e810 00:06:57.110 15:07:55 -- nvmf/common.sh@296 -- # x722=() 00:06:57.110 15:07:55 -- nvmf/common.sh@296 -- # local -ga x722 00:06:57.110 15:07:55 -- nvmf/common.sh@297 -- # mlx=() 00:06:57.110 15:07:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:57.110 15:07:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:57.110 15:07:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:57.111 15:07:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:57.111 15:07:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:57.111 15:07:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:57.111 15:07:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:57.111 15:07:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:57.111 15:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:57.111 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:57.111 15:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:57.111 15:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:57.111 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:57.111 15:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:57.111 15:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:57.111 15:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:57.111 15:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:57.111 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:57.111 15:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:57.111 15:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:57.111 15:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:57.111 15:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:57.111 15:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:57.111 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:57.111 15:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:57.111 15:07:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:57.111 15:07:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:57.111 15:07:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:57.111 15:07:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:57.111 15:07:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:57.111 15:07:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:57.111 15:07:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:57.111 15:07:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:57.111 15:07:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:57.111 15:07:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:57.111 15:07:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:57.111 15:07:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:57.111 15:07:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:57.111 15:07:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:57.111 15:07:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:57.111 15:07:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:57.370 15:07:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:57.370 15:07:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:57.370 15:07:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:57.370 15:07:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:57.370 15:07:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:57.370 15:07:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:57.370 15:07:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:57.370 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:57.370 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:06:57.370 00:06:57.370 --- 10.0.0.2 ping statistics --- 00:06:57.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:57.370 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:06:57.370 15:07:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:57.370 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:57.370 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:06:57.370 00:06:57.370 --- 10.0.0.1 ping statistics --- 00:06:57.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:57.371 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:06:57.371 15:07:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:57.371 15:07:55 -- nvmf/common.sh@410 -- # return 0 00:06:57.371 15:07:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:57.371 15:07:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:57.371 15:07:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:57.371 15:07:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:57.371 15:07:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:57.371 15:07:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:57.371 15:07:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:57.371 15:07:55 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:57.371 15:07:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:57.371 15:07:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.371 15:07:55 -- common/autotest_common.sh@10 -- # set +x 00:06:57.371 ************************************ 00:06:57.371 START TEST nvmf_filesystem_no_in_capsule 00:06:57.371 ************************************ 00:06:57.371 15:07:55 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:57.371 15:07:55 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:57.371 15:07:55 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:57.371 15:07:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:57.371 15:07:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:57.371 15:07:55 -- common/autotest_common.sh@10 -- # set +x 00:06:57.371 15:07:55 -- nvmf/common.sh@469 -- # nvmfpid=2665627 00:06:57.371 15:07:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:57.371 15:07:55 -- nvmf/common.sh@470 -- # waitforlisten 2665627 00:06:57.371 15:07:55 -- common/autotest_common.sh@829 -- # '[' -z 2665627 ']' 00:06:57.371 15:07:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:57.371 15:07:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:57.371 15:07:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:57.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:57.371 15:07:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:57.371 15:07:55 -- common/autotest_common.sh@10 -- # set +x 00:06:57.371 [2024-11-19 15:07:55.837128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.371 [2024-11-19 15:07:55.837202] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:57.371 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.371 [2024-11-19 15:07:55.908389] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:57.630 [2024-11-19 15:07:56.029569] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:57.630 [2024-11-19 15:07:56.029736] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:57.630 [2024-11-19 15:07:56.029758] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:57.630 [2024-11-19 15:07:56.029772] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:57.630 [2024-11-19 15:07:56.029830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:57.630 [2024-11-19 15:07:56.029892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:57.630 [2024-11-19 15:07:56.030003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:57.630 [2024-11-19 15:07:56.030007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.565 15:07:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:58.565 15:07:56 -- common/autotest_common.sh@862 -- # return 0 00:06:58.565 15:07:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:58.565 15:07:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 15:07:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:58.565 15:07:56 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:58.565 15:07:56 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:58.565 15:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 [2024-11-19 15:07:56.818249] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:58.565 15:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:56 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:58.565 15:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 Malloc1 00:06:58.565 15:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:56 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:58.565 15:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 15:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:56 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:58.565 15:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 15:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:56 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:58.565 15:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 [2024-11-19 15:07:57.004657] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:58.565 15:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:57 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:58.565 15:07:57 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:58.565 15:07:57 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:58.565 15:07:57 -- common/autotest_common.sh@1369 -- # local bs 00:06:58.565 15:07:57 -- common/autotest_common.sh@1370 -- # local nb 00:06:58.565 15:07:57 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:58.565 15:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.565 15:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:58.565 15:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.565 15:07:57 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:58.565 { 00:06:58.565 "name": "Malloc1", 00:06:58.565 "aliases": [ 00:06:58.565 "8b5b22d7-61f3-4c4e-92ac-2758c8b94f3e" 00:06:58.565 ], 00:06:58.565 "product_name": "Malloc disk", 00:06:58.565 "block_size": 512, 00:06:58.565 "num_blocks": 1048576, 00:06:58.565 "uuid": "8b5b22d7-61f3-4c4e-92ac-2758c8b94f3e", 00:06:58.565 "assigned_rate_limits": { 00:06:58.565 "rw_ios_per_sec": 0, 00:06:58.565 "rw_mbytes_per_sec": 0, 00:06:58.565 "r_mbytes_per_sec": 0, 00:06:58.565 "w_mbytes_per_sec": 0 00:06:58.565 }, 00:06:58.565 "claimed": true, 00:06:58.565 "claim_type": "exclusive_write", 00:06:58.565 "zoned": false, 00:06:58.565 "supported_io_types": { 00:06:58.565 "read": true, 00:06:58.565 "write": true, 00:06:58.566 "unmap": true, 00:06:58.566 "write_zeroes": true, 00:06:58.566 "flush": true, 00:06:58.566 "reset": true, 00:06:58.566 "compare": false, 00:06:58.566 "compare_and_write": false, 00:06:58.566 "abort": true, 00:06:58.566 "nvme_admin": false, 00:06:58.566 "nvme_io": false 00:06:58.566 }, 00:06:58.566 "memory_domains": [ 00:06:58.566 { 00:06:58.566 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:58.566 "dma_device_type": 2 00:06:58.566 } 00:06:58.566 ], 00:06:58.566 "driver_specific": {} 00:06:58.566 } 00:06:58.566 ]' 00:06:58.566 15:07:57 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:58.566 15:07:57 -- common/autotest_common.sh@1372 -- # bs=512 00:06:58.566 15:07:57 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:58.566 15:07:57 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:58.566 15:07:57 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:58.566 15:07:57 -- common/autotest_common.sh@1377 -- # echo 512 00:06:58.566 15:07:57 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:58.566 15:07:57 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:59.500 15:07:57 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:59.500 15:07:57 -- common/autotest_common.sh@1187 -- # local i=0 00:06:59.500 15:07:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:59.500 15:07:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:59.500 15:07:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:01.397 15:07:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:01.397 15:07:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:01.397 15:07:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:01.397 15:07:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:01.397 15:07:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:01.397 15:07:59 -- common/autotest_common.sh@1197 -- # return 0 00:07:01.397 15:07:59 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:01.397 15:07:59 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:01.397 15:07:59 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:01.397 15:07:59 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:01.397 15:07:59 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:01.397 15:07:59 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:01.397 15:07:59 -- setup/common.sh@80 -- # echo 536870912 00:07:01.397 15:07:59 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:01.397 15:07:59 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:01.397 15:07:59 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:01.397 15:07:59 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:01.397 15:07:59 -- target/filesystem.sh@69 -- # partprobe 00:07:02.332 15:08:00 -- target/filesystem.sh@70 -- # sleep 1 00:07:03.266 15:08:01 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:03.266 15:08:01 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:03.266 15:08:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:03.266 15:08:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.266 15:08:01 -- common/autotest_common.sh@10 -- # set +x 00:07:03.524 ************************************ 00:07:03.524 START TEST filesystem_ext4 00:07:03.524 ************************************ 00:07:03.524 15:08:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:03.524 15:08:01 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:03.524 15:08:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.524 15:08:01 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:03.524 15:08:01 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:03.524 15:08:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:03.524 15:08:01 -- common/autotest_common.sh@914 -- # local i=0 00:07:03.524 15:08:01 -- common/autotest_common.sh@915 -- # local force 00:07:03.524 15:08:01 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:03.524 15:08:01 -- common/autotest_common.sh@918 -- # force=-F 00:07:03.524 15:08:01 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:03.524 mke2fs 1.47.0 (5-Feb-2023) 00:07:03.524 Discarding device blocks: 0/522240 done 00:07:03.524 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:03.524 Filesystem UUID: 3d3db01e-3287-4600-b0b8-5b045616f281 00:07:03.524 Superblock backups stored on blocks: 00:07:03.524 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:03.524 00:07:03.524 Allocating group tables: 0/64 done 00:07:03.524 Writing inode tables: 0/64 done 00:07:03.524 Creating journal (8192 blocks): done 00:07:03.782 Writing superblocks and filesystem accounting information: 0/64 done 00:07:03.782 00:07:03.782 15:08:02 -- common/autotest_common.sh@931 -- # return 0 00:07:03.782 15:08:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:10.337 15:08:07 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:10.337 15:08:07 -- target/filesystem.sh@25 -- # sync 00:07:10.337 15:08:07 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:10.337 15:08:07 -- target/filesystem.sh@27 -- # sync 00:07:10.337 15:08:07 -- target/filesystem.sh@29 -- # i=0 00:07:10.337 15:08:07 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:10.337 15:08:08 -- target/filesystem.sh@37 -- # kill -0 2665627 00:07:10.337 15:08:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:10.337 15:08:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:10.337 15:08:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:10.337 15:08:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:10.337 00:07:10.337 real 0m6.190s 00:07:10.337 user 0m0.018s 00:07:10.337 sys 0m0.067s 00:07:10.337 15:08:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.337 15:08:08 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 END TEST filesystem_ext4 00:07:10.337 ************************************ 00:07:10.337 15:08:08 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:10.337 15:08:08 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:10.337 15:08:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.337 15:08:08 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 START TEST filesystem_btrfs 00:07:10.337 ************************************ 00:07:10.337 15:08:08 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:10.337 15:08:08 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:10.337 15:08:08 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:10.337 15:08:08 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:10.337 15:08:08 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:10.337 15:08:08 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:10.337 15:08:08 -- common/autotest_common.sh@914 -- # local i=0 00:07:10.337 15:08:08 -- common/autotest_common.sh@915 -- # local force 00:07:10.337 15:08:08 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:10.337 15:08:08 -- common/autotest_common.sh@920 -- # force=-f 00:07:10.337 15:08:08 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:10.337 btrfs-progs v6.8.1 00:07:10.337 See https://btrfs.readthedocs.io for more information. 00:07:10.337 00:07:10.337 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:10.337 NOTE: several default settings have changed in version 5.15, please make sure 00:07:10.337 this does not affect your deployments: 00:07:10.337 - DUP for metadata (-m dup) 00:07:10.337 - enabled no-holes (-O no-holes) 00:07:10.337 - enabled free-space-tree (-R free-space-tree) 00:07:10.337 00:07:10.337 Label: (null) 00:07:10.337 UUID: 0ccf8d84-2754-4e7b-b09d-397d18709151 00:07:10.337 Node size: 16384 00:07:10.337 Sector size: 4096 (CPU page size: 4096) 00:07:10.337 Filesystem size: 510.00MiB 00:07:10.337 Block group profiles: 00:07:10.337 Data: single 8.00MiB 00:07:10.337 Metadata: DUP 32.00MiB 00:07:10.337 System: DUP 8.00MiB 00:07:10.337 SSD detected: yes 00:07:10.337 Zoned device: no 00:07:10.337 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:10.337 Checksum: crc32c 00:07:10.337 Number of devices: 1 00:07:10.337 Devices: 00:07:10.337 ID SIZE PATH 00:07:10.337 1 510.00MiB /dev/nvme0n1p1 00:07:10.337 00:07:10.337 15:08:08 -- common/autotest_common.sh@931 -- # return 0 00:07:10.337 15:08:08 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:10.596 15:08:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:10.597 15:08:08 -- target/filesystem.sh@25 -- # sync 00:07:10.597 15:08:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:10.597 15:08:08 -- target/filesystem.sh@27 -- # sync 00:07:10.597 15:08:08 -- target/filesystem.sh@29 -- # i=0 00:07:10.597 15:08:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:10.597 15:08:09 -- target/filesystem.sh@37 -- # kill -0 2665627 00:07:10.597 15:08:09 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:10.597 15:08:09 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:10.597 15:08:09 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:10.597 15:08:09 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:10.597 00:07:10.597 real 0m0.998s 00:07:10.597 user 0m0.021s 00:07:10.597 sys 0m0.096s 00:07:10.597 15:08:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.597 15:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:10.597 ************************************ 00:07:10.597 END TEST filesystem_btrfs 00:07:10.597 ************************************ 00:07:10.597 15:08:09 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:10.597 15:08:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:10.597 15:08:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.597 15:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:10.597 ************************************ 00:07:10.597 START TEST filesystem_xfs 00:07:10.597 ************************************ 00:07:10.597 15:08:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:10.597 15:08:09 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:10.597 15:08:09 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:10.597 15:08:09 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:10.597 15:08:09 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:10.597 15:08:09 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:10.597 15:08:09 -- common/autotest_common.sh@914 -- # local i=0 00:07:10.597 15:08:09 -- common/autotest_common.sh@915 -- # local force 00:07:10.597 15:08:09 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:10.597 15:08:09 -- common/autotest_common.sh@920 -- # force=-f 00:07:10.597 15:08:09 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:10.864 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:10.864 = sectsz=512 attr=2, projid32bit=1 00:07:10.864 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:10.864 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:10.864 data = bsize=4096 blocks=130560, imaxpct=25 00:07:10.864 = sunit=0 swidth=0 blks 00:07:10.864 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:10.864 log =internal log bsize=4096 blocks=16384, version=2 00:07:10.864 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:10.864 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:11.800 Discarding blocks...Done. 00:07:11.800 15:08:10 -- common/autotest_common.sh@931 -- # return 0 00:07:11.800 15:08:10 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:14.328 15:08:12 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:14.328 15:08:12 -- target/filesystem.sh@25 -- # sync 00:07:14.328 15:08:12 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:14.328 15:08:12 -- target/filesystem.sh@27 -- # sync 00:07:14.328 15:08:12 -- target/filesystem.sh@29 -- # i=0 00:07:14.328 15:08:12 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:14.328 15:08:12 -- target/filesystem.sh@37 -- # kill -0 2665627 00:07:14.328 15:08:12 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:14.328 15:08:12 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:14.328 15:08:12 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:14.328 15:08:12 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:14.328 00:07:14.328 real 0m3.610s 00:07:14.328 user 0m0.017s 00:07:14.328 sys 0m0.064s 00:07:14.328 15:08:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.328 15:08:12 -- common/autotest_common.sh@10 -- # set +x 00:07:14.328 ************************************ 00:07:14.328 END TEST filesystem_xfs 00:07:14.328 ************************************ 00:07:14.328 15:08:12 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:14.587 15:08:12 -- target/filesystem.sh@93 -- # sync 00:07:14.587 15:08:12 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:14.587 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:14.587 15:08:13 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:14.587 15:08:13 -- common/autotest_common.sh@1208 -- # local i=0 00:07:14.587 15:08:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:14.587 15:08:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.587 15:08:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:14.587 15:08:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.587 15:08:13 -- common/autotest_common.sh@1220 -- # return 0 00:07:14.587 15:08:13 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:14.587 15:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.587 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:14.587 15:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.587 15:08:13 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:14.587 15:08:13 -- target/filesystem.sh@101 -- # killprocess 2665627 00:07:14.587 15:08:13 -- common/autotest_common.sh@936 -- # '[' -z 2665627 ']' 00:07:14.587 15:08:13 -- common/autotest_common.sh@940 -- # kill -0 2665627 00:07:14.587 15:08:13 -- common/autotest_common.sh@941 -- # uname 00:07:14.587 15:08:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:14.587 15:08:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2665627 00:07:14.845 15:08:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:14.845 15:08:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:14.845 15:08:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2665627' 00:07:14.845 killing process with pid 2665627 00:07:14.845 15:08:13 -- common/autotest_common.sh@955 -- # kill 2665627 00:07:14.845 15:08:13 -- common/autotest_common.sh@960 -- # wait 2665627 00:07:15.104 15:08:13 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:15.104 00:07:15.104 real 0m17.849s 00:07:15.104 user 1m8.895s 00:07:15.104 sys 0m2.270s 00:07:15.104 15:08:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.104 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:15.104 ************************************ 00:07:15.104 END TEST nvmf_filesystem_no_in_capsule 00:07:15.104 ************************************ 00:07:15.104 15:08:13 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:15.104 15:08:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:15.104 15:08:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.104 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:15.363 ************************************ 00:07:15.363 START TEST nvmf_filesystem_in_capsule 00:07:15.363 ************************************ 00:07:15.363 15:08:13 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:15.363 15:08:13 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:15.363 15:08:13 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:15.363 15:08:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:15.363 15:08:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:15.363 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:15.363 15:08:13 -- nvmf/common.sh@469 -- # nvmfpid=2668031 00:07:15.363 15:08:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:15.363 15:08:13 -- nvmf/common.sh@470 -- # waitforlisten 2668031 00:07:15.363 15:08:13 -- common/autotest_common.sh@829 -- # '[' -z 2668031 ']' 00:07:15.363 15:08:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.363 15:08:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:15.363 15:08:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.363 15:08:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:15.363 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:15.363 [2024-11-19 15:08:13.716561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:15.363 [2024-11-19 15:08:13.716658] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:15.363 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.363 [2024-11-19 15:08:13.780628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:15.363 [2024-11-19 15:08:13.890408] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:15.363 [2024-11-19 15:08:13.890572] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:15.363 [2024-11-19 15:08:13.890589] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:15.363 [2024-11-19 15:08:13.890602] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:15.363 [2024-11-19 15:08:13.890658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.363 [2024-11-19 15:08:13.890720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:15.363 [2024-11-19 15:08:13.890785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:15.363 [2024-11-19 15:08:13.890788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.298 15:08:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:16.298 15:08:14 -- common/autotest_common.sh@862 -- # return 0 00:07:16.298 15:08:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:16.298 15:08:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:16.298 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.298 15:08:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:16.298 15:08:14 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:16.298 15:08:14 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:16.298 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.298 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.298 [2024-11-19 15:08:14.720265] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:16.298 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.298 15:08:14 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:16.298 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.298 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.556 Malloc1 00:07:16.556 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.556 15:08:14 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:16.556 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.556 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.556 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.556 15:08:14 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:16.556 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.556 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.556 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.556 15:08:14 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:16.556 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.556 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.556 [2024-11-19 15:08:14.902158] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:16.556 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.556 15:08:14 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:16.556 15:08:14 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:16.556 15:08:14 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:16.556 15:08:14 -- common/autotest_common.sh@1369 -- # local bs 00:07:16.556 15:08:14 -- common/autotest_common.sh@1370 -- # local nb 00:07:16.556 15:08:14 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:16.556 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.556 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:16.556 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.556 15:08:14 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:16.556 { 00:07:16.556 "name": "Malloc1", 00:07:16.556 "aliases": [ 00:07:16.556 "d3396fa1-0e50-4354-a3e3-6f5ae4e5c881" 00:07:16.556 ], 00:07:16.556 "product_name": "Malloc disk", 00:07:16.556 "block_size": 512, 00:07:16.556 "num_blocks": 1048576, 00:07:16.556 "uuid": "d3396fa1-0e50-4354-a3e3-6f5ae4e5c881", 00:07:16.556 "assigned_rate_limits": { 00:07:16.556 "rw_ios_per_sec": 0, 00:07:16.556 "rw_mbytes_per_sec": 0, 00:07:16.556 "r_mbytes_per_sec": 0, 00:07:16.556 "w_mbytes_per_sec": 0 00:07:16.556 }, 00:07:16.556 "claimed": true, 00:07:16.557 "claim_type": "exclusive_write", 00:07:16.557 "zoned": false, 00:07:16.557 "supported_io_types": { 00:07:16.557 "read": true, 00:07:16.557 "write": true, 00:07:16.557 "unmap": true, 00:07:16.557 "write_zeroes": true, 00:07:16.557 "flush": true, 00:07:16.557 "reset": true, 00:07:16.557 "compare": false, 00:07:16.557 "compare_and_write": false, 00:07:16.557 "abort": true, 00:07:16.557 "nvme_admin": false, 00:07:16.557 "nvme_io": false 00:07:16.557 }, 00:07:16.557 "memory_domains": [ 00:07:16.557 { 00:07:16.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:16.557 "dma_device_type": 2 00:07:16.557 } 00:07:16.557 ], 00:07:16.557 "driver_specific": {} 00:07:16.557 } 00:07:16.557 ]' 00:07:16.557 15:08:14 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:16.557 15:08:14 -- common/autotest_common.sh@1372 -- # bs=512 00:07:16.557 15:08:14 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:16.557 15:08:14 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:16.557 15:08:14 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:16.557 15:08:14 -- common/autotest_common.sh@1377 -- # echo 512 00:07:16.557 15:08:14 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:16.557 15:08:15 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:17.123 15:08:15 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:17.123 15:08:15 -- common/autotest_common.sh@1187 -- # local i=0 00:07:17.123 15:08:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:17.123 15:08:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:17.123 15:08:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:19.652 15:08:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:19.652 15:08:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:19.652 15:08:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:19.652 15:08:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:19.652 15:08:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:19.652 15:08:17 -- common/autotest_common.sh@1197 -- # return 0 00:07:19.652 15:08:17 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:19.652 15:08:17 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:19.652 15:08:17 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:19.652 15:08:17 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:19.652 15:08:17 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:19.652 15:08:17 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:19.652 15:08:17 -- setup/common.sh@80 -- # echo 536870912 00:07:19.652 15:08:17 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:19.652 15:08:17 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:19.652 15:08:17 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:19.652 15:08:17 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:19.652 15:08:17 -- target/filesystem.sh@69 -- # partprobe 00:07:19.910 15:08:18 -- target/filesystem.sh@70 -- # sleep 1 00:07:21.284 15:08:19 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:21.284 15:08:19 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:21.284 15:08:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.284 15:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.284 15:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:21.284 ************************************ 00:07:21.284 START TEST filesystem_in_capsule_ext4 00:07:21.284 ************************************ 00:07:21.284 15:08:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:21.284 15:08:19 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:21.284 15:08:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:21.284 15:08:19 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:21.284 15:08:19 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:21.284 15:08:19 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:21.284 15:08:19 -- common/autotest_common.sh@914 -- # local i=0 00:07:21.284 15:08:19 -- common/autotest_common.sh@915 -- # local force 00:07:21.284 15:08:19 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:21.284 15:08:19 -- common/autotest_common.sh@918 -- # force=-F 00:07:21.284 15:08:19 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:21.284 mke2fs 1.47.0 (5-Feb-2023) 00:07:21.284 Discarding device blocks: 0/522240 done 00:07:21.284 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:21.284 Filesystem UUID: 64e4699b-0265-4b62-90c2-26c7e6a539e9 00:07:21.284 Superblock backups stored on blocks: 00:07:21.284 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:21.284 00:07:21.284 Allocating group tables: 0/64 done 00:07:21.284 Writing inode tables: 0/64 done 00:07:21.284 Creating journal (8192 blocks): done 00:07:23.223 Writing superblocks and filesystem accounting information: 0/64 done 00:07:23.223 00:07:23.223 15:08:21 -- common/autotest_common.sh@931 -- # return 0 00:07:23.223 15:08:21 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:28.520 15:08:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:28.781 15:08:27 -- target/filesystem.sh@25 -- # sync 00:07:28.781 15:08:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:28.781 15:08:27 -- target/filesystem.sh@27 -- # sync 00:07:28.781 15:08:27 -- target/filesystem.sh@29 -- # i=0 00:07:28.781 15:08:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:28.781 15:08:27 -- target/filesystem.sh@37 -- # kill -0 2668031 00:07:28.781 15:08:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:28.781 15:08:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:28.781 15:08:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:28.781 15:08:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:28.781 00:07:28.781 real 0m7.715s 00:07:28.781 user 0m0.015s 00:07:28.781 sys 0m0.070s 00:07:28.781 15:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.781 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:28.781 ************************************ 00:07:28.781 END TEST filesystem_in_capsule_ext4 00:07:28.781 ************************************ 00:07:28.781 15:08:27 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:28.781 15:08:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:28.781 15:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.781 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:28.781 ************************************ 00:07:28.781 START TEST filesystem_in_capsule_btrfs 00:07:28.781 ************************************ 00:07:28.781 15:08:27 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:28.781 15:08:27 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:28.781 15:08:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:28.781 15:08:27 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:28.781 15:08:27 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:28.781 15:08:27 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:28.781 15:08:27 -- common/autotest_common.sh@914 -- # local i=0 00:07:28.781 15:08:27 -- common/autotest_common.sh@915 -- # local force 00:07:28.781 15:08:27 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:28.781 15:08:27 -- common/autotest_common.sh@920 -- # force=-f 00:07:28.781 15:08:27 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:29.039 btrfs-progs v6.8.1 00:07:29.039 See https://btrfs.readthedocs.io for more information. 00:07:29.039 00:07:29.039 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:29.039 NOTE: several default settings have changed in version 5.15, please make sure 00:07:29.039 this does not affect your deployments: 00:07:29.039 - DUP for metadata (-m dup) 00:07:29.039 - enabled no-holes (-O no-holes) 00:07:29.039 - enabled free-space-tree (-R free-space-tree) 00:07:29.039 00:07:29.039 Label: (null) 00:07:29.039 UUID: f52a0f32-22e5-43bf-9850-f9edda6ccb5e 00:07:29.039 Node size: 16384 00:07:29.039 Sector size: 4096 (CPU page size: 4096) 00:07:29.039 Filesystem size: 510.00MiB 00:07:29.039 Block group profiles: 00:07:29.039 Data: single 8.00MiB 00:07:29.039 Metadata: DUP 32.00MiB 00:07:29.039 System: DUP 8.00MiB 00:07:29.039 SSD detected: yes 00:07:29.039 Zoned device: no 00:07:29.039 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:29.039 Checksum: crc32c 00:07:29.039 Number of devices: 1 00:07:29.039 Devices: 00:07:29.039 ID SIZE PATH 00:07:29.039 1 510.00MiB /dev/nvme0n1p1 00:07:29.039 00:07:29.039 15:08:27 -- common/autotest_common.sh@931 -- # return 0 00:07:29.039 15:08:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:29.606 15:08:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:29.606 15:08:27 -- target/filesystem.sh@25 -- # sync 00:07:29.606 15:08:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:29.606 15:08:27 -- target/filesystem.sh@27 -- # sync 00:07:29.606 15:08:27 -- target/filesystem.sh@29 -- # i=0 00:07:29.606 15:08:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:29.606 15:08:27 -- target/filesystem.sh@37 -- # kill -0 2668031 00:07:29.606 15:08:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:29.606 15:08:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:29.606 15:08:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:29.606 15:08:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:29.606 00:07:29.606 real 0m0.771s 00:07:29.606 user 0m0.016s 00:07:29.606 sys 0m0.093s 00:07:29.606 15:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.606 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.606 ************************************ 00:07:29.606 END TEST filesystem_in_capsule_btrfs 00:07:29.606 ************************************ 00:07:29.606 15:08:27 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:29.606 15:08:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:29.606 15:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.606 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.606 ************************************ 00:07:29.606 START TEST filesystem_in_capsule_xfs 00:07:29.606 ************************************ 00:07:29.606 15:08:27 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:29.606 15:08:27 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:29.606 15:08:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:29.606 15:08:27 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:29.606 15:08:27 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:29.606 15:08:27 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:29.606 15:08:27 -- common/autotest_common.sh@914 -- # local i=0 00:07:29.606 15:08:27 -- common/autotest_common.sh@915 -- # local force 00:07:29.606 15:08:27 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:29.606 15:08:27 -- common/autotest_common.sh@920 -- # force=-f 00:07:29.606 15:08:27 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:29.606 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:29.606 = sectsz=512 attr=2, projid32bit=1 00:07:29.606 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:29.606 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:29.606 data = bsize=4096 blocks=130560, imaxpct=25 00:07:29.606 = sunit=0 swidth=0 blks 00:07:29.606 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:29.606 log =internal log bsize=4096 blocks=16384, version=2 00:07:29.606 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:29.606 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:30.540 Discarding blocks...Done. 00:07:30.540 15:08:29 -- common/autotest_common.sh@931 -- # return 0 00:07:30.540 15:08:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:33.079 15:08:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:33.079 15:08:31 -- target/filesystem.sh@25 -- # sync 00:07:33.079 15:08:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:33.080 15:08:31 -- target/filesystem.sh@27 -- # sync 00:07:33.080 15:08:31 -- target/filesystem.sh@29 -- # i=0 00:07:33.080 15:08:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:33.080 15:08:31 -- target/filesystem.sh@37 -- # kill -0 2668031 00:07:33.080 15:08:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:33.080 15:08:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:33.080 15:08:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:33.080 15:08:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:33.080 00:07:33.080 real 0m3.656s 00:07:33.080 user 0m0.017s 00:07:33.080 sys 0m0.061s 00:07:33.080 15:08:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.080 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:07:33.080 ************************************ 00:07:33.080 END TEST filesystem_in_capsule_xfs 00:07:33.080 ************************************ 00:07:33.338 15:08:31 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:33.338 15:08:31 -- target/filesystem.sh@93 -- # sync 00:07:33.338 15:08:31 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:33.338 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:33.338 15:08:31 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:33.338 15:08:31 -- common/autotest_common.sh@1208 -- # local i=0 00:07:33.338 15:08:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:33.338 15:08:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:33.338 15:08:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:33.338 15:08:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:33.596 15:08:31 -- common/autotest_common.sh@1220 -- # return 0 00:07:33.596 15:08:31 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:33.596 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.597 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:07:33.597 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.597 15:08:31 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:33.597 15:08:31 -- target/filesystem.sh@101 -- # killprocess 2668031 00:07:33.597 15:08:31 -- common/autotest_common.sh@936 -- # '[' -z 2668031 ']' 00:07:33.597 15:08:31 -- common/autotest_common.sh@940 -- # kill -0 2668031 00:07:33.597 15:08:31 -- common/autotest_common.sh@941 -- # uname 00:07:33.597 15:08:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:33.597 15:08:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2668031 00:07:33.597 15:08:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:33.597 15:08:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:33.597 15:08:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2668031' 00:07:33.597 killing process with pid 2668031 00:07:33.597 15:08:31 -- common/autotest_common.sh@955 -- # kill 2668031 00:07:33.597 15:08:31 -- common/autotest_common.sh@960 -- # wait 2668031 00:07:34.165 15:08:32 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:34.165 00:07:34.165 real 0m18.778s 00:07:34.165 user 1m12.636s 00:07:34.165 sys 0m2.294s 00:07:34.165 15:08:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.165 15:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:34.165 ************************************ 00:07:34.165 END TEST nvmf_filesystem_in_capsule 00:07:34.165 ************************************ 00:07:34.165 15:08:32 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:34.165 15:08:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:34.165 15:08:32 -- nvmf/common.sh@116 -- # sync 00:07:34.165 15:08:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:34.165 15:08:32 -- nvmf/common.sh@119 -- # set +e 00:07:34.165 15:08:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:34.165 15:08:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:34.165 rmmod nvme_tcp 00:07:34.165 rmmod nvme_fabrics 00:07:34.165 rmmod nvme_keyring 00:07:34.165 15:08:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:34.165 15:08:32 -- nvmf/common.sh@123 -- # set -e 00:07:34.165 15:08:32 -- nvmf/common.sh@124 -- # return 0 00:07:34.165 15:08:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:34.165 15:08:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:34.165 15:08:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:34.165 15:08:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:34.165 15:08:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:34.165 15:08:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:34.165 15:08:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:34.165 15:08:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:34.165 15:08:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:36.073 15:08:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:36.073 00:07:36.073 real 0m41.431s 00:07:36.073 user 2m22.685s 00:07:36.073 sys 0m6.240s 00:07:36.073 15:08:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.073 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:36.073 ************************************ 00:07:36.073 END TEST nvmf_filesystem 00:07:36.073 ************************************ 00:07:36.073 15:08:34 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:36.073 15:08:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:36.073 15:08:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.073 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:36.073 ************************************ 00:07:36.073 START TEST nvmf_discovery 00:07:36.073 ************************************ 00:07:36.073 15:08:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:36.073 * Looking for test storage... 00:07:36.073 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:36.073 15:08:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:36.073 15:08:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:36.073 15:08:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:36.333 15:08:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:36.333 15:08:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:36.333 15:08:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:36.333 15:08:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:36.333 15:08:34 -- scripts/common.sh@335 -- # IFS=.-: 00:07:36.333 15:08:34 -- scripts/common.sh@335 -- # read -ra ver1 00:07:36.333 15:08:34 -- scripts/common.sh@336 -- # IFS=.-: 00:07:36.333 15:08:34 -- scripts/common.sh@336 -- # read -ra ver2 00:07:36.333 15:08:34 -- scripts/common.sh@337 -- # local 'op=<' 00:07:36.333 15:08:34 -- scripts/common.sh@339 -- # ver1_l=2 00:07:36.333 15:08:34 -- scripts/common.sh@340 -- # ver2_l=1 00:07:36.333 15:08:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:36.333 15:08:34 -- scripts/common.sh@343 -- # case "$op" in 00:07:36.333 15:08:34 -- scripts/common.sh@344 -- # : 1 00:07:36.333 15:08:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:36.333 15:08:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:36.333 15:08:34 -- scripts/common.sh@364 -- # decimal 1 00:07:36.333 15:08:34 -- scripts/common.sh@352 -- # local d=1 00:07:36.333 15:08:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:36.333 15:08:34 -- scripts/common.sh@354 -- # echo 1 00:07:36.333 15:08:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:36.333 15:08:34 -- scripts/common.sh@365 -- # decimal 2 00:07:36.333 15:08:34 -- scripts/common.sh@352 -- # local d=2 00:07:36.333 15:08:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:36.333 15:08:34 -- scripts/common.sh@354 -- # echo 2 00:07:36.333 15:08:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:36.333 15:08:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:36.333 15:08:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:36.333 15:08:34 -- scripts/common.sh@367 -- # return 0 00:07:36.333 15:08:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:36.333 15:08:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:36.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:36.333 --rc genhtml_branch_coverage=1 00:07:36.333 --rc genhtml_function_coverage=1 00:07:36.333 --rc genhtml_legend=1 00:07:36.333 --rc geninfo_all_blocks=1 00:07:36.333 --rc geninfo_unexecuted_blocks=1 00:07:36.333 00:07:36.333 ' 00:07:36.333 15:08:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:36.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:36.333 --rc genhtml_branch_coverage=1 00:07:36.333 --rc genhtml_function_coverage=1 00:07:36.333 --rc genhtml_legend=1 00:07:36.333 --rc geninfo_all_blocks=1 00:07:36.333 --rc geninfo_unexecuted_blocks=1 00:07:36.333 00:07:36.333 ' 00:07:36.333 15:08:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:36.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:36.333 --rc genhtml_branch_coverage=1 00:07:36.333 --rc genhtml_function_coverage=1 00:07:36.333 --rc genhtml_legend=1 00:07:36.333 --rc geninfo_all_blocks=1 00:07:36.333 --rc geninfo_unexecuted_blocks=1 00:07:36.333 00:07:36.333 ' 00:07:36.333 15:08:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:36.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:36.333 --rc genhtml_branch_coverage=1 00:07:36.333 --rc genhtml_function_coverage=1 00:07:36.333 --rc genhtml_legend=1 00:07:36.333 --rc geninfo_all_blocks=1 00:07:36.333 --rc geninfo_unexecuted_blocks=1 00:07:36.333 00:07:36.333 ' 00:07:36.333 15:08:34 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:36.333 15:08:34 -- nvmf/common.sh@7 -- # uname -s 00:07:36.333 15:08:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:36.333 15:08:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:36.333 15:08:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:36.333 15:08:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:36.333 15:08:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:36.333 15:08:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:36.333 15:08:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:36.333 15:08:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:36.333 15:08:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:36.333 15:08:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:36.333 15:08:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:36.333 15:08:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:36.333 15:08:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:36.333 15:08:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:36.333 15:08:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:36.333 15:08:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:36.333 15:08:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:36.333 15:08:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:36.333 15:08:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:36.333 15:08:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:36.333 15:08:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:36.333 15:08:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:36.333 15:08:34 -- paths/export.sh@5 -- # export PATH 00:07:36.333 15:08:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:36.333 15:08:34 -- nvmf/common.sh@46 -- # : 0 00:07:36.333 15:08:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:36.333 15:08:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:36.333 15:08:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:36.333 15:08:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:36.333 15:08:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:36.333 15:08:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:36.333 15:08:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:36.333 15:08:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:36.333 15:08:34 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:36.333 15:08:34 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:36.334 15:08:34 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:36.334 15:08:34 -- target/discovery.sh@15 -- # hash nvme 00:07:36.334 15:08:34 -- target/discovery.sh@20 -- # nvmftestinit 00:07:36.334 15:08:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:36.334 15:08:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:36.334 15:08:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:36.334 15:08:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:36.334 15:08:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:36.334 15:08:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:36.334 15:08:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:36.334 15:08:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:36.334 15:08:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:36.334 15:08:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:36.334 15:08:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:36.334 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:38.868 15:08:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:38.868 15:08:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:38.868 15:08:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:38.868 15:08:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:38.868 15:08:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:38.868 15:08:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:38.868 15:08:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:38.868 15:08:36 -- nvmf/common.sh@294 -- # net_devs=() 00:07:38.868 15:08:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:38.868 15:08:36 -- nvmf/common.sh@295 -- # e810=() 00:07:38.868 15:08:36 -- nvmf/common.sh@295 -- # local -ga e810 00:07:38.868 15:08:36 -- nvmf/common.sh@296 -- # x722=() 00:07:38.868 15:08:36 -- nvmf/common.sh@296 -- # local -ga x722 00:07:38.868 15:08:36 -- nvmf/common.sh@297 -- # mlx=() 00:07:38.868 15:08:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:38.868 15:08:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:38.868 15:08:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:38.868 15:08:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:38.869 15:08:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:38.869 15:08:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:38.869 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:38.869 15:08:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:38.869 15:08:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:38.869 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:38.869 15:08:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:38.869 15:08:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:38.869 15:08:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:38.869 15:08:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:38.869 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:38.869 15:08:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:38.869 15:08:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:38.869 15:08:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:38.869 15:08:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:38.869 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:38.869 15:08:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:38.869 15:08:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:38.869 15:08:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:38.869 15:08:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:38.869 15:08:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:38.869 15:08:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:38.869 15:08:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:38.869 15:08:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:38.869 15:08:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:38.869 15:08:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:38.869 15:08:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:38.869 15:08:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:38.869 15:08:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:38.869 15:08:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:38.869 15:08:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:38.869 15:08:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:38.869 15:08:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:38.869 15:08:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:38.869 15:08:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:38.869 15:08:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:38.869 15:08:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:38.869 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:38.869 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:07:38.869 00:07:38.869 --- 10.0.0.2 ping statistics --- 00:07:38.869 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:38.869 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:07:38.869 15:08:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:38.869 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:38.869 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:07:38.869 00:07:38.869 --- 10.0.0.1 ping statistics --- 00:07:38.869 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:38.869 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:07:38.869 15:08:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:38.869 15:08:36 -- nvmf/common.sh@410 -- # return 0 00:07:38.869 15:08:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:38.869 15:08:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:38.869 15:08:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:38.869 15:08:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:38.869 15:08:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:38.869 15:08:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:38.869 15:08:36 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:38.869 15:08:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:38.869 15:08:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:38.869 15:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:38.869 15:08:36 -- nvmf/common.sh@469 -- # nvmfpid=2672464 00:07:38.869 15:08:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:38.869 15:08:36 -- nvmf/common.sh@470 -- # waitforlisten 2672464 00:07:38.869 15:08:36 -- common/autotest_common.sh@829 -- # '[' -z 2672464 ']' 00:07:38.869 15:08:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:38.869 15:08:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:38.869 15:08:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:38.869 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:38.869 15:08:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:38.869 15:08:36 -- common/autotest_common.sh@10 -- # set +x 00:07:38.869 [2024-11-19 15:08:37.006959] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.869 [2024-11-19 15:08:37.007064] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:38.869 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.869 [2024-11-19 15:08:37.073286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.869 [2024-11-19 15:08:37.183020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:38.869 [2024-11-19 15:08:37.183192] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:38.869 [2024-11-19 15:08:37.183209] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:38.869 [2024-11-19 15:08:37.183222] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:38.869 [2024-11-19 15:08:37.183276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.869 [2024-11-19 15:08:37.183338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.869 [2024-11-19 15:08:37.183367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.869 [2024-11-19 15:08:37.183370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.435 15:08:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:39.435 15:08:37 -- common/autotest_common.sh@862 -- # return 0 00:07:39.435 15:08:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:39.435 15:08:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:39.435 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:39.435 15:08:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:39.435 15:08:37 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:39.435 15:08:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.435 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 [2024-11-19 15:08:38.000276] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@26 -- # seq 1 4 00:07:39.694 15:08:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:39.694 15:08:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 Null1 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 [2024-11-19 15:08:38.040538] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:39.694 15:08:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 Null2 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:39.694 15:08:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 Null3 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:39.694 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.694 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.694 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.694 15:08:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:39.695 15:08:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 Null4 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:39.695 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.695 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.695 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.695 15:08:38 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:39.953 00:07:39.953 Discovery Log Number of Records 6, Generation counter 6 00:07:39.953 =====Discovery Log Entry 0====== 00:07:39.953 trtype: tcp 00:07:39.953 adrfam: ipv4 00:07:39.953 subtype: current discovery subsystem 00:07:39.953 treq: not required 00:07:39.953 portid: 0 00:07:39.953 trsvcid: 4420 00:07:39.953 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:39.953 traddr: 10.0.0.2 00:07:39.953 eflags: explicit discovery connections, duplicate discovery information 00:07:39.953 sectype: none 00:07:39.953 =====Discovery Log Entry 1====== 00:07:39.953 trtype: tcp 00:07:39.953 adrfam: ipv4 00:07:39.953 subtype: nvme subsystem 00:07:39.953 treq: not required 00:07:39.953 portid: 0 00:07:39.953 trsvcid: 4420 00:07:39.953 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:39.953 traddr: 10.0.0.2 00:07:39.953 eflags: none 00:07:39.953 sectype: none 00:07:39.953 =====Discovery Log Entry 2====== 00:07:39.953 trtype: tcp 00:07:39.953 adrfam: ipv4 00:07:39.953 subtype: nvme subsystem 00:07:39.953 treq: not required 00:07:39.953 portid: 0 00:07:39.953 trsvcid: 4420 00:07:39.953 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:39.953 traddr: 10.0.0.2 00:07:39.953 eflags: none 00:07:39.953 sectype: none 00:07:39.953 =====Discovery Log Entry 3====== 00:07:39.953 trtype: tcp 00:07:39.953 adrfam: ipv4 00:07:39.953 subtype: nvme subsystem 00:07:39.953 treq: not required 00:07:39.953 portid: 0 00:07:39.953 trsvcid: 4420 00:07:39.953 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:39.953 traddr: 10.0.0.2 00:07:39.954 eflags: none 00:07:39.954 sectype: none 00:07:39.954 =====Discovery Log Entry 4====== 00:07:39.954 trtype: tcp 00:07:39.954 adrfam: ipv4 00:07:39.954 subtype: nvme subsystem 00:07:39.954 treq: not required 00:07:39.954 portid: 0 00:07:39.954 trsvcid: 4420 00:07:39.954 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:39.954 traddr: 10.0.0.2 00:07:39.954 eflags: none 00:07:39.954 sectype: none 00:07:39.954 =====Discovery Log Entry 5====== 00:07:39.954 trtype: tcp 00:07:39.954 adrfam: ipv4 00:07:39.954 subtype: discovery subsystem referral 00:07:39.954 treq: not required 00:07:39.954 portid: 0 00:07:39.954 trsvcid: 4430 00:07:39.954 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:39.954 traddr: 10.0.0.2 00:07:39.954 eflags: none 00:07:39.954 sectype: none 00:07:39.954 15:08:38 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:39.954 Perform nvmf subsystem discovery via RPC 00:07:39.954 15:08:38 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:39.954 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.954 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.954 [2024-11-19 15:08:38.357514] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:39.954 [ 00:07:39.954 { 00:07:39.954 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:39.954 "subtype": "Discovery", 00:07:39.954 "listen_addresses": [ 00:07:39.954 { 00:07:39.954 "transport": "TCP", 00:07:39.954 "trtype": "TCP", 00:07:39.954 "adrfam": "IPv4", 00:07:39.954 "traddr": "10.0.0.2", 00:07:39.954 "trsvcid": "4420" 00:07:39.954 } 00:07:39.954 ], 00:07:39.954 "allow_any_host": true, 00:07:39.954 "hosts": [] 00:07:39.954 }, 00:07:39.954 { 00:07:39.954 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:39.954 "subtype": "NVMe", 00:07:39.954 "listen_addresses": [ 00:07:39.954 { 00:07:39.954 "transport": "TCP", 00:07:39.954 "trtype": "TCP", 00:07:39.954 "adrfam": "IPv4", 00:07:39.954 "traddr": "10.0.0.2", 00:07:39.954 "trsvcid": "4420" 00:07:39.954 } 00:07:39.954 ], 00:07:39.954 "allow_any_host": true, 00:07:39.954 "hosts": [], 00:07:39.954 "serial_number": "SPDK00000000000001", 00:07:39.954 "model_number": "SPDK bdev Controller", 00:07:39.954 "max_namespaces": 32, 00:07:39.954 "min_cntlid": 1, 00:07:39.954 "max_cntlid": 65519, 00:07:39.954 "namespaces": [ 00:07:39.954 { 00:07:39.954 "nsid": 1, 00:07:39.954 "bdev_name": "Null1", 00:07:39.954 "name": "Null1", 00:07:39.954 "nguid": "2BE5CD26CD794A7F9A663617B137CE66", 00:07:39.954 "uuid": "2be5cd26-cd79-4a7f-9a66-3617b137ce66" 00:07:39.954 } 00:07:39.954 ] 00:07:39.954 }, 00:07:39.954 { 00:07:39.954 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:39.954 "subtype": "NVMe", 00:07:39.954 "listen_addresses": [ 00:07:39.954 { 00:07:39.954 "transport": "TCP", 00:07:39.954 "trtype": "TCP", 00:07:39.954 "adrfam": "IPv4", 00:07:39.954 "traddr": "10.0.0.2", 00:07:39.954 "trsvcid": "4420" 00:07:39.954 } 00:07:39.954 ], 00:07:39.954 "allow_any_host": true, 00:07:39.954 "hosts": [], 00:07:39.954 "serial_number": "SPDK00000000000002", 00:07:39.954 "model_number": "SPDK bdev Controller", 00:07:39.954 "max_namespaces": 32, 00:07:39.954 "min_cntlid": 1, 00:07:39.954 "max_cntlid": 65519, 00:07:39.954 "namespaces": [ 00:07:39.954 { 00:07:39.954 "nsid": 1, 00:07:39.954 "bdev_name": "Null2", 00:07:39.954 "name": "Null2", 00:07:39.954 "nguid": "008480B05A8644A78E471C8B4D36FFA0", 00:07:39.954 "uuid": "008480b0-5a86-44a7-8e47-1c8b4d36ffa0" 00:07:39.954 } 00:07:39.954 ] 00:07:39.954 }, 00:07:39.954 { 00:07:39.954 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:39.954 "subtype": "NVMe", 00:07:39.954 "listen_addresses": [ 00:07:39.954 { 00:07:39.954 "transport": "TCP", 00:07:39.954 "trtype": "TCP", 00:07:39.954 "adrfam": "IPv4", 00:07:39.954 "traddr": "10.0.0.2", 00:07:39.954 "trsvcid": "4420" 00:07:39.954 } 00:07:39.954 ], 00:07:39.954 "allow_any_host": true, 00:07:39.954 "hosts": [], 00:07:39.954 "serial_number": "SPDK00000000000003", 00:07:39.954 "model_number": "SPDK bdev Controller", 00:07:39.954 "max_namespaces": 32, 00:07:39.954 "min_cntlid": 1, 00:07:39.954 "max_cntlid": 65519, 00:07:39.954 "namespaces": [ 00:07:39.954 { 00:07:39.954 "nsid": 1, 00:07:39.954 "bdev_name": "Null3", 00:07:39.954 "name": "Null3", 00:07:39.954 "nguid": "86485E8AAA3145078D256FC71036524E", 00:07:39.954 "uuid": "86485e8a-aa31-4507-8d25-6fc71036524e" 00:07:39.954 } 00:07:39.954 ] 00:07:39.954 }, 00:07:39.954 { 00:07:39.954 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:39.954 "subtype": "NVMe", 00:07:39.954 "listen_addresses": [ 00:07:39.954 { 00:07:39.954 "transport": "TCP", 00:07:39.954 "trtype": "TCP", 00:07:39.954 "adrfam": "IPv4", 00:07:39.954 "traddr": "10.0.0.2", 00:07:39.954 "trsvcid": "4420" 00:07:39.954 } 00:07:39.954 ], 00:07:39.954 "allow_any_host": true, 00:07:39.954 "hosts": [], 00:07:39.954 "serial_number": "SPDK00000000000004", 00:07:39.954 "model_number": "SPDK bdev Controller", 00:07:39.954 "max_namespaces": 32, 00:07:39.954 "min_cntlid": 1, 00:07:39.954 "max_cntlid": 65519, 00:07:39.954 "namespaces": [ 00:07:39.954 { 00:07:39.954 "nsid": 1, 00:07:39.954 "bdev_name": "Null4", 00:07:39.954 "name": "Null4", 00:07:39.954 "nguid": "B84C63F93AE54AD5BE17B0822491AEC8", 00:07:39.954 "uuid": "b84c63f9-3ae5-4ad5-be17-b0822491aec8" 00:07:39.954 } 00:07:39.954 ] 00:07:39.954 } 00:07:39.954 ] 00:07:39.954 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.954 15:08:38 -- target/discovery.sh@42 -- # seq 1 4 00:07:39.954 15:08:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.954 15:08:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:39.954 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.954 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.954 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.954 15:08:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:39.954 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.954 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.954 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.954 15:08:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.954 15:08:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:39.954 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.954 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.955 15:08:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.955 15:08:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:39.955 15:08:38 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:39.955 15:08:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.955 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:39.955 15:08:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.955 15:08:38 -- target/discovery.sh@49 -- # check_bdevs= 00:07:39.955 15:08:38 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:39.955 15:08:38 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:39.955 15:08:38 -- target/discovery.sh@57 -- # nvmftestfini 00:07:39.955 15:08:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:39.955 15:08:38 -- nvmf/common.sh@116 -- # sync 00:07:39.955 15:08:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:39.955 15:08:38 -- nvmf/common.sh@119 -- # set +e 00:07:39.955 15:08:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:39.955 15:08:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:39.955 rmmod nvme_tcp 00:07:39.955 rmmod nvme_fabrics 00:07:40.214 rmmod nvme_keyring 00:07:40.214 15:08:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:40.214 15:08:38 -- nvmf/common.sh@123 -- # set -e 00:07:40.214 15:08:38 -- nvmf/common.sh@124 -- # return 0 00:07:40.214 15:08:38 -- nvmf/common.sh@477 -- # '[' -n 2672464 ']' 00:07:40.214 15:08:38 -- nvmf/common.sh@478 -- # killprocess 2672464 00:07:40.214 15:08:38 -- common/autotest_common.sh@936 -- # '[' -z 2672464 ']' 00:07:40.214 15:08:38 -- common/autotest_common.sh@940 -- # kill -0 2672464 00:07:40.214 15:08:38 -- common/autotest_common.sh@941 -- # uname 00:07:40.214 15:08:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:40.214 15:08:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2672464 00:07:40.214 15:08:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:40.214 15:08:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:40.214 15:08:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2672464' 00:07:40.214 killing process with pid 2672464 00:07:40.214 15:08:38 -- common/autotest_common.sh@955 -- # kill 2672464 00:07:40.214 [2024-11-19 15:08:38.577210] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:40.214 15:08:38 -- common/autotest_common.sh@960 -- # wait 2672464 00:07:40.473 15:08:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:40.473 15:08:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:40.473 15:08:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:40.473 15:08:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:40.473 15:08:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:40.473 15:08:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:40.473 15:08:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:40.473 15:08:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:42.387 15:08:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:42.387 00:07:42.387 real 0m6.310s 00:07:42.387 user 0m7.549s 00:07:42.387 sys 0m1.960s 00:07:42.387 15:08:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.387 15:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:42.387 ************************************ 00:07:42.387 END TEST nvmf_discovery 00:07:42.387 ************************************ 00:07:42.388 15:08:40 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:42.388 15:08:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:42.388 15:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.388 15:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:42.388 ************************************ 00:07:42.388 START TEST nvmf_referrals 00:07:42.388 ************************************ 00:07:42.388 15:08:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:42.647 * Looking for test storage... 00:07:42.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:42.647 15:08:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:42.647 15:08:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:42.647 15:08:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:42.647 15:08:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:42.647 15:08:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:42.647 15:08:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:42.647 15:08:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:42.647 15:08:41 -- scripts/common.sh@335 -- # IFS=.-: 00:07:42.647 15:08:41 -- scripts/common.sh@335 -- # read -ra ver1 00:07:42.647 15:08:41 -- scripts/common.sh@336 -- # IFS=.-: 00:07:42.647 15:08:41 -- scripts/common.sh@336 -- # read -ra ver2 00:07:42.647 15:08:41 -- scripts/common.sh@337 -- # local 'op=<' 00:07:42.647 15:08:41 -- scripts/common.sh@339 -- # ver1_l=2 00:07:42.647 15:08:41 -- scripts/common.sh@340 -- # ver2_l=1 00:07:42.647 15:08:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:42.647 15:08:41 -- scripts/common.sh@343 -- # case "$op" in 00:07:42.647 15:08:41 -- scripts/common.sh@344 -- # : 1 00:07:42.647 15:08:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:42.647 15:08:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:42.647 15:08:41 -- scripts/common.sh@364 -- # decimal 1 00:07:42.647 15:08:41 -- scripts/common.sh@352 -- # local d=1 00:07:42.647 15:08:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:42.647 15:08:41 -- scripts/common.sh@354 -- # echo 1 00:07:42.647 15:08:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:42.647 15:08:41 -- scripts/common.sh@365 -- # decimal 2 00:07:42.647 15:08:41 -- scripts/common.sh@352 -- # local d=2 00:07:42.647 15:08:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:42.647 15:08:41 -- scripts/common.sh@354 -- # echo 2 00:07:42.647 15:08:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:42.647 15:08:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:42.647 15:08:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:42.647 15:08:41 -- scripts/common.sh@367 -- # return 0 00:07:42.647 15:08:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:42.647 15:08:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:42.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.647 --rc genhtml_branch_coverage=1 00:07:42.647 --rc genhtml_function_coverage=1 00:07:42.647 --rc genhtml_legend=1 00:07:42.647 --rc geninfo_all_blocks=1 00:07:42.647 --rc geninfo_unexecuted_blocks=1 00:07:42.647 00:07:42.647 ' 00:07:42.647 15:08:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:42.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.647 --rc genhtml_branch_coverage=1 00:07:42.647 --rc genhtml_function_coverage=1 00:07:42.647 --rc genhtml_legend=1 00:07:42.647 --rc geninfo_all_blocks=1 00:07:42.647 --rc geninfo_unexecuted_blocks=1 00:07:42.647 00:07:42.647 ' 00:07:42.647 15:08:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:42.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.647 --rc genhtml_branch_coverage=1 00:07:42.647 --rc genhtml_function_coverage=1 00:07:42.647 --rc genhtml_legend=1 00:07:42.647 --rc geninfo_all_blocks=1 00:07:42.647 --rc geninfo_unexecuted_blocks=1 00:07:42.647 00:07:42.647 ' 00:07:42.647 15:08:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:42.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:42.647 --rc genhtml_branch_coverage=1 00:07:42.647 --rc genhtml_function_coverage=1 00:07:42.647 --rc genhtml_legend=1 00:07:42.647 --rc geninfo_all_blocks=1 00:07:42.647 --rc geninfo_unexecuted_blocks=1 00:07:42.647 00:07:42.647 ' 00:07:42.647 15:08:41 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:42.647 15:08:41 -- nvmf/common.sh@7 -- # uname -s 00:07:42.647 15:08:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:42.647 15:08:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:42.648 15:08:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:42.648 15:08:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:42.648 15:08:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:42.648 15:08:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:42.648 15:08:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:42.648 15:08:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:42.648 15:08:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:42.648 15:08:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:42.648 15:08:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:42.648 15:08:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:42.648 15:08:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:42.648 15:08:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:42.648 15:08:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:42.648 15:08:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:42.648 15:08:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:42.648 15:08:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:42.648 15:08:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:42.648 15:08:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.648 15:08:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.648 15:08:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.648 15:08:41 -- paths/export.sh@5 -- # export PATH 00:07:42.648 15:08:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:42.648 15:08:41 -- nvmf/common.sh@46 -- # : 0 00:07:42.648 15:08:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:42.648 15:08:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:42.648 15:08:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:42.648 15:08:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:42.648 15:08:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:42.648 15:08:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:42.648 15:08:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:42.648 15:08:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:42.648 15:08:41 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:42.648 15:08:41 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:42.648 15:08:41 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:42.648 15:08:41 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:42.648 15:08:41 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:42.648 15:08:41 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:42.648 15:08:41 -- target/referrals.sh@37 -- # nvmftestinit 00:07:42.648 15:08:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:42.648 15:08:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:42.648 15:08:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:42.648 15:08:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:42.648 15:08:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:42.648 15:08:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:42.648 15:08:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:42.648 15:08:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:42.648 15:08:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:42.648 15:08:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:42.648 15:08:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:42.648 15:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.184 15:08:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:45.184 15:08:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:45.184 15:08:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:45.184 15:08:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:45.184 15:08:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:45.184 15:08:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:45.184 15:08:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:45.184 15:08:43 -- nvmf/common.sh@294 -- # net_devs=() 00:07:45.184 15:08:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:45.184 15:08:43 -- nvmf/common.sh@295 -- # e810=() 00:07:45.184 15:08:43 -- nvmf/common.sh@295 -- # local -ga e810 00:07:45.184 15:08:43 -- nvmf/common.sh@296 -- # x722=() 00:07:45.184 15:08:43 -- nvmf/common.sh@296 -- # local -ga x722 00:07:45.184 15:08:43 -- nvmf/common.sh@297 -- # mlx=() 00:07:45.184 15:08:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:45.184 15:08:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:45.184 15:08:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:45.184 15:08:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:45.184 15:08:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:45.184 15:08:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:45.184 15:08:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:45.184 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:45.184 15:08:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:45.184 15:08:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:45.184 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:45.184 15:08:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:45.184 15:08:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:45.184 15:08:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:45.184 15:08:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:45.184 15:08:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:45.184 15:08:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:45.184 15:08:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:45.184 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:45.185 15:08:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:45.185 15:08:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:45.185 15:08:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:45.185 15:08:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:45.185 15:08:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:45.185 15:08:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:45.185 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:45.185 15:08:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:45.185 15:08:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:45.185 15:08:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:45.185 15:08:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:45.185 15:08:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:45.185 15:08:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:45.185 15:08:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:45.185 15:08:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:45.185 15:08:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:45.185 15:08:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:45.185 15:08:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:45.185 15:08:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:45.185 15:08:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:45.185 15:08:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:45.185 15:08:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:45.185 15:08:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:45.185 15:08:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:45.185 15:08:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:45.185 15:08:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:45.185 15:08:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:45.185 15:08:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:45.185 15:08:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:45.185 15:08:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:45.185 15:08:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:45.185 15:08:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:45.185 15:08:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:45.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:45.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:07:45.185 00:07:45.185 --- 10.0.0.2 ping statistics --- 00:07:45.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:45.185 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:07:45.185 15:08:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:45.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:45.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:07:45.185 00:07:45.185 --- 10.0.0.1 ping statistics --- 00:07:45.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:45.185 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:07:45.185 15:08:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:45.185 15:08:43 -- nvmf/common.sh@410 -- # return 0 00:07:45.185 15:08:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:45.185 15:08:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:45.185 15:08:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:45.185 15:08:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:45.185 15:08:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:45.185 15:08:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:45.185 15:08:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:45.185 15:08:43 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:45.185 15:08:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:45.185 15:08:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:45.185 15:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:45.185 15:08:43 -- nvmf/common.sh@469 -- # nvmfpid=2674651 00:07:45.185 15:08:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:45.185 15:08:43 -- nvmf/common.sh@470 -- # waitforlisten 2674651 00:07:45.185 15:08:43 -- common/autotest_common.sh@829 -- # '[' -z 2674651 ']' 00:07:45.185 15:08:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:45.185 15:08:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:45.185 15:08:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:45.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:45.185 15:08:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:45.185 15:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:45.185 [2024-11-19 15:08:43.408467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:45.185 [2024-11-19 15:08:43.408536] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:45.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.185 [2024-11-19 15:08:43.477355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:45.185 [2024-11-19 15:08:43.586104] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:45.185 [2024-11-19 15:08:43.586274] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:45.185 [2024-11-19 15:08:43.586307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:45.185 [2024-11-19 15:08:43.586320] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:45.185 [2024-11-19 15:08:43.586388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:45.185 [2024-11-19 15:08:43.586449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:45.185 [2024-11-19 15:08:43.586478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:45.185 [2024-11-19 15:08:43.586480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.119 15:08:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:46.119 15:08:44 -- common/autotest_common.sh@862 -- # return 0 00:07:46.119 15:08:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:46.119 15:08:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:46.119 15:08:44 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 [2024-11-19 15:08:44.468522] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 [2024-11-19 15:08:44.480765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.119 15:08:44 -- target/referrals.sh@48 -- # jq length 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:46.119 15:08:44 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:46.119 15:08:44 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:46.119 15:08:44 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.119 15:08:44 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:46.119 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.119 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.119 15:08:44 -- target/referrals.sh@21 -- # sort 00:07:46.119 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:46.119 15:08:44 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:46.119 15:08:44 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:46.119 15:08:44 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:46.119 15:08:44 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:46.119 15:08:44 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.119 15:08:44 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:46.119 15:08:44 -- target/referrals.sh@26 -- # sort 00:07:46.377 15:08:44 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:46.377 15:08:44 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:46.377 15:08:44 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:46.377 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.377 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.377 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.377 15:08:44 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:46.377 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.377 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.377 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.377 15:08:44 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:46.377 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.377 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.377 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.377 15:08:44 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.377 15:08:44 -- target/referrals.sh@56 -- # jq length 00:07:46.378 15:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.378 15:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:46.378 15:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.378 15:08:44 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:46.378 15:08:44 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:46.378 15:08:44 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:46.378 15:08:44 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:46.378 15:08:44 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.378 15:08:44 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:46.378 15:08:44 -- target/referrals.sh@26 -- # sort 00:07:46.651 15:08:45 -- target/referrals.sh@26 -- # echo 00:07:46.652 15:08:45 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:46.652 15:08:45 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:46.652 15:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.652 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:46.652 15:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.652 15:08:45 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:46.652 15:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.652 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:46.652 15:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.652 15:08:45 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:46.652 15:08:45 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:46.652 15:08:45 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.652 15:08:45 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:46.652 15:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.652 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:46.652 15:08:45 -- target/referrals.sh@21 -- # sort 00:07:46.652 15:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.652 15:08:45 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:46.652 15:08:45 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:46.652 15:08:45 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:46.652 15:08:45 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:46.652 15:08:45 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:46.652 15:08:45 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.652 15:08:45 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:46.652 15:08:45 -- target/referrals.sh@26 -- # sort 00:07:46.910 15:08:45 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:46.910 15:08:45 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:46.910 15:08:45 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:46.910 15:08:45 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:46.910 15:08:45 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:46.910 15:08:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.910 15:08:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:47.168 15:08:45 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:47.168 15:08:45 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:47.168 15:08:45 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:47.168 15:08:45 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:47.168 15:08:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.168 15:08:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:47.168 15:08:45 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:47.168 15:08:45 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:47.168 15:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:47.168 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:47.427 15:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.427 15:08:45 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:47.427 15:08:45 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:47.427 15:08:45 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:47.427 15:08:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:47.427 15:08:45 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:47.427 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:47.427 15:08:45 -- target/referrals.sh@21 -- # sort 00:07:47.427 15:08:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.427 15:08:45 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:47.427 15:08:45 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:47.427 15:08:45 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:47.427 15:08:45 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:47.427 15:08:45 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:47.427 15:08:45 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.427 15:08:45 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:47.427 15:08:45 -- target/referrals.sh@26 -- # sort 00:07:47.427 15:08:45 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:47.427 15:08:45 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:47.427 15:08:45 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:47.427 15:08:45 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:47.427 15:08:45 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:47.427 15:08:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.427 15:08:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:47.686 15:08:46 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:47.686 15:08:46 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:47.686 15:08:46 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:47.686 15:08:46 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:47.686 15:08:46 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.686 15:08:46 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:47.686 15:08:46 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:47.686 15:08:46 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:47.686 15:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:47.686 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:47.944 15:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.944 15:08:46 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:47.944 15:08:46 -- target/referrals.sh@82 -- # jq length 00:07:47.944 15:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:47.944 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:47.944 15:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.944 15:08:46 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:47.944 15:08:46 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:47.944 15:08:46 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:47.944 15:08:46 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:47.944 15:08:46 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.944 15:08:46 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:47.944 15:08:46 -- target/referrals.sh@26 -- # sort 00:07:48.202 15:08:46 -- target/referrals.sh@26 -- # echo 00:07:48.202 15:08:46 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:48.202 15:08:46 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:48.202 15:08:46 -- target/referrals.sh@86 -- # nvmftestfini 00:07:48.202 15:08:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:48.202 15:08:46 -- nvmf/common.sh@116 -- # sync 00:07:48.202 15:08:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:48.202 15:08:46 -- nvmf/common.sh@119 -- # set +e 00:07:48.202 15:08:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:48.202 15:08:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:48.202 rmmod nvme_tcp 00:07:48.202 rmmod nvme_fabrics 00:07:48.202 rmmod nvme_keyring 00:07:48.202 15:08:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:48.202 15:08:46 -- nvmf/common.sh@123 -- # set -e 00:07:48.202 15:08:46 -- nvmf/common.sh@124 -- # return 0 00:07:48.202 15:08:46 -- nvmf/common.sh@477 -- # '[' -n 2674651 ']' 00:07:48.202 15:08:46 -- nvmf/common.sh@478 -- # killprocess 2674651 00:07:48.202 15:08:46 -- common/autotest_common.sh@936 -- # '[' -z 2674651 ']' 00:07:48.202 15:08:46 -- common/autotest_common.sh@940 -- # kill -0 2674651 00:07:48.202 15:08:46 -- common/autotest_common.sh@941 -- # uname 00:07:48.202 15:08:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.202 15:08:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2674651 00:07:48.202 15:08:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:48.202 15:08:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:48.202 15:08:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2674651' 00:07:48.202 killing process with pid 2674651 00:07:48.202 15:08:46 -- common/autotest_common.sh@955 -- # kill 2674651 00:07:48.202 15:08:46 -- common/autotest_common.sh@960 -- # wait 2674651 00:07:48.461 15:08:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:48.461 15:08:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:48.461 15:08:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:48.461 15:08:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:48.461 15:08:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:48.461 15:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:48.461 15:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:48.461 15:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:50.996 15:08:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:50.996 00:07:50.996 real 0m8.024s 00:07:50.996 user 0m14.881s 00:07:50.996 sys 0m2.337s 00:07:50.996 15:08:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:50.996 15:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:50.996 ************************************ 00:07:50.996 END TEST nvmf_referrals 00:07:50.996 ************************************ 00:07:50.997 15:08:48 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:50.997 15:08:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:50.997 15:08:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.997 15:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:50.997 ************************************ 00:07:50.997 START TEST nvmf_connect_disconnect 00:07:50.997 ************************************ 00:07:50.997 15:08:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:50.997 * Looking for test storage... 00:07:50.997 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:50.997 15:08:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:50.997 15:08:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:50.997 15:08:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:50.997 15:08:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:50.997 15:08:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:50.997 15:08:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:50.997 15:08:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:50.997 15:08:49 -- scripts/common.sh@335 -- # IFS=.-: 00:07:50.997 15:08:49 -- scripts/common.sh@335 -- # read -ra ver1 00:07:50.997 15:08:49 -- scripts/common.sh@336 -- # IFS=.-: 00:07:50.997 15:08:49 -- scripts/common.sh@336 -- # read -ra ver2 00:07:50.997 15:08:49 -- scripts/common.sh@337 -- # local 'op=<' 00:07:50.997 15:08:49 -- scripts/common.sh@339 -- # ver1_l=2 00:07:50.997 15:08:49 -- scripts/common.sh@340 -- # ver2_l=1 00:07:50.997 15:08:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:50.997 15:08:49 -- scripts/common.sh@343 -- # case "$op" in 00:07:50.997 15:08:49 -- scripts/common.sh@344 -- # : 1 00:07:50.997 15:08:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:50.997 15:08:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:50.997 15:08:49 -- scripts/common.sh@364 -- # decimal 1 00:07:50.997 15:08:49 -- scripts/common.sh@352 -- # local d=1 00:07:50.997 15:08:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:50.997 15:08:49 -- scripts/common.sh@354 -- # echo 1 00:07:50.997 15:08:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:50.997 15:08:49 -- scripts/common.sh@365 -- # decimal 2 00:07:50.997 15:08:49 -- scripts/common.sh@352 -- # local d=2 00:07:50.997 15:08:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:50.997 15:08:49 -- scripts/common.sh@354 -- # echo 2 00:07:50.997 15:08:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:50.997 15:08:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:50.997 15:08:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:50.997 15:08:49 -- scripts/common.sh@367 -- # return 0 00:07:50.997 15:08:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:50.997 15:08:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:50.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.997 --rc genhtml_branch_coverage=1 00:07:50.997 --rc genhtml_function_coverage=1 00:07:50.997 --rc genhtml_legend=1 00:07:50.997 --rc geninfo_all_blocks=1 00:07:50.997 --rc geninfo_unexecuted_blocks=1 00:07:50.997 00:07:50.997 ' 00:07:50.997 15:08:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:50.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.997 --rc genhtml_branch_coverage=1 00:07:50.997 --rc genhtml_function_coverage=1 00:07:50.997 --rc genhtml_legend=1 00:07:50.997 --rc geninfo_all_blocks=1 00:07:50.997 --rc geninfo_unexecuted_blocks=1 00:07:50.997 00:07:50.997 ' 00:07:50.997 15:08:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:50.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.997 --rc genhtml_branch_coverage=1 00:07:50.997 --rc genhtml_function_coverage=1 00:07:50.997 --rc genhtml_legend=1 00:07:50.997 --rc geninfo_all_blocks=1 00:07:50.997 --rc geninfo_unexecuted_blocks=1 00:07:50.997 00:07:50.997 ' 00:07:50.997 15:08:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:50.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.997 --rc genhtml_branch_coverage=1 00:07:50.997 --rc genhtml_function_coverage=1 00:07:50.997 --rc genhtml_legend=1 00:07:50.997 --rc geninfo_all_blocks=1 00:07:50.997 --rc geninfo_unexecuted_blocks=1 00:07:50.997 00:07:50.997 ' 00:07:50.997 15:08:49 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.997 15:08:49 -- nvmf/common.sh@7 -- # uname -s 00:07:50.997 15:08:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.997 15:08:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.997 15:08:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.997 15:08:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.997 15:08:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.997 15:08:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.997 15:08:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.997 15:08:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.997 15:08:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.997 15:08:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.997 15:08:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.997 15:08:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.997 15:08:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.997 15:08:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.997 15:08:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.997 15:08:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:50.997 15:08:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.997 15:08:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.997 15:08:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.997 15:08:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.997 15:08:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.997 15:08:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.997 15:08:49 -- paths/export.sh@5 -- # export PATH 00:07:50.997 15:08:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.997 15:08:49 -- nvmf/common.sh@46 -- # : 0 00:07:50.997 15:08:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:50.997 15:08:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:50.997 15:08:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:50.997 15:08:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.997 15:08:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.997 15:08:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:50.997 15:08:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:50.997 15:08:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:50.997 15:08:49 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:50.997 15:08:49 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:50.997 15:08:49 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:50.997 15:08:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:50.997 15:08:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:50.997 15:08:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:50.997 15:08:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:50.997 15:08:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:50.997 15:08:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:50.997 15:08:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:50.997 15:08:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:50.997 15:08:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:50.997 15:08:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:50.997 15:08:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:50.997 15:08:49 -- common/autotest_common.sh@10 -- # set +x 00:07:52.900 15:08:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:52.900 15:08:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:52.900 15:08:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:52.900 15:08:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:52.900 15:08:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:52.900 15:08:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:52.900 15:08:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:52.900 15:08:51 -- nvmf/common.sh@294 -- # net_devs=() 00:07:52.900 15:08:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:52.900 15:08:51 -- nvmf/common.sh@295 -- # e810=() 00:07:52.900 15:08:51 -- nvmf/common.sh@295 -- # local -ga e810 00:07:52.900 15:08:51 -- nvmf/common.sh@296 -- # x722=() 00:07:52.900 15:08:51 -- nvmf/common.sh@296 -- # local -ga x722 00:07:52.900 15:08:51 -- nvmf/common.sh@297 -- # mlx=() 00:07:52.900 15:08:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:52.900 15:08:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:52.900 15:08:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:52.900 15:08:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:52.900 15:08:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:52.900 15:08:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:52.900 15:08:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:52.900 15:08:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:52.900 15:08:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.901 15:08:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:52.901 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:52.901 15:08:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.901 15:08:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:52.901 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:52.901 15:08:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:52.901 15:08:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.901 15:08:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.901 15:08:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.901 15:08:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.901 15:08:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:52.901 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:52.901 15:08:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.901 15:08:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.901 15:08:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.901 15:08:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.901 15:08:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.901 15:08:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:52.901 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:52.901 15:08:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.901 15:08:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:52.901 15:08:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:52.901 15:08:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:52.901 15:08:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:52.901 15:08:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:52.901 15:08:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:52.901 15:08:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:52.901 15:08:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:52.901 15:08:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:52.901 15:08:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:52.901 15:08:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:52.901 15:08:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:52.901 15:08:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:52.901 15:08:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:52.901 15:08:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:52.901 15:08:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:52.901 15:08:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:52.901 15:08:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:52.901 15:08:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:52.901 15:08:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:52.901 15:08:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:52.901 15:08:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:52.901 15:08:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:52.901 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:52.901 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:07:52.901 00:07:52.901 --- 10.0.0.2 ping statistics --- 00:07:52.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.901 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:07:52.901 15:08:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:52.901 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:52.901 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:07:52.901 00:07:52.901 --- 10.0.0.1 ping statistics --- 00:07:52.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.901 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:07:52.901 15:08:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:52.901 15:08:51 -- nvmf/common.sh@410 -- # return 0 00:07:52.901 15:08:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:52.901 15:08:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:52.901 15:08:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:52.901 15:08:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:52.901 15:08:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:52.901 15:08:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:52.901 15:08:51 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:52.901 15:08:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:52.901 15:08:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:52.901 15:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:52.901 15:08:51 -- nvmf/common.sh@469 -- # nvmfpid=2677108 00:07:52.901 15:08:51 -- nvmf/common.sh@470 -- # waitforlisten 2677108 00:07:52.901 15:08:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:52.901 15:08:51 -- common/autotest_common.sh@829 -- # '[' -z 2677108 ']' 00:07:52.901 15:08:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:52.901 15:08:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:52.901 15:08:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:52.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:52.901 15:08:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:52.901 15:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:52.901 [2024-11-19 15:08:51.385215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:52.901 [2024-11-19 15:08:51.385294] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:52.901 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.901 [2024-11-19 15:08:51.454876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:53.160 [2024-11-19 15:08:51.575154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:53.160 [2024-11-19 15:08:51.575319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:53.160 [2024-11-19 15:08:51.575339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:53.160 [2024-11-19 15:08:51.575353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:53.160 [2024-11-19 15:08:51.575452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:53.160 [2024-11-19 15:08:51.575506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:53.160 [2024-11-19 15:08:51.575538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:53.160 [2024-11-19 15:08:51.575541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.096 15:08:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:54.096 15:08:52 -- common/autotest_common.sh@862 -- # return 0 00:07:54.096 15:08:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:54.096 15:08:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 15:08:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:54.096 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 [2024-11-19 15:08:52.422413] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:54.096 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:54.096 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:54.096 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:54.096 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:54.096 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.096 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:54.096 [2024-11-19 15:08:52.480179] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:54.096 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:54.096 15:08:52 -- target/connect_disconnect.sh@34 -- # set +x 00:07:56.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.524 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.446 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.826 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.882 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.609 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.665 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.625 [2024-11-19 15:10:46.037471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f441a0 is same with the state(5) to be set 00:09:47.625 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.152 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.110 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.637 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.066 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.881 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.369 [2024-11-19 15:11:53.576528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f441a0 is same with the state(5) to be set 00:10:55.369 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.852 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.415 [2024-11-19 15:12:12.349513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f441a0 is same with the state(5) to be set 00:11:14.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.707 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.684 15:12:45 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:46.684 15:12:45 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:46.684 15:12:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:46.684 15:12:45 -- nvmf/common.sh@116 -- # sync 00:11:46.684 15:12:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:46.684 15:12:45 -- nvmf/common.sh@119 -- # set +e 00:11:46.684 15:12:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:46.684 15:12:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:46.684 rmmod nvme_tcp 00:11:46.684 rmmod nvme_fabrics 00:11:46.684 rmmod nvme_keyring 00:11:46.684 15:12:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:46.684 15:12:45 -- nvmf/common.sh@123 -- # set -e 00:11:46.684 15:12:45 -- nvmf/common.sh@124 -- # return 0 00:11:46.684 15:12:45 -- nvmf/common.sh@477 -- # '[' -n 2677108 ']' 00:11:46.684 15:12:45 -- nvmf/common.sh@478 -- # killprocess 2677108 00:11:46.684 15:12:45 -- common/autotest_common.sh@936 -- # '[' -z 2677108 ']' 00:11:46.684 15:12:45 -- common/autotest_common.sh@940 -- # kill -0 2677108 00:11:46.684 15:12:45 -- common/autotest_common.sh@941 -- # uname 00:11:46.684 15:12:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:46.684 15:12:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2677108 00:11:46.684 15:12:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:46.684 15:12:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:46.684 15:12:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2677108' 00:11:46.684 killing process with pid 2677108 00:11:46.684 15:12:45 -- common/autotest_common.sh@955 -- # kill 2677108 00:11:46.684 15:12:45 -- common/autotest_common.sh@960 -- # wait 2677108 00:11:46.943 15:12:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:46.943 15:12:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:46.943 15:12:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:46.943 15:12:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:46.943 15:12:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:46.943 15:12:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.943 15:12:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:46.943 15:12:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.477 15:12:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:49.477 00:11:49.477 real 3m58.475s 00:11:49.477 user 15m10.976s 00:11:49.478 sys 0m33.235s 00:11:49.478 15:12:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:49.478 15:12:47 -- common/autotest_common.sh@10 -- # set +x 00:11:49.478 ************************************ 00:11:49.478 END TEST nvmf_connect_disconnect 00:11:49.478 ************************************ 00:11:49.478 15:12:47 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:49.478 15:12:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:49.478 15:12:47 -- common/autotest_common.sh@10 -- # set +x 00:11:49.478 ************************************ 00:11:49.478 START TEST nvmf_multitarget 00:11:49.478 ************************************ 00:11:49.478 15:12:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:49.478 * Looking for test storage... 00:11:49.478 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:49.478 15:12:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:49.478 15:12:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:49.478 15:12:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:49.478 15:12:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:49.478 15:12:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:49.478 15:12:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:49.478 15:12:47 -- scripts/common.sh@335 -- # IFS=.-: 00:11:49.478 15:12:47 -- scripts/common.sh@335 -- # read -ra ver1 00:11:49.478 15:12:47 -- scripts/common.sh@336 -- # IFS=.-: 00:11:49.478 15:12:47 -- scripts/common.sh@336 -- # read -ra ver2 00:11:49.478 15:12:47 -- scripts/common.sh@337 -- # local 'op=<' 00:11:49.478 15:12:47 -- scripts/common.sh@339 -- # ver1_l=2 00:11:49.478 15:12:47 -- scripts/common.sh@340 -- # ver2_l=1 00:11:49.478 15:12:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:49.478 15:12:47 -- scripts/common.sh@343 -- # case "$op" in 00:11:49.478 15:12:47 -- scripts/common.sh@344 -- # : 1 00:11:49.478 15:12:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:49.478 15:12:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:49.478 15:12:47 -- scripts/common.sh@364 -- # decimal 1 00:11:49.478 15:12:47 -- scripts/common.sh@352 -- # local d=1 00:11:49.478 15:12:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:49.478 15:12:47 -- scripts/common.sh@354 -- # echo 1 00:11:49.478 15:12:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:49.478 15:12:47 -- scripts/common.sh@365 -- # decimal 2 00:11:49.478 15:12:47 -- scripts/common.sh@352 -- # local d=2 00:11:49.478 15:12:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:49.478 15:12:47 -- scripts/common.sh@354 -- # echo 2 00:11:49.478 15:12:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:49.478 15:12:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:49.478 15:12:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:49.478 15:12:47 -- scripts/common.sh@367 -- # return 0 00:11:49.478 15:12:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:49.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.478 --rc genhtml_branch_coverage=1 00:11:49.478 --rc genhtml_function_coverage=1 00:11:49.478 --rc genhtml_legend=1 00:11:49.478 --rc geninfo_all_blocks=1 00:11:49.478 --rc geninfo_unexecuted_blocks=1 00:11:49.478 00:11:49.478 ' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:49.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.478 --rc genhtml_branch_coverage=1 00:11:49.478 --rc genhtml_function_coverage=1 00:11:49.478 --rc genhtml_legend=1 00:11:49.478 --rc geninfo_all_blocks=1 00:11:49.478 --rc geninfo_unexecuted_blocks=1 00:11:49.478 00:11:49.478 ' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:49.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.478 --rc genhtml_branch_coverage=1 00:11:49.478 --rc genhtml_function_coverage=1 00:11:49.478 --rc genhtml_legend=1 00:11:49.478 --rc geninfo_all_blocks=1 00:11:49.478 --rc geninfo_unexecuted_blocks=1 00:11:49.478 00:11:49.478 ' 00:11:49.478 15:12:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:49.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.478 --rc genhtml_branch_coverage=1 00:11:49.478 --rc genhtml_function_coverage=1 00:11:49.478 --rc genhtml_legend=1 00:11:49.478 --rc geninfo_all_blocks=1 00:11:49.478 --rc geninfo_unexecuted_blocks=1 00:11:49.478 00:11:49.478 ' 00:11:49.478 15:12:47 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:49.478 15:12:47 -- nvmf/common.sh@7 -- # uname -s 00:11:49.478 15:12:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:49.478 15:12:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:49.478 15:12:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:49.478 15:12:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:49.478 15:12:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:49.478 15:12:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:49.478 15:12:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:49.478 15:12:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:49.478 15:12:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:49.478 15:12:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:49.478 15:12:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.478 15:12:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.478 15:12:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:49.478 15:12:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:49.478 15:12:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:49.478 15:12:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:49.478 15:12:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:49.478 15:12:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:49.478 15:12:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:49.478 15:12:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.478 15:12:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.478 15:12:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.478 15:12:47 -- paths/export.sh@5 -- # export PATH 00:11:49.478 15:12:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.478 15:12:47 -- nvmf/common.sh@46 -- # : 0 00:11:49.478 15:12:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:49.478 15:12:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:49.478 15:12:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:49.478 15:12:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:49.478 15:12:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:49.478 15:12:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:49.478 15:12:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:49.478 15:12:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:49.478 15:12:47 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:49.478 15:12:47 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:49.478 15:12:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:49.478 15:12:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:49.478 15:12:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:49.478 15:12:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:49.478 15:12:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:49.478 15:12:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.478 15:12:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.478 15:12:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.478 15:12:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:49.478 15:12:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:49.478 15:12:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:49.478 15:12:47 -- common/autotest_common.sh@10 -- # set +x 00:11:51.383 15:12:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:51.383 15:12:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:51.383 15:12:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:51.383 15:12:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:51.383 15:12:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:51.383 15:12:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:51.383 15:12:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:51.383 15:12:49 -- nvmf/common.sh@294 -- # net_devs=() 00:11:51.383 15:12:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:51.383 15:12:49 -- nvmf/common.sh@295 -- # e810=() 00:11:51.383 15:12:49 -- nvmf/common.sh@295 -- # local -ga e810 00:11:51.383 15:12:49 -- nvmf/common.sh@296 -- # x722=() 00:11:51.383 15:12:49 -- nvmf/common.sh@296 -- # local -ga x722 00:11:51.383 15:12:49 -- nvmf/common.sh@297 -- # mlx=() 00:11:51.383 15:12:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:51.383 15:12:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:51.383 15:12:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.383 15:12:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:51.383 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:51.383 15:12:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.383 15:12:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:51.383 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:51.383 15:12:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.383 15:12:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.383 15:12:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.383 15:12:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:51.383 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:51.383 15:12:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.383 15:12:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.383 15:12:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.383 15:12:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:51.383 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:51.383 15:12:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:51.383 15:12:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:51.383 15:12:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:51.383 15:12:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:51.383 15:12:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:51.383 15:12:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:51.383 15:12:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:51.383 15:12:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:51.383 15:12:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:51.383 15:12:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:51.383 15:12:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:51.383 15:12:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:51.383 15:12:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:51.383 15:12:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:51.383 15:12:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:51.383 15:12:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:51.383 15:12:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:51.383 15:12:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:51.383 15:12:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:51.383 15:12:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:51.383 15:12:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:51.383 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:51.383 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:11:51.383 00:11:51.383 --- 10.0.0.2 ping statistics --- 00:11:51.383 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.383 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:11:51.383 15:12:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:51.383 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:51.383 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:11:51.383 00:11:51.383 --- 10.0.0.1 ping statistics --- 00:11:51.383 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.383 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:11:51.383 15:12:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:51.383 15:12:49 -- nvmf/common.sh@410 -- # return 0 00:11:51.383 15:12:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:51.383 15:12:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:51.383 15:12:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:51.383 15:12:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:51.383 15:12:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:51.383 15:12:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:51.383 15:12:49 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:51.383 15:12:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:51.383 15:12:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:51.383 15:12:49 -- common/autotest_common.sh@10 -- # set +x 00:11:51.383 15:12:49 -- nvmf/common.sh@469 -- # nvmfpid=2709880 00:11:51.383 15:12:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:51.383 15:12:49 -- nvmf/common.sh@470 -- # waitforlisten 2709880 00:11:51.383 15:12:49 -- common/autotest_common.sh@829 -- # '[' -z 2709880 ']' 00:11:51.383 15:12:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:51.383 15:12:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:51.383 15:12:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:51.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:51.383 15:12:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:51.383 15:12:49 -- common/autotest_common.sh@10 -- # set +x 00:11:51.383 [2024-11-19 15:12:49.848987] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:51.383 [2024-11-19 15:12:49.849070] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:51.384 EAL: No free 2048 kB hugepages reported on node 1 00:11:51.384 [2024-11-19 15:12:49.922572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:51.733 [2024-11-19 15:12:50.057064] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:51.733 [2024-11-19 15:12:50.057239] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:51.733 [2024-11-19 15:12:50.057259] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:51.733 [2024-11-19 15:12:50.057282] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:51.733 [2024-11-19 15:12:50.057357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:51.733 [2024-11-19 15:12:50.057409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:51.733 [2024-11-19 15:12:50.057462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:51.733 [2024-11-19 15:12:50.057465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:52.302 15:12:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:52.302 15:12:50 -- common/autotest_common.sh@862 -- # return 0 00:11:52.302 15:12:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:52.302 15:12:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:52.302 15:12:50 -- common/autotest_common.sh@10 -- # set +x 00:11:52.560 15:12:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:52.560 15:12:50 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:52.560 15:12:50 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:52.560 15:12:50 -- target/multitarget.sh@21 -- # jq length 00:11:52.560 15:12:50 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:52.560 15:12:50 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:52.560 "nvmf_tgt_1" 00:11:52.560 15:12:51 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:52.818 "nvmf_tgt_2" 00:11:52.818 15:12:51 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:52.818 15:12:51 -- target/multitarget.sh@28 -- # jq length 00:11:52.818 15:12:51 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:52.818 15:12:51 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:53.077 true 00:11:53.077 15:12:51 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:53.077 true 00:11:53.077 15:12:51 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:53.077 15:12:51 -- target/multitarget.sh@35 -- # jq length 00:11:53.336 15:12:51 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:53.336 15:12:51 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:53.336 15:12:51 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:53.336 15:12:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:53.336 15:12:51 -- nvmf/common.sh@116 -- # sync 00:11:53.336 15:12:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:53.336 15:12:51 -- nvmf/common.sh@119 -- # set +e 00:11:53.336 15:12:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:53.336 15:12:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:53.336 rmmod nvme_tcp 00:11:53.336 rmmod nvme_fabrics 00:11:53.336 rmmod nvme_keyring 00:11:53.336 15:12:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:53.336 15:12:51 -- nvmf/common.sh@123 -- # set -e 00:11:53.336 15:12:51 -- nvmf/common.sh@124 -- # return 0 00:11:53.336 15:12:51 -- nvmf/common.sh@477 -- # '[' -n 2709880 ']' 00:11:53.336 15:12:51 -- nvmf/common.sh@478 -- # killprocess 2709880 00:11:53.336 15:12:51 -- common/autotest_common.sh@936 -- # '[' -z 2709880 ']' 00:11:53.336 15:12:51 -- common/autotest_common.sh@940 -- # kill -0 2709880 00:11:53.336 15:12:51 -- common/autotest_common.sh@941 -- # uname 00:11:53.336 15:12:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:53.336 15:12:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2709880 00:11:53.336 15:12:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:53.336 15:12:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:53.336 15:12:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2709880' 00:11:53.336 killing process with pid 2709880 00:11:53.336 15:12:51 -- common/autotest_common.sh@955 -- # kill 2709880 00:11:53.336 15:12:51 -- common/autotest_common.sh@960 -- # wait 2709880 00:11:53.593 15:12:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:53.593 15:12:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:53.593 15:12:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:53.593 15:12:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:53.593 15:12:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:53.593 15:12:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:53.593 15:12:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:53.593 15:12:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.130 15:12:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:56.130 00:11:56.130 real 0m6.598s 00:11:56.130 user 0m9.542s 00:11:56.130 sys 0m1.980s 00:11:56.130 15:12:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:56.130 15:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:56.130 ************************************ 00:11:56.130 END TEST nvmf_multitarget 00:11:56.130 ************************************ 00:11:56.130 15:12:54 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:56.130 15:12:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:56.130 15:12:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:56.130 15:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:56.130 ************************************ 00:11:56.130 START TEST nvmf_rpc 00:11:56.130 ************************************ 00:11:56.130 15:12:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:56.130 * Looking for test storage... 00:11:56.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:56.130 15:12:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:56.130 15:12:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:56.130 15:12:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:56.130 15:12:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:56.130 15:12:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:56.130 15:12:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:56.130 15:12:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:56.130 15:12:54 -- scripts/common.sh@335 -- # IFS=.-: 00:11:56.130 15:12:54 -- scripts/common.sh@335 -- # read -ra ver1 00:11:56.131 15:12:54 -- scripts/common.sh@336 -- # IFS=.-: 00:11:56.131 15:12:54 -- scripts/common.sh@336 -- # read -ra ver2 00:11:56.131 15:12:54 -- scripts/common.sh@337 -- # local 'op=<' 00:11:56.131 15:12:54 -- scripts/common.sh@339 -- # ver1_l=2 00:11:56.131 15:12:54 -- scripts/common.sh@340 -- # ver2_l=1 00:11:56.131 15:12:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:56.131 15:12:54 -- scripts/common.sh@343 -- # case "$op" in 00:11:56.131 15:12:54 -- scripts/common.sh@344 -- # : 1 00:11:56.131 15:12:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:56.131 15:12:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:56.131 15:12:54 -- scripts/common.sh@364 -- # decimal 1 00:11:56.131 15:12:54 -- scripts/common.sh@352 -- # local d=1 00:11:56.131 15:12:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:56.131 15:12:54 -- scripts/common.sh@354 -- # echo 1 00:11:56.131 15:12:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:56.131 15:12:54 -- scripts/common.sh@365 -- # decimal 2 00:11:56.131 15:12:54 -- scripts/common.sh@352 -- # local d=2 00:11:56.131 15:12:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:56.131 15:12:54 -- scripts/common.sh@354 -- # echo 2 00:11:56.131 15:12:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:56.131 15:12:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:56.131 15:12:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:56.131 15:12:54 -- scripts/common.sh@367 -- # return 0 00:11:56.131 15:12:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:56.131 15:12:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:56.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.131 --rc genhtml_branch_coverage=1 00:11:56.131 --rc genhtml_function_coverage=1 00:11:56.131 --rc genhtml_legend=1 00:11:56.131 --rc geninfo_all_blocks=1 00:11:56.131 --rc geninfo_unexecuted_blocks=1 00:11:56.131 00:11:56.131 ' 00:11:56.131 15:12:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:56.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.131 --rc genhtml_branch_coverage=1 00:11:56.131 --rc genhtml_function_coverage=1 00:11:56.131 --rc genhtml_legend=1 00:11:56.131 --rc geninfo_all_blocks=1 00:11:56.131 --rc geninfo_unexecuted_blocks=1 00:11:56.131 00:11:56.131 ' 00:11:56.131 15:12:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:56.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.131 --rc genhtml_branch_coverage=1 00:11:56.131 --rc genhtml_function_coverage=1 00:11:56.131 --rc genhtml_legend=1 00:11:56.131 --rc geninfo_all_blocks=1 00:11:56.131 --rc geninfo_unexecuted_blocks=1 00:11:56.131 00:11:56.131 ' 00:11:56.131 15:12:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:56.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.131 --rc genhtml_branch_coverage=1 00:11:56.131 --rc genhtml_function_coverage=1 00:11:56.131 --rc genhtml_legend=1 00:11:56.131 --rc geninfo_all_blocks=1 00:11:56.131 --rc geninfo_unexecuted_blocks=1 00:11:56.131 00:11:56.131 ' 00:11:56.131 15:12:54 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:56.131 15:12:54 -- nvmf/common.sh@7 -- # uname -s 00:11:56.131 15:12:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.131 15:12:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.131 15:12:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.131 15:12:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.131 15:12:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.131 15:12:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.131 15:12:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.131 15:12:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.131 15:12:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.131 15:12:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.131 15:12:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.131 15:12:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.131 15:12:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.131 15:12:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.131 15:12:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:56.131 15:12:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:56.131 15:12:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.131 15:12:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.131 15:12:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.131 15:12:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.131 15:12:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.131 15:12:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.131 15:12:54 -- paths/export.sh@5 -- # export PATH 00:11:56.131 15:12:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.131 15:12:54 -- nvmf/common.sh@46 -- # : 0 00:11:56.131 15:12:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:56.131 15:12:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:56.131 15:12:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:56.131 15:12:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.131 15:12:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.131 15:12:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:56.131 15:12:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:56.131 15:12:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:56.131 15:12:54 -- target/rpc.sh@11 -- # loops=5 00:11:56.131 15:12:54 -- target/rpc.sh@23 -- # nvmftestinit 00:11:56.131 15:12:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:56.131 15:12:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.131 15:12:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:56.131 15:12:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:56.131 15:12:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:56.131 15:12:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.131 15:12:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.131 15:12:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.131 15:12:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:56.131 15:12:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:56.131 15:12:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:56.131 15:12:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.035 15:12:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:58.035 15:12:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:58.035 15:12:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:58.035 15:12:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:58.035 15:12:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:58.035 15:12:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:58.035 15:12:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:58.035 15:12:56 -- nvmf/common.sh@294 -- # net_devs=() 00:11:58.035 15:12:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:58.035 15:12:56 -- nvmf/common.sh@295 -- # e810=() 00:11:58.035 15:12:56 -- nvmf/common.sh@295 -- # local -ga e810 00:11:58.035 15:12:56 -- nvmf/common.sh@296 -- # x722=() 00:11:58.035 15:12:56 -- nvmf/common.sh@296 -- # local -ga x722 00:11:58.035 15:12:56 -- nvmf/common.sh@297 -- # mlx=() 00:11:58.035 15:12:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:58.035 15:12:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:58.035 15:12:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:58.035 15:12:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:58.035 15:12:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.035 15:12:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:58.035 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:58.035 15:12:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.035 15:12:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:58.035 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:58.035 15:12:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.035 15:12:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.035 15:12:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.035 15:12:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:58.035 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:58.035 15:12:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.035 15:12:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.035 15:12:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.035 15:12:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.035 15:12:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:58.035 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:58.035 15:12:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.035 15:12:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:58.035 15:12:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:58.035 15:12:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:58.035 15:12:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:58.035 15:12:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:58.035 15:12:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:58.035 15:12:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:58.035 15:12:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:58.035 15:12:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:58.036 15:12:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:58.036 15:12:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:58.036 15:12:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:58.036 15:12:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:58.036 15:12:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:58.036 15:12:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:58.036 15:12:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:58.036 15:12:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:58.036 15:12:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:58.036 15:12:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:58.036 15:12:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:58.036 15:12:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:58.036 15:12:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:58.036 15:12:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:58.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:58.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:11:58.036 00:11:58.036 --- 10.0.0.2 ping statistics --- 00:11:58.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.036 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:11:58.036 15:12:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:58.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:58.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:11:58.036 00:11:58.036 --- 10.0.0.1 ping statistics --- 00:11:58.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.036 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:11:58.036 15:12:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:58.036 15:12:56 -- nvmf/common.sh@410 -- # return 0 00:11:58.036 15:12:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:58.036 15:12:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:58.036 15:12:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:58.036 15:12:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:58.036 15:12:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:58.036 15:12:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:58.036 15:12:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:58.036 15:12:56 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:58.036 15:12:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:58.036 15:12:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:58.036 15:12:56 -- common/autotest_common.sh@10 -- # set +x 00:11:58.036 15:12:56 -- nvmf/common.sh@469 -- # nvmfpid=2712141 00:11:58.036 15:12:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:58.036 15:12:56 -- nvmf/common.sh@470 -- # waitforlisten 2712141 00:11:58.036 15:12:56 -- common/autotest_common.sh@829 -- # '[' -z 2712141 ']' 00:11:58.036 15:12:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:58.036 15:12:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:58.036 15:12:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:58.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:58.036 15:12:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:58.036 15:12:56 -- common/autotest_common.sh@10 -- # set +x 00:11:58.036 [2024-11-19 15:12:56.590463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:58.036 [2024-11-19 15:12:56.590530] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:58.296 EAL: No free 2048 kB hugepages reported on node 1 00:11:58.296 [2024-11-19 15:12:56.653580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:58.296 [2024-11-19 15:12:56.768670] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:58.296 [2024-11-19 15:12:56.768817] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:58.296 [2024-11-19 15:12:56.768835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:58.296 [2024-11-19 15:12:56.768847] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:58.296 [2024-11-19 15:12:56.768908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:58.296 [2024-11-19 15:12:56.768937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:58.296 [2024-11-19 15:12:56.769011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:58.296 [2024-11-19 15:12:56.769014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:59.232 15:12:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:59.232 15:12:57 -- common/autotest_common.sh@862 -- # return 0 00:11:59.232 15:12:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:59.232 15:12:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:59.232 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.232 15:12:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:59.232 15:12:57 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:59.232 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.232 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.232 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.232 15:12:57 -- target/rpc.sh@26 -- # stats='{ 00:11:59.232 "tick_rate": 2700000000, 00:11:59.232 "poll_groups": [ 00:11:59.232 { 00:11:59.232 "name": "nvmf_tgt_poll_group_0", 00:11:59.232 "admin_qpairs": 0, 00:11:59.232 "io_qpairs": 0, 00:11:59.232 "current_admin_qpairs": 0, 00:11:59.232 "current_io_qpairs": 0, 00:11:59.232 "pending_bdev_io": 0, 00:11:59.232 "completed_nvme_io": 0, 00:11:59.232 "transports": [] 00:11:59.232 }, 00:11:59.232 { 00:11:59.232 "name": "nvmf_tgt_poll_group_1", 00:11:59.232 "admin_qpairs": 0, 00:11:59.232 "io_qpairs": 0, 00:11:59.232 "current_admin_qpairs": 0, 00:11:59.232 "current_io_qpairs": 0, 00:11:59.232 "pending_bdev_io": 0, 00:11:59.232 "completed_nvme_io": 0, 00:11:59.232 "transports": [] 00:11:59.232 }, 00:11:59.232 { 00:11:59.232 "name": "nvmf_tgt_poll_group_2", 00:11:59.232 "admin_qpairs": 0, 00:11:59.232 "io_qpairs": 0, 00:11:59.232 "current_admin_qpairs": 0, 00:11:59.232 "current_io_qpairs": 0, 00:11:59.232 "pending_bdev_io": 0, 00:11:59.232 "completed_nvme_io": 0, 00:11:59.232 "transports": [] 00:11:59.232 }, 00:11:59.232 { 00:11:59.232 "name": "nvmf_tgt_poll_group_3", 00:11:59.232 "admin_qpairs": 0, 00:11:59.232 "io_qpairs": 0, 00:11:59.232 "current_admin_qpairs": 0, 00:11:59.232 "current_io_qpairs": 0, 00:11:59.232 "pending_bdev_io": 0, 00:11:59.232 "completed_nvme_io": 0, 00:11:59.232 "transports": [] 00:11:59.232 } 00:11:59.232 ] 00:11:59.232 }' 00:11:59.232 15:12:57 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:59.232 15:12:57 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:59.232 15:12:57 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:59.232 15:12:57 -- target/rpc.sh@15 -- # wc -l 00:11:59.232 15:12:57 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:59.232 15:12:57 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:59.232 15:12:57 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:59.233 15:12:57 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:59.233 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.233 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.233 [2024-11-19 15:12:57.711647] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:59.233 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.233 15:12:57 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:59.233 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.233 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.233 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.233 15:12:57 -- target/rpc.sh@33 -- # stats='{ 00:11:59.233 "tick_rate": 2700000000, 00:11:59.233 "poll_groups": [ 00:11:59.233 { 00:11:59.233 "name": "nvmf_tgt_poll_group_0", 00:11:59.233 "admin_qpairs": 0, 00:11:59.233 "io_qpairs": 0, 00:11:59.233 "current_admin_qpairs": 0, 00:11:59.233 "current_io_qpairs": 0, 00:11:59.233 "pending_bdev_io": 0, 00:11:59.233 "completed_nvme_io": 0, 00:11:59.233 "transports": [ 00:11:59.233 { 00:11:59.233 "trtype": "TCP" 00:11:59.233 } 00:11:59.233 ] 00:11:59.233 }, 00:11:59.233 { 00:11:59.233 "name": "nvmf_tgt_poll_group_1", 00:11:59.233 "admin_qpairs": 0, 00:11:59.233 "io_qpairs": 0, 00:11:59.233 "current_admin_qpairs": 0, 00:11:59.233 "current_io_qpairs": 0, 00:11:59.233 "pending_bdev_io": 0, 00:11:59.233 "completed_nvme_io": 0, 00:11:59.233 "transports": [ 00:11:59.233 { 00:11:59.233 "trtype": "TCP" 00:11:59.233 } 00:11:59.233 ] 00:11:59.233 }, 00:11:59.233 { 00:11:59.233 "name": "nvmf_tgt_poll_group_2", 00:11:59.233 "admin_qpairs": 0, 00:11:59.233 "io_qpairs": 0, 00:11:59.233 "current_admin_qpairs": 0, 00:11:59.233 "current_io_qpairs": 0, 00:11:59.233 "pending_bdev_io": 0, 00:11:59.233 "completed_nvme_io": 0, 00:11:59.233 "transports": [ 00:11:59.233 { 00:11:59.233 "trtype": "TCP" 00:11:59.233 } 00:11:59.233 ] 00:11:59.233 }, 00:11:59.233 { 00:11:59.233 "name": "nvmf_tgt_poll_group_3", 00:11:59.233 "admin_qpairs": 0, 00:11:59.233 "io_qpairs": 0, 00:11:59.233 "current_admin_qpairs": 0, 00:11:59.233 "current_io_qpairs": 0, 00:11:59.233 "pending_bdev_io": 0, 00:11:59.233 "completed_nvme_io": 0, 00:11:59.233 "transports": [ 00:11:59.233 { 00:11:59.233 "trtype": "TCP" 00:11:59.233 } 00:11:59.233 ] 00:11:59.233 } 00:11:59.233 ] 00:11:59.233 }' 00:11:59.233 15:12:57 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:59.233 15:12:57 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:59.233 15:12:57 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:59.233 15:12:57 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:59.492 15:12:57 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:59.492 15:12:57 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:59.492 15:12:57 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:59.492 15:12:57 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:59.492 15:12:57 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:59.492 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.492 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.492 Malloc1 00:11:59.492 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.492 15:12:57 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:59.492 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.492 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.492 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.492 15:12:57 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:59.492 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.492 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.492 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.492 15:12:57 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:59.492 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.492 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.492 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.492 15:12:57 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:59.492 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.492 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.492 [2024-11-19 15:12:57.856021] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.492 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.492 15:12:57 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.492 15:12:57 -- common/autotest_common.sh@650 -- # local es=0 00:11:59.492 15:12:57 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.492 15:12:57 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:59.492 15:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:59.492 15:12:57 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:59.492 15:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:59.492 15:12:57 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:59.492 15:12:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:59.492 15:12:57 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:59.492 15:12:57 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:59.492 15:12:57 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.492 [2024-11-19 15:12:57.878466] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:59.492 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:59.492 could not add new controller: failed to write to nvme-fabrics device 00:11:59.493 15:12:57 -- common/autotest_common.sh@653 -- # es=1 00:11:59.493 15:12:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:59.493 15:12:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:59.493 15:12:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:59.493 15:12:57 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.493 15:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.493 15:12:57 -- common/autotest_common.sh@10 -- # set +x 00:11:59.493 15:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.493 15:12:57 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:00.059 15:12:58 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:00.059 15:12:58 -- common/autotest_common.sh@1187 -- # local i=0 00:12:00.059 15:12:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:00.059 15:12:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:00.059 15:12:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.959 15:13:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.959 15:13:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.959 15:13:00 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.959 15:13:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.959 15:13:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.959 15:13:00 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.959 15:13:00 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:02.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.218 15:13:00 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:02.218 15:13:00 -- common/autotest_common.sh@1208 -- # local i=0 00:12:02.218 15:13:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:02.218 15:13:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.218 15:13:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:02.218 15:13:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.218 15:13:00 -- common/autotest_common.sh@1220 -- # return 0 00:12:02.218 15:13:00 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:02.218 15:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.218 15:13:00 -- common/autotest_common.sh@10 -- # set +x 00:12:02.218 15:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.218 15:13:00 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.218 15:13:00 -- common/autotest_common.sh@650 -- # local es=0 00:12:02.218 15:13:00 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.218 15:13:00 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:02.218 15:13:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.218 15:13:00 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:02.218 15:13:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.218 15:13:00 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:02.218 15:13:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:02.218 15:13:00 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:02.218 15:13:00 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:02.218 15:13:00 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.218 [2024-11-19 15:13:00.657415] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:02.218 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:02.218 could not add new controller: failed to write to nvme-fabrics device 00:12:02.218 15:13:00 -- common/autotest_common.sh@653 -- # es=1 00:12:02.218 15:13:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:02.218 15:13:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:02.218 15:13:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:02.218 15:13:00 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:02.218 15:13:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.218 15:13:00 -- common/autotest_common.sh@10 -- # set +x 00:12:02.218 15:13:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.218 15:13:00 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.784 15:13:01 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.784 15:13:01 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.784 15:13:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.784 15:13:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.784 15:13:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:05.314 15:13:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:05.314 15:13:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:05.314 15:13:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:05.314 15:13:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:05.314 15:13:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:05.314 15:13:03 -- common/autotest_common.sh@1197 -- # return 0 00:12:05.315 15:13:03 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:05.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.315 15:13:03 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:05.315 15:13:03 -- common/autotest_common.sh@1208 -- # local i=0 00:12:05.315 15:13:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:05.315 15:13:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.315 15:13:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:05.315 15:13:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.315 15:13:03 -- common/autotest_common.sh@1220 -- # return 0 00:12:05.315 15:13:03 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:05.315 15:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.315 15:13:03 -- common/autotest_common.sh@10 -- # set +x 00:12:05.315 15:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.315 15:13:03 -- target/rpc.sh@81 -- # seq 1 5 00:12:05.315 15:13:03 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:05.315 15:13:03 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:05.315 15:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.315 15:13:03 -- common/autotest_common.sh@10 -- # set +x 00:12:05.315 15:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.315 15:13:03 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:05.315 15:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.315 15:13:03 -- common/autotest_common.sh@10 -- # set +x 00:12:05.315 [2024-11-19 15:13:03.437902] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:05.315 15:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.315 15:13:03 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:05.315 15:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.315 15:13:03 -- common/autotest_common.sh@10 -- # set +x 00:12:05.315 15:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.315 15:13:03 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:05.315 15:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.315 15:13:03 -- common/autotest_common.sh@10 -- # set +x 00:12:05.315 15:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.315 15:13:03 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.574 15:13:04 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:05.574 15:13:04 -- common/autotest_common.sh@1187 -- # local i=0 00:12:05.574 15:13:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:05.574 15:13:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:05.574 15:13:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:08.103 15:13:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:08.103 15:13:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:08.103 15:13:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:08.103 15:13:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:08.103 15:13:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:08.103 15:13:06 -- common/autotest_common.sh@1197 -- # return 0 00:12:08.103 15:13:06 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:08.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.103 15:13:06 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:08.103 15:13:06 -- common/autotest_common.sh@1208 -- # local i=0 00:12:08.103 15:13:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:08.103 15:13:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.103 15:13:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:08.103 15:13:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.103 15:13:06 -- common/autotest_common.sh@1220 -- # return 0 00:12:08.103 15:13:06 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:08.103 15:13:06 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 [2024-11-19 15:13:06.201993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.103 15:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.103 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:12:08.103 15:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.103 15:13:06 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.362 15:13:06 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.362 15:13:06 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.362 15:13:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.362 15:13:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.362 15:13:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:10.889 15:13:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:10.889 15:13:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:10.889 15:13:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.889 15:13:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:10.889 15:13:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.889 15:13:08 -- common/autotest_common.sh@1197 -- # return 0 00:12:10.889 15:13:08 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.889 15:13:09 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.889 15:13:09 -- common/autotest_common.sh@1208 -- # local i=0 00:12:10.889 15:13:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:10.890 15:13:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.890 15:13:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:10.890 15:13:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.890 15:13:09 -- common/autotest_common.sh@1220 -- # return 0 00:12:10.890 15:13:09 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:10.890 15:13:09 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 [2024-11-19 15:13:09.055814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.890 15:13:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.890 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:12:10.890 15:13:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.890 15:13:09 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:11.147 15:13:09 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:11.147 15:13:09 -- common/autotest_common.sh@1187 -- # local i=0 00:12:11.147 15:13:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:11.147 15:13:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:11.147 15:13:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:13.675 15:13:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:13.675 15:13:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:13.675 15:13:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:13.675 15:13:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:13.675 15:13:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:13.675 15:13:11 -- common/autotest_common.sh@1197 -- # return 0 00:12:13.675 15:13:11 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:13.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.675 15:13:11 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:13.675 15:13:11 -- common/autotest_common.sh@1208 -- # local i=0 00:12:13.675 15:13:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:13.675 15:13:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.675 15:13:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:13.675 15:13:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.675 15:13:11 -- common/autotest_common.sh@1220 -- # return 0 00:12:13.675 15:13:11 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:13.675 15:13:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 [2024-11-19 15:13:11.783804] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:13.675 15:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.675 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:13.675 15:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.675 15:13:11 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:13.933 15:13:12 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:13.933 15:13:12 -- common/autotest_common.sh@1187 -- # local i=0 00:12:13.933 15:13:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:13.933 15:13:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:13.933 15:13:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:16.459 15:13:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:16.459 15:13:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:16.459 15:13:14 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:16.459 15:13:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:16.459 15:13:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:16.459 15:13:14 -- common/autotest_common.sh@1197 -- # return 0 00:12:16.459 15:13:14 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:16.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.459 15:13:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:16.459 15:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:12:16.459 15:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:16.459 15:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.459 15:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:16.459 15:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.459 15:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:12:16.459 15:13:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:16.459 15:13:14 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 [2024-11-19 15:13:14.639641] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:16.459 15:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.459 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:12:16.459 15:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.459 15:13:14 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:16.717 15:13:15 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:16.717 15:13:15 -- common/autotest_common.sh@1187 -- # local i=0 00:12:16.717 15:13:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:16.717 15:13:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:16.717 15:13:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:19.244 15:13:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:19.244 15:13:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:19.244 15:13:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:19.244 15:13:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.244 15:13:17 -- common/autotest_common.sh@1197 -- # return 0 00:12:19.244 15:13:17 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.244 15:13:17 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@1208 -- # local i=0 00:12:19.244 15:13:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:19.244 15:13:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:19.244 15:13:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@1220 -- # return 0 00:12:19.244 15:13:17 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@99 -- # seq 1 5 00:12:19.244 15:13:17 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.244 15:13:17 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 [2024-11-19 15:13:17.370734] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.244 15:13:17 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 [2024-11-19 15:13:17.418812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.244 15:13:17 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 [2024-11-19 15:13:17.467010] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.244 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.244 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.244 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.244 15:13:17 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.245 15:13:17 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 [2024-11-19 15:13:17.515177] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.245 15:13:17 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 [2024-11-19 15:13:17.563338] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:19.245 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.245 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:19.245 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.245 15:13:17 -- target/rpc.sh@110 -- # stats='{ 00:12:19.245 "tick_rate": 2700000000, 00:12:19.245 "poll_groups": [ 00:12:19.245 { 00:12:19.245 "name": "nvmf_tgt_poll_group_0", 00:12:19.245 "admin_qpairs": 2, 00:12:19.245 "io_qpairs": 84, 00:12:19.245 "current_admin_qpairs": 0, 00:12:19.245 "current_io_qpairs": 0, 00:12:19.245 "pending_bdev_io": 0, 00:12:19.245 "completed_nvme_io": 185, 00:12:19.245 "transports": [ 00:12:19.245 { 00:12:19.245 "trtype": "TCP" 00:12:19.245 } 00:12:19.245 ] 00:12:19.245 }, 00:12:19.245 { 00:12:19.245 "name": "nvmf_tgt_poll_group_1", 00:12:19.245 "admin_qpairs": 2, 00:12:19.245 "io_qpairs": 84, 00:12:19.245 "current_admin_qpairs": 0, 00:12:19.245 "current_io_qpairs": 0, 00:12:19.245 "pending_bdev_io": 0, 00:12:19.245 "completed_nvme_io": 282, 00:12:19.245 "transports": [ 00:12:19.245 { 00:12:19.245 "trtype": "TCP" 00:12:19.245 } 00:12:19.245 ] 00:12:19.245 }, 00:12:19.245 { 00:12:19.245 "name": "nvmf_tgt_poll_group_2", 00:12:19.245 "admin_qpairs": 1, 00:12:19.245 "io_qpairs": 84, 00:12:19.245 "current_admin_qpairs": 0, 00:12:19.245 "current_io_qpairs": 0, 00:12:19.245 "pending_bdev_io": 0, 00:12:19.245 "completed_nvme_io": 85, 00:12:19.245 "transports": [ 00:12:19.245 { 00:12:19.245 "trtype": "TCP" 00:12:19.245 } 00:12:19.245 ] 00:12:19.245 }, 00:12:19.245 { 00:12:19.245 "name": "nvmf_tgt_poll_group_3", 00:12:19.245 "admin_qpairs": 2, 00:12:19.245 "io_qpairs": 84, 00:12:19.245 "current_admin_qpairs": 0, 00:12:19.245 "current_io_qpairs": 0, 00:12:19.245 "pending_bdev_io": 0, 00:12:19.245 "completed_nvme_io": 134, 00:12:19.245 "transports": [ 00:12:19.245 { 00:12:19.245 "trtype": "TCP" 00:12:19.245 } 00:12:19.245 ] 00:12:19.245 } 00:12:19.245 ] 00:12:19.245 }' 00:12:19.245 15:13:17 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.245 15:13:17 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:19.245 15:13:17 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:19.245 15:13:17 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.245 15:13:17 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:19.245 15:13:17 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:19.245 15:13:17 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:19.245 15:13:17 -- target/rpc.sh@123 -- # nvmftestfini 00:12:19.245 15:13:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:19.245 15:13:17 -- nvmf/common.sh@116 -- # sync 00:12:19.245 15:13:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:19.245 15:13:17 -- nvmf/common.sh@119 -- # set +e 00:12:19.245 15:13:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:19.245 15:13:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:19.245 rmmod nvme_tcp 00:12:19.245 rmmod nvme_fabrics 00:12:19.245 rmmod nvme_keyring 00:12:19.245 15:13:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:19.245 15:13:17 -- nvmf/common.sh@123 -- # set -e 00:12:19.245 15:13:17 -- nvmf/common.sh@124 -- # return 0 00:12:19.245 15:13:17 -- nvmf/common.sh@477 -- # '[' -n 2712141 ']' 00:12:19.245 15:13:17 -- nvmf/common.sh@478 -- # killprocess 2712141 00:12:19.245 15:13:17 -- common/autotest_common.sh@936 -- # '[' -z 2712141 ']' 00:12:19.245 15:13:17 -- common/autotest_common.sh@940 -- # kill -0 2712141 00:12:19.245 15:13:17 -- common/autotest_common.sh@941 -- # uname 00:12:19.245 15:13:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:19.245 15:13:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2712141 00:12:19.504 15:13:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:19.504 15:13:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:19.504 15:13:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2712141' 00:12:19.504 killing process with pid 2712141 00:12:19.504 15:13:17 -- common/autotest_common.sh@955 -- # kill 2712141 00:12:19.504 15:13:17 -- common/autotest_common.sh@960 -- # wait 2712141 00:12:19.763 15:13:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:19.763 15:13:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:19.763 15:13:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:19.763 15:13:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:19.763 15:13:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:19.763 15:13:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:19.763 15:13:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:19.763 15:13:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:21.669 15:13:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:21.669 00:12:21.669 real 0m26.062s 00:12:21.669 user 1m24.916s 00:12:21.669 sys 0m4.083s 00:12:21.669 15:13:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:21.669 15:13:20 -- common/autotest_common.sh@10 -- # set +x 00:12:21.669 ************************************ 00:12:21.669 END TEST nvmf_rpc 00:12:21.669 ************************************ 00:12:21.669 15:13:20 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:21.669 15:13:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:21.669 15:13:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:21.669 15:13:20 -- common/autotest_common.sh@10 -- # set +x 00:12:21.669 ************************************ 00:12:21.669 START TEST nvmf_invalid 00:12:21.669 ************************************ 00:12:21.669 15:13:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:21.928 * Looking for test storage... 00:12:21.928 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:21.928 15:13:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:21.928 15:13:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:21.928 15:13:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:21.928 15:13:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:21.928 15:13:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:21.928 15:13:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:21.928 15:13:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:21.928 15:13:20 -- scripts/common.sh@335 -- # IFS=.-: 00:12:21.928 15:13:20 -- scripts/common.sh@335 -- # read -ra ver1 00:12:21.928 15:13:20 -- scripts/common.sh@336 -- # IFS=.-: 00:12:21.928 15:13:20 -- scripts/common.sh@336 -- # read -ra ver2 00:12:21.928 15:13:20 -- scripts/common.sh@337 -- # local 'op=<' 00:12:21.928 15:13:20 -- scripts/common.sh@339 -- # ver1_l=2 00:12:21.928 15:13:20 -- scripts/common.sh@340 -- # ver2_l=1 00:12:21.928 15:13:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:21.928 15:13:20 -- scripts/common.sh@343 -- # case "$op" in 00:12:21.928 15:13:20 -- scripts/common.sh@344 -- # : 1 00:12:21.928 15:13:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:21.928 15:13:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:21.928 15:13:20 -- scripts/common.sh@364 -- # decimal 1 00:12:21.928 15:13:20 -- scripts/common.sh@352 -- # local d=1 00:12:21.928 15:13:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:21.928 15:13:20 -- scripts/common.sh@354 -- # echo 1 00:12:21.928 15:13:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:21.928 15:13:20 -- scripts/common.sh@365 -- # decimal 2 00:12:21.928 15:13:20 -- scripts/common.sh@352 -- # local d=2 00:12:21.928 15:13:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:21.928 15:13:20 -- scripts/common.sh@354 -- # echo 2 00:12:21.928 15:13:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:21.928 15:13:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:21.928 15:13:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:21.928 15:13:20 -- scripts/common.sh@367 -- # return 0 00:12:21.928 15:13:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:21.928 15:13:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:21.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:21.928 --rc genhtml_branch_coverage=1 00:12:21.928 --rc genhtml_function_coverage=1 00:12:21.928 --rc genhtml_legend=1 00:12:21.928 --rc geninfo_all_blocks=1 00:12:21.928 --rc geninfo_unexecuted_blocks=1 00:12:21.928 00:12:21.928 ' 00:12:21.928 15:13:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:21.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:21.928 --rc genhtml_branch_coverage=1 00:12:21.928 --rc genhtml_function_coverage=1 00:12:21.928 --rc genhtml_legend=1 00:12:21.928 --rc geninfo_all_blocks=1 00:12:21.928 --rc geninfo_unexecuted_blocks=1 00:12:21.928 00:12:21.928 ' 00:12:21.928 15:13:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:21.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:21.928 --rc genhtml_branch_coverage=1 00:12:21.928 --rc genhtml_function_coverage=1 00:12:21.928 --rc genhtml_legend=1 00:12:21.928 --rc geninfo_all_blocks=1 00:12:21.928 --rc geninfo_unexecuted_blocks=1 00:12:21.928 00:12:21.928 ' 00:12:21.928 15:13:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:21.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:21.928 --rc genhtml_branch_coverage=1 00:12:21.928 --rc genhtml_function_coverage=1 00:12:21.928 --rc genhtml_legend=1 00:12:21.929 --rc geninfo_all_blocks=1 00:12:21.929 --rc geninfo_unexecuted_blocks=1 00:12:21.929 00:12:21.929 ' 00:12:21.929 15:13:20 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:21.929 15:13:20 -- nvmf/common.sh@7 -- # uname -s 00:12:21.929 15:13:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:21.929 15:13:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:21.929 15:13:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:21.929 15:13:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:21.929 15:13:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:21.929 15:13:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:21.929 15:13:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:21.929 15:13:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:21.929 15:13:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:21.929 15:13:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:21.929 15:13:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:21.929 15:13:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:21.929 15:13:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:21.929 15:13:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:21.929 15:13:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:21.929 15:13:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:21.929 15:13:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:21.929 15:13:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:21.929 15:13:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:21.929 15:13:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:21.929 15:13:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:21.929 15:13:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:21.929 15:13:20 -- paths/export.sh@5 -- # export PATH 00:12:21.929 15:13:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:21.929 15:13:20 -- nvmf/common.sh@46 -- # : 0 00:12:21.929 15:13:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:21.929 15:13:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:21.929 15:13:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:21.929 15:13:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:21.929 15:13:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:21.929 15:13:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:21.929 15:13:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:21.929 15:13:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:21.929 15:13:20 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:21.929 15:13:20 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:21.929 15:13:20 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:21.929 15:13:20 -- target/invalid.sh@14 -- # target=foobar 00:12:21.929 15:13:20 -- target/invalid.sh@16 -- # RANDOM=0 00:12:21.929 15:13:20 -- target/invalid.sh@34 -- # nvmftestinit 00:12:21.929 15:13:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:21.929 15:13:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:21.929 15:13:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:21.929 15:13:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:21.929 15:13:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:21.929 15:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:21.929 15:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:21.929 15:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:21.929 15:13:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:21.929 15:13:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:21.929 15:13:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:21.929 15:13:20 -- common/autotest_common.sh@10 -- # set +x 00:12:24.460 15:13:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:24.460 15:13:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:24.460 15:13:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:24.460 15:13:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:24.460 15:13:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:24.460 15:13:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:24.460 15:13:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:24.460 15:13:22 -- nvmf/common.sh@294 -- # net_devs=() 00:12:24.460 15:13:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:24.460 15:13:22 -- nvmf/common.sh@295 -- # e810=() 00:12:24.460 15:13:22 -- nvmf/common.sh@295 -- # local -ga e810 00:12:24.460 15:13:22 -- nvmf/common.sh@296 -- # x722=() 00:12:24.460 15:13:22 -- nvmf/common.sh@296 -- # local -ga x722 00:12:24.460 15:13:22 -- nvmf/common.sh@297 -- # mlx=() 00:12:24.460 15:13:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:24.460 15:13:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.460 15:13:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.461 15:13:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.461 15:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:24.461 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:24.461 15:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.461 15:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:24.461 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:24.461 15:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.461 15:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.461 15:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.461 15:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:24.461 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:24.461 15:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.461 15:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.461 15:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.461 15:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:24.461 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:24.461 15:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:24.461 15:13:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:24.461 15:13:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:24.461 15:13:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:24.461 15:13:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:24.461 15:13:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:24.461 15:13:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:24.461 15:13:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:24.461 15:13:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:24.461 15:13:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:24.461 15:13:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:24.461 15:13:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:24.461 15:13:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:24.461 15:13:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:24.461 15:13:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:24.461 15:13:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:24.461 15:13:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:24.461 15:13:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:24.461 15:13:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:24.461 15:13:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:24.461 15:13:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:24.461 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:24.461 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:12:24.461 00:12:24.461 --- 10.0.0.2 ping statistics --- 00:12:24.461 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.461 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:12:24.461 15:13:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:24.461 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:24.461 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:12:24.461 00:12:24.461 --- 10.0.0.1 ping statistics --- 00:12:24.461 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.461 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:12:24.461 15:13:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:24.461 15:13:22 -- nvmf/common.sh@410 -- # return 0 00:12:24.461 15:13:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:24.461 15:13:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:24.461 15:13:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:24.461 15:13:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:24.461 15:13:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:24.461 15:13:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:24.461 15:13:22 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:24.461 15:13:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:24.461 15:13:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:24.461 15:13:22 -- common/autotest_common.sh@10 -- # set +x 00:12:24.461 15:13:22 -- nvmf/common.sh@469 -- # nvmfpid=2716850 00:12:24.461 15:13:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:24.461 15:13:22 -- nvmf/common.sh@470 -- # waitforlisten 2716850 00:12:24.461 15:13:22 -- common/autotest_common.sh@829 -- # '[' -z 2716850 ']' 00:12:24.461 15:13:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.461 15:13:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:24.461 15:13:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.461 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.461 15:13:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:24.461 15:13:22 -- common/autotest_common.sh@10 -- # set +x 00:12:24.461 [2024-11-19 15:13:22.627406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:24.461 [2024-11-19 15:13:22.627501] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.461 EAL: No free 2048 kB hugepages reported on node 1 00:12:24.461 [2024-11-19 15:13:22.697128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:24.461 [2024-11-19 15:13:22.819241] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:24.461 [2024-11-19 15:13:22.819408] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.461 [2024-11-19 15:13:22.819428] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.461 [2024-11-19 15:13:22.819444] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.461 [2024-11-19 15:13:22.820589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:24.461 [2024-11-19 15:13:22.820683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:24.461 [2024-11-19 15:13:22.820747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:24.461 [2024-11-19 15:13:22.820752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:25.394 15:13:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:25.394 15:13:23 -- common/autotest_common.sh@862 -- # return 0 00:12:25.394 15:13:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:25.394 15:13:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:25.394 15:13:23 -- common/autotest_common.sh@10 -- # set +x 00:12:25.394 15:13:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:25.394 15:13:23 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:25.394 15:13:23 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode15410 00:12:25.652 [2024-11-19 15:13:23.964310] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:25.652 15:13:23 -- target/invalid.sh@40 -- # out='request: 00:12:25.652 { 00:12:25.652 "nqn": "nqn.2016-06.io.spdk:cnode15410", 00:12:25.652 "tgt_name": "foobar", 00:12:25.652 "method": "nvmf_create_subsystem", 00:12:25.652 "req_id": 1 00:12:25.652 } 00:12:25.652 Got JSON-RPC error response 00:12:25.652 response: 00:12:25.652 { 00:12:25.652 "code": -32603, 00:12:25.652 "message": "Unable to find target foobar" 00:12:25.652 }' 00:12:25.652 15:13:23 -- target/invalid.sh@41 -- # [[ request: 00:12:25.652 { 00:12:25.652 "nqn": "nqn.2016-06.io.spdk:cnode15410", 00:12:25.652 "tgt_name": "foobar", 00:12:25.652 "method": "nvmf_create_subsystem", 00:12:25.652 "req_id": 1 00:12:25.652 } 00:12:25.652 Got JSON-RPC error response 00:12:25.652 response: 00:12:25.652 { 00:12:25.652 "code": -32603, 00:12:25.652 "message": "Unable to find target foobar" 00:12:25.652 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:25.652 15:13:23 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:25.653 15:13:23 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode21511 00:12:25.911 [2024-11-19 15:13:24.229208] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21511: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:25.911 15:13:24 -- target/invalid.sh@45 -- # out='request: 00:12:25.911 { 00:12:25.911 "nqn": "nqn.2016-06.io.spdk:cnode21511", 00:12:25.911 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:25.911 "method": "nvmf_create_subsystem", 00:12:25.911 "req_id": 1 00:12:25.911 } 00:12:25.911 Got JSON-RPC error response 00:12:25.911 response: 00:12:25.911 { 00:12:25.911 "code": -32602, 00:12:25.911 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:25.911 }' 00:12:25.911 15:13:24 -- target/invalid.sh@46 -- # [[ request: 00:12:25.911 { 00:12:25.911 "nqn": "nqn.2016-06.io.spdk:cnode21511", 00:12:25.911 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:25.911 "method": "nvmf_create_subsystem", 00:12:25.911 "req_id": 1 00:12:25.911 } 00:12:25.911 Got JSON-RPC error response 00:12:25.911 response: 00:12:25.911 { 00:12:25.911 "code": -32602, 00:12:25.911 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:25.911 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:25.911 15:13:24 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:25.911 15:13:24 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode11099 00:12:26.169 [2024-11-19 15:13:24.482013] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11099: invalid model number 'SPDK_Controller' 00:12:26.169 15:13:24 -- target/invalid.sh@50 -- # out='request: 00:12:26.169 { 00:12:26.169 "nqn": "nqn.2016-06.io.spdk:cnode11099", 00:12:26.169 "model_number": "SPDK_Controller\u001f", 00:12:26.169 "method": "nvmf_create_subsystem", 00:12:26.169 "req_id": 1 00:12:26.169 } 00:12:26.169 Got JSON-RPC error response 00:12:26.169 response: 00:12:26.169 { 00:12:26.169 "code": -32602, 00:12:26.169 "message": "Invalid MN SPDK_Controller\u001f" 00:12:26.169 }' 00:12:26.169 15:13:24 -- target/invalid.sh@51 -- # [[ request: 00:12:26.169 { 00:12:26.169 "nqn": "nqn.2016-06.io.spdk:cnode11099", 00:12:26.169 "model_number": "SPDK_Controller\u001f", 00:12:26.169 "method": "nvmf_create_subsystem", 00:12:26.169 "req_id": 1 00:12:26.169 } 00:12:26.169 Got JSON-RPC error response 00:12:26.169 response: 00:12:26.169 { 00:12:26.169 "code": -32602, 00:12:26.169 "message": "Invalid MN SPDK_Controller\u001f" 00:12:26.169 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:26.169 15:13:24 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:26.169 15:13:24 -- target/invalid.sh@19 -- # local length=21 ll 00:12:26.169 15:13:24 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:26.169 15:13:24 -- target/invalid.sh@21 -- # local chars 00:12:26.169 15:13:24 -- target/invalid.sh@22 -- # local string 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 77 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=M 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 75 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=K 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 79 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=O 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 39 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=\' 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 51 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=3 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 42 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+='*' 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 124 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+='|' 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 43 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=+ 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # printf %x 41 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:26.169 15:13:24 -- target/invalid.sh@25 -- # string+=')' 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.169 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 85 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=U 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 108 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=l 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 38 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+='&' 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 91 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+='[' 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 89 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=Y 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 38 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+='&' 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 85 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=U 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 110 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=n 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 120 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=x 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 48 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+=0 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 125 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+='}' 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # printf %x 91 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:26.170 15:13:24 -- target/invalid.sh@25 -- # string+='[' 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.170 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.170 15:13:24 -- target/invalid.sh@28 -- # [[ M == \- ]] 00:12:26.170 15:13:24 -- target/invalid.sh@31 -- # echo 'MKO'\''3*|+)Ul&[Y&Unx0}[' 00:12:26.170 15:13:24 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'MKO'\''3*|+)Ul&[Y&Unx0}[' nqn.2016-06.io.spdk:cnode17440 00:12:26.428 [2024-11-19 15:13:24.807045] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17440: invalid serial number 'MKO'3*|+)Ul&[Y&Unx0}[' 00:12:26.428 15:13:24 -- target/invalid.sh@54 -- # out='request: 00:12:26.428 { 00:12:26.428 "nqn": "nqn.2016-06.io.spdk:cnode17440", 00:12:26.428 "serial_number": "MKO'\''3*|+)Ul&[Y&Unx0}[", 00:12:26.428 "method": "nvmf_create_subsystem", 00:12:26.428 "req_id": 1 00:12:26.428 } 00:12:26.428 Got JSON-RPC error response 00:12:26.428 response: 00:12:26.428 { 00:12:26.428 "code": -32602, 00:12:26.428 "message": "Invalid SN MKO'\''3*|+)Ul&[Y&Unx0}[" 00:12:26.428 }' 00:12:26.428 15:13:24 -- target/invalid.sh@55 -- # [[ request: 00:12:26.428 { 00:12:26.428 "nqn": "nqn.2016-06.io.spdk:cnode17440", 00:12:26.428 "serial_number": "MKO'3*|+)Ul&[Y&Unx0}[", 00:12:26.428 "method": "nvmf_create_subsystem", 00:12:26.428 "req_id": 1 00:12:26.428 } 00:12:26.428 Got JSON-RPC error response 00:12:26.428 response: 00:12:26.428 { 00:12:26.428 "code": -32602, 00:12:26.428 "message": "Invalid SN MKO'3*|+)Ul&[Y&Unx0}[" 00:12:26.428 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:26.428 15:13:24 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:26.428 15:13:24 -- target/invalid.sh@19 -- # local length=41 ll 00:12:26.428 15:13:24 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:26.428 15:13:24 -- target/invalid.sh@21 -- # local chars 00:12:26.428 15:13:24 -- target/invalid.sh@22 -- # local string 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 36 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+='$' 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 121 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=y 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 110 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=n 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 104 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=h 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 79 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=O 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 114 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=r 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 112 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=p 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 112 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=p 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 41 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=')' 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 34 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+='"' 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # printf %x 56 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:26.428 15:13:24 -- target/invalid.sh@25 -- # string+=8 00:12:26.428 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 37 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=% 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 81 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=Q 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 94 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='^' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 39 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=\' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 60 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='<' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 92 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='\' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 35 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='#' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 39 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=\' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 65 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=A 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 98 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=b 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 80 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=P 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 64 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=@ 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 94 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='^' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 33 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='!' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 117 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=u 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 92 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='\' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 54 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=6 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 112 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=p 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 33 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='!' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 96 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='`' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 94 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='^' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 124 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+='|' 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 103 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=g 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 53 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=5 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 72 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=H 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 103 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=g 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 119 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=w 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.429 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # printf %x 81 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:26.429 15:13:24 -- target/invalid.sh@25 -- # string+=Q 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # printf %x 50 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # string+=2 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # printf %x 33 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:26.430 15:13:24 -- target/invalid.sh@25 -- # string+='!' 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.430 15:13:24 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.430 15:13:24 -- target/invalid.sh@28 -- # [[ $ == \- ]] 00:12:26.430 15:13:24 -- target/invalid.sh@31 -- # echo '$ynhOrpp)"8%Q^'\''<\#'\''AbP@^!u\6p!`^|g5HgwQ2!' 00:12:26.430 15:13:24 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '$ynhOrpp)"8%Q^'\''<\#'\''AbP@^!u\6p!`^|g5HgwQ2!' nqn.2016-06.io.spdk:cnode25812 00:12:26.687 [2024-11-19 15:13:25.240448] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25812: invalid model number '$ynhOrpp)"8%Q^'<\#'AbP@^!u\6p!`^|g5HgwQ2!' 00:12:26.946 15:13:25 -- target/invalid.sh@58 -- # out='request: 00:12:26.946 { 00:12:26.946 "nqn": "nqn.2016-06.io.spdk:cnode25812", 00:12:26.946 "model_number": "$ynhOrpp)\"8%Q^'\''<\\#'\''AbP@^!u\\6p!`^|g5HgwQ2!", 00:12:26.946 "method": "nvmf_create_subsystem", 00:12:26.946 "req_id": 1 00:12:26.946 } 00:12:26.946 Got JSON-RPC error response 00:12:26.946 response: 00:12:26.946 { 00:12:26.946 "code": -32602, 00:12:26.946 "message": "Invalid MN $ynhOrpp)\"8%Q^'\''<\\#'\''AbP@^!u\\6p!`^|g5HgwQ2!" 00:12:26.946 }' 00:12:26.946 15:13:25 -- target/invalid.sh@59 -- # [[ request: 00:12:26.946 { 00:12:26.946 "nqn": "nqn.2016-06.io.spdk:cnode25812", 00:12:26.946 "model_number": "$ynhOrpp)\"8%Q^'<\\#'AbP@^!u\\6p!`^|g5HgwQ2!", 00:12:26.946 "method": "nvmf_create_subsystem", 00:12:26.946 "req_id": 1 00:12:26.946 } 00:12:26.946 Got JSON-RPC error response 00:12:26.946 response: 00:12:26.946 { 00:12:26.946 "code": -32602, 00:12:26.946 "message": "Invalid MN $ynhOrpp)\"8%Q^'<\\#'AbP@^!u\\6p!`^|g5HgwQ2!" 00:12:26.946 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:26.946 15:13:25 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:26.946 [2024-11-19 15:13:25.493367] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:27.204 15:13:25 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:27.204 15:13:25 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:27.462 15:13:25 -- target/invalid.sh@67 -- # echo '' 00:12:27.462 15:13:25 -- target/invalid.sh@67 -- # head -n 1 00:12:27.462 15:13:25 -- target/invalid.sh@67 -- # IP= 00:12:27.462 15:13:25 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:27.462 [2024-11-19 15:13:25.991094] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:27.462 15:13:26 -- target/invalid.sh@69 -- # out='request: 00:12:27.462 { 00:12:27.462 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:27.462 "listen_address": { 00:12:27.462 "trtype": "tcp", 00:12:27.462 "traddr": "", 00:12:27.462 "trsvcid": "4421" 00:12:27.462 }, 00:12:27.462 "method": "nvmf_subsystem_remove_listener", 00:12:27.462 "req_id": 1 00:12:27.462 } 00:12:27.462 Got JSON-RPC error response 00:12:27.462 response: 00:12:27.462 { 00:12:27.462 "code": -32602, 00:12:27.462 "message": "Invalid parameters" 00:12:27.462 }' 00:12:27.462 15:13:26 -- target/invalid.sh@70 -- # [[ request: 00:12:27.462 { 00:12:27.462 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:27.462 "listen_address": { 00:12:27.462 "trtype": "tcp", 00:12:27.462 "traddr": "", 00:12:27.462 "trsvcid": "4421" 00:12:27.462 }, 00:12:27.462 "method": "nvmf_subsystem_remove_listener", 00:12:27.462 "req_id": 1 00:12:27.462 } 00:12:27.462 Got JSON-RPC error response 00:12:27.462 response: 00:12:27.462 { 00:12:27.462 "code": -32602, 00:12:27.462 "message": "Invalid parameters" 00:12:27.462 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:27.462 15:13:26 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4329 -i 0 00:12:27.720 [2024-11-19 15:13:26.259875] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4329: invalid cntlid range [0-65519] 00:12:27.720 15:13:26 -- target/invalid.sh@73 -- # out='request: 00:12:27.720 { 00:12:27.720 "nqn": "nqn.2016-06.io.spdk:cnode4329", 00:12:27.720 "min_cntlid": 0, 00:12:27.720 "method": "nvmf_create_subsystem", 00:12:27.720 "req_id": 1 00:12:27.720 } 00:12:27.720 Got JSON-RPC error response 00:12:27.720 response: 00:12:27.720 { 00:12:27.720 "code": -32602, 00:12:27.720 "message": "Invalid cntlid range [0-65519]" 00:12:27.720 }' 00:12:27.720 15:13:26 -- target/invalid.sh@74 -- # [[ request: 00:12:27.720 { 00:12:27.720 "nqn": "nqn.2016-06.io.spdk:cnode4329", 00:12:27.720 "min_cntlid": 0, 00:12:27.720 "method": "nvmf_create_subsystem", 00:12:27.720 "req_id": 1 00:12:27.720 } 00:12:27.720 Got JSON-RPC error response 00:12:27.720 response: 00:12:27.720 { 00:12:27.720 "code": -32602, 00:12:27.720 "message": "Invalid cntlid range [0-65519]" 00:12:27.720 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:27.978 15:13:26 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24759 -i 65520 00:12:27.978 [2024-11-19 15:13:26.516767] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24759: invalid cntlid range [65520-65519] 00:12:27.978 15:13:26 -- target/invalid.sh@75 -- # out='request: 00:12:27.978 { 00:12:27.978 "nqn": "nqn.2016-06.io.spdk:cnode24759", 00:12:27.978 "min_cntlid": 65520, 00:12:27.978 "method": "nvmf_create_subsystem", 00:12:27.978 "req_id": 1 00:12:27.978 } 00:12:27.978 Got JSON-RPC error response 00:12:27.978 response: 00:12:27.978 { 00:12:27.978 "code": -32602, 00:12:27.978 "message": "Invalid cntlid range [65520-65519]" 00:12:27.978 }' 00:12:27.978 15:13:26 -- target/invalid.sh@76 -- # [[ request: 00:12:27.978 { 00:12:27.978 "nqn": "nqn.2016-06.io.spdk:cnode24759", 00:12:27.978 "min_cntlid": 65520, 00:12:27.978 "method": "nvmf_create_subsystem", 00:12:27.978 "req_id": 1 00:12:27.978 } 00:12:27.978 Got JSON-RPC error response 00:12:27.978 response: 00:12:27.978 { 00:12:27.978 "code": -32602, 00:12:27.978 "message": "Invalid cntlid range [65520-65519]" 00:12:27.978 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:27.978 15:13:26 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18084 -I 0 00:12:28.236 [2024-11-19 15:13:26.761566] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18084: invalid cntlid range [1-0] 00:12:28.236 15:13:26 -- target/invalid.sh@77 -- # out='request: 00:12:28.236 { 00:12:28.236 "nqn": "nqn.2016-06.io.spdk:cnode18084", 00:12:28.236 "max_cntlid": 0, 00:12:28.236 "method": "nvmf_create_subsystem", 00:12:28.236 "req_id": 1 00:12:28.236 } 00:12:28.236 Got JSON-RPC error response 00:12:28.236 response: 00:12:28.236 { 00:12:28.236 "code": -32602, 00:12:28.236 "message": "Invalid cntlid range [1-0]" 00:12:28.236 }' 00:12:28.236 15:13:26 -- target/invalid.sh@78 -- # [[ request: 00:12:28.236 { 00:12:28.236 "nqn": "nqn.2016-06.io.spdk:cnode18084", 00:12:28.236 "max_cntlid": 0, 00:12:28.236 "method": "nvmf_create_subsystem", 00:12:28.236 "req_id": 1 00:12:28.236 } 00:12:28.236 Got JSON-RPC error response 00:12:28.236 response: 00:12:28.236 { 00:12:28.236 "code": -32602, 00:12:28.236 "message": "Invalid cntlid range [1-0]" 00:12:28.236 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.236 15:13:26 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30983 -I 65520 00:12:28.493 [2024-11-19 15:13:27.014440] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30983: invalid cntlid range [1-65520] 00:12:28.493 15:13:27 -- target/invalid.sh@79 -- # out='request: 00:12:28.493 { 00:12:28.493 "nqn": "nqn.2016-06.io.spdk:cnode30983", 00:12:28.493 "max_cntlid": 65520, 00:12:28.493 "method": "nvmf_create_subsystem", 00:12:28.493 "req_id": 1 00:12:28.493 } 00:12:28.493 Got JSON-RPC error response 00:12:28.493 response: 00:12:28.493 { 00:12:28.493 "code": -32602, 00:12:28.493 "message": "Invalid cntlid range [1-65520]" 00:12:28.493 }' 00:12:28.493 15:13:27 -- target/invalid.sh@80 -- # [[ request: 00:12:28.493 { 00:12:28.493 "nqn": "nqn.2016-06.io.spdk:cnode30983", 00:12:28.493 "max_cntlid": 65520, 00:12:28.493 "method": "nvmf_create_subsystem", 00:12:28.493 "req_id": 1 00:12:28.493 } 00:12:28.493 Got JSON-RPC error response 00:12:28.493 response: 00:12:28.494 { 00:12:28.494 "code": -32602, 00:12:28.494 "message": "Invalid cntlid range [1-65520]" 00:12:28.494 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.494 15:13:27 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4471 -i 6 -I 5 00:12:28.751 [2024-11-19 15:13:27.263333] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4471: invalid cntlid range [6-5] 00:12:28.751 15:13:27 -- target/invalid.sh@83 -- # out='request: 00:12:28.751 { 00:12:28.751 "nqn": "nqn.2016-06.io.spdk:cnode4471", 00:12:28.751 "min_cntlid": 6, 00:12:28.751 "max_cntlid": 5, 00:12:28.751 "method": "nvmf_create_subsystem", 00:12:28.751 "req_id": 1 00:12:28.751 } 00:12:28.751 Got JSON-RPC error response 00:12:28.751 response: 00:12:28.751 { 00:12:28.751 "code": -32602, 00:12:28.751 "message": "Invalid cntlid range [6-5]" 00:12:28.751 }' 00:12:28.751 15:13:27 -- target/invalid.sh@84 -- # [[ request: 00:12:28.751 { 00:12:28.751 "nqn": "nqn.2016-06.io.spdk:cnode4471", 00:12:28.751 "min_cntlid": 6, 00:12:28.751 "max_cntlid": 5, 00:12:28.751 "method": "nvmf_create_subsystem", 00:12:28.751 "req_id": 1 00:12:28.751 } 00:12:28.751 Got JSON-RPC error response 00:12:28.751 response: 00:12:28.751 { 00:12:28.751 "code": -32602, 00:12:28.751 "message": "Invalid cntlid range [6-5]" 00:12:28.751 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.751 15:13:27 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:29.046 15:13:27 -- target/invalid.sh@87 -- # out='request: 00:12:29.046 { 00:12:29.046 "name": "foobar", 00:12:29.046 "method": "nvmf_delete_target", 00:12:29.046 "req_id": 1 00:12:29.046 } 00:12:29.046 Got JSON-RPC error response 00:12:29.046 response: 00:12:29.046 { 00:12:29.046 "code": -32602, 00:12:29.046 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:29.046 }' 00:12:29.046 15:13:27 -- target/invalid.sh@88 -- # [[ request: 00:12:29.046 { 00:12:29.046 "name": "foobar", 00:12:29.046 "method": "nvmf_delete_target", 00:12:29.046 "req_id": 1 00:12:29.046 } 00:12:29.046 Got JSON-RPC error response 00:12:29.046 response: 00:12:29.046 { 00:12:29.046 "code": -32602, 00:12:29.046 "message": "The specified target doesn't exist, cannot delete it." 00:12:29.046 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:29.046 15:13:27 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:29.046 15:13:27 -- target/invalid.sh@91 -- # nvmftestfini 00:12:29.046 15:13:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:29.046 15:13:27 -- nvmf/common.sh@116 -- # sync 00:12:29.046 15:13:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:29.046 15:13:27 -- nvmf/common.sh@119 -- # set +e 00:12:29.046 15:13:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:29.046 15:13:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:29.046 rmmod nvme_tcp 00:12:29.046 rmmod nvme_fabrics 00:12:29.046 rmmod nvme_keyring 00:12:29.046 15:13:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:29.046 15:13:27 -- nvmf/common.sh@123 -- # set -e 00:12:29.046 15:13:27 -- nvmf/common.sh@124 -- # return 0 00:12:29.046 15:13:27 -- nvmf/common.sh@477 -- # '[' -n 2716850 ']' 00:12:29.046 15:13:27 -- nvmf/common.sh@478 -- # killprocess 2716850 00:12:29.046 15:13:27 -- common/autotest_common.sh@936 -- # '[' -z 2716850 ']' 00:12:29.046 15:13:27 -- common/autotest_common.sh@940 -- # kill -0 2716850 00:12:29.046 15:13:27 -- common/autotest_common.sh@941 -- # uname 00:12:29.046 15:13:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:29.046 15:13:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2716850 00:12:29.046 15:13:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:29.046 15:13:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:29.046 15:13:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2716850' 00:12:29.046 killing process with pid 2716850 00:12:29.046 15:13:27 -- common/autotest_common.sh@955 -- # kill 2716850 00:12:29.046 15:13:27 -- common/autotest_common.sh@960 -- # wait 2716850 00:12:29.324 15:13:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:29.324 15:13:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:29.324 15:13:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:29.324 15:13:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:29.324 15:13:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:29.324 15:13:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:29.324 15:13:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:29.324 15:13:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:31.867 15:13:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:31.867 00:12:31.867 real 0m9.644s 00:12:31.867 user 0m23.739s 00:12:31.867 sys 0m2.560s 00:12:31.867 15:13:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:31.867 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:31.867 ************************************ 00:12:31.867 END TEST nvmf_invalid 00:12:31.867 ************************************ 00:12:31.867 15:13:29 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:31.867 15:13:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:31.867 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:31.867 ************************************ 00:12:31.867 START TEST nvmf_abort 00:12:31.867 ************************************ 00:12:31.867 15:13:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:31.867 * Looking for test storage... 00:12:31.867 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:31.867 15:13:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:31.867 15:13:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:31.867 15:13:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:31.867 15:13:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:31.867 15:13:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:31.867 15:13:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:31.867 15:13:29 -- scripts/common.sh@335 -- # IFS=.-: 00:12:31.867 15:13:29 -- scripts/common.sh@335 -- # read -ra ver1 00:12:31.867 15:13:29 -- scripts/common.sh@336 -- # IFS=.-: 00:12:31.867 15:13:29 -- scripts/common.sh@336 -- # read -ra ver2 00:12:31.867 15:13:29 -- scripts/common.sh@337 -- # local 'op=<' 00:12:31.867 15:13:29 -- scripts/common.sh@339 -- # ver1_l=2 00:12:31.867 15:13:29 -- scripts/common.sh@340 -- # ver2_l=1 00:12:31.867 15:13:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:31.867 15:13:29 -- scripts/common.sh@343 -- # case "$op" in 00:12:31.867 15:13:29 -- scripts/common.sh@344 -- # : 1 00:12:31.867 15:13:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:31.867 15:13:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:31.867 15:13:29 -- scripts/common.sh@364 -- # decimal 1 00:12:31.867 15:13:29 -- scripts/common.sh@352 -- # local d=1 00:12:31.867 15:13:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:31.867 15:13:29 -- scripts/common.sh@354 -- # echo 1 00:12:31.867 15:13:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:31.867 15:13:29 -- scripts/common.sh@365 -- # decimal 2 00:12:31.867 15:13:29 -- scripts/common.sh@352 -- # local d=2 00:12:31.867 15:13:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:31.867 15:13:29 -- scripts/common.sh@354 -- # echo 2 00:12:31.867 15:13:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:31.867 15:13:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:31.867 15:13:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:31.867 15:13:29 -- scripts/common.sh@367 -- # return 0 00:12:31.867 15:13:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:31.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:31.867 --rc genhtml_branch_coverage=1 00:12:31.867 --rc genhtml_function_coverage=1 00:12:31.867 --rc genhtml_legend=1 00:12:31.867 --rc geninfo_all_blocks=1 00:12:31.867 --rc geninfo_unexecuted_blocks=1 00:12:31.867 00:12:31.867 ' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:31.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:31.867 --rc genhtml_branch_coverage=1 00:12:31.867 --rc genhtml_function_coverage=1 00:12:31.867 --rc genhtml_legend=1 00:12:31.867 --rc geninfo_all_blocks=1 00:12:31.867 --rc geninfo_unexecuted_blocks=1 00:12:31.867 00:12:31.867 ' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:31.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:31.867 --rc genhtml_branch_coverage=1 00:12:31.867 --rc genhtml_function_coverage=1 00:12:31.867 --rc genhtml_legend=1 00:12:31.867 --rc geninfo_all_blocks=1 00:12:31.867 --rc geninfo_unexecuted_blocks=1 00:12:31.867 00:12:31.867 ' 00:12:31.867 15:13:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:31.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:31.867 --rc genhtml_branch_coverage=1 00:12:31.867 --rc genhtml_function_coverage=1 00:12:31.867 --rc genhtml_legend=1 00:12:31.867 --rc geninfo_all_blocks=1 00:12:31.867 --rc geninfo_unexecuted_blocks=1 00:12:31.867 00:12:31.867 ' 00:12:31.867 15:13:29 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:31.867 15:13:29 -- nvmf/common.sh@7 -- # uname -s 00:12:31.867 15:13:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:31.867 15:13:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:31.867 15:13:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:31.867 15:13:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:31.867 15:13:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:31.867 15:13:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:31.867 15:13:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:31.867 15:13:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:31.867 15:13:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:31.867 15:13:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:31.867 15:13:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:31.867 15:13:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:31.867 15:13:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:31.867 15:13:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:31.867 15:13:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:31.867 15:13:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:31.867 15:13:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:31.867 15:13:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:31.867 15:13:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:31.867 15:13:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.867 15:13:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.867 15:13:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.867 15:13:30 -- paths/export.sh@5 -- # export PATH 00:12:31.867 15:13:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.867 15:13:30 -- nvmf/common.sh@46 -- # : 0 00:12:31.867 15:13:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:31.867 15:13:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:31.867 15:13:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:31.867 15:13:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:31.867 15:13:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:31.867 15:13:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:31.867 15:13:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:31.867 15:13:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:31.867 15:13:30 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:31.867 15:13:30 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:31.867 15:13:30 -- target/abort.sh@14 -- # nvmftestinit 00:12:31.867 15:13:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:31.867 15:13:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:31.867 15:13:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:31.867 15:13:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:31.867 15:13:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:31.867 15:13:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:31.867 15:13:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:31.867 15:13:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:31.867 15:13:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:31.867 15:13:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:31.867 15:13:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:31.867 15:13:30 -- common/autotest_common.sh@10 -- # set +x 00:12:33.768 15:13:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:33.768 15:13:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:33.768 15:13:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:33.768 15:13:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:33.768 15:13:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:33.768 15:13:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:33.768 15:13:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:33.768 15:13:32 -- nvmf/common.sh@294 -- # net_devs=() 00:12:33.768 15:13:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:33.768 15:13:32 -- nvmf/common.sh@295 -- # e810=() 00:12:33.768 15:13:32 -- nvmf/common.sh@295 -- # local -ga e810 00:12:33.768 15:13:32 -- nvmf/common.sh@296 -- # x722=() 00:12:33.768 15:13:32 -- nvmf/common.sh@296 -- # local -ga x722 00:12:33.768 15:13:32 -- nvmf/common.sh@297 -- # mlx=() 00:12:33.768 15:13:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:33.768 15:13:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:33.768 15:13:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:33.768 15:13:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:33.768 15:13:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:33.768 15:13:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:33.768 15:13:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:33.768 15:13:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.769 15:13:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:33.769 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:33.769 15:13:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.769 15:13:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:33.769 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:33.769 15:13:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.769 15:13:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.769 15:13:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.769 15:13:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:33.769 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:33.769 15:13:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.769 15:13:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.769 15:13:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.769 15:13:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.769 15:13:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:33.769 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:33.769 15:13:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.769 15:13:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:33.769 15:13:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:33.769 15:13:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:33.769 15:13:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:33.769 15:13:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:33.769 15:13:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:33.769 15:13:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:33.769 15:13:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:33.769 15:13:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:33.769 15:13:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:33.769 15:13:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:33.769 15:13:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:33.769 15:13:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:33.769 15:13:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:33.769 15:13:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:33.769 15:13:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:33.769 15:13:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:33.769 15:13:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:33.769 15:13:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:33.769 15:13:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:33.769 15:13:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:33.769 15:13:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:33.769 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:33.769 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:12:33.769 00:12:33.769 --- 10.0.0.2 ping statistics --- 00:12:33.769 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.769 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:12:33.769 15:13:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:33.769 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:33.769 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:12:33.769 00:12:33.769 --- 10.0.0.1 ping statistics --- 00:12:33.769 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.769 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:12:33.769 15:13:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:33.769 15:13:32 -- nvmf/common.sh@410 -- # return 0 00:12:33.769 15:13:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:33.769 15:13:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:33.769 15:13:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:33.769 15:13:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:33.769 15:13:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:33.769 15:13:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:33.769 15:13:32 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:33.769 15:13:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:33.769 15:13:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:33.769 15:13:32 -- common/autotest_common.sh@10 -- # set +x 00:12:33.769 15:13:32 -- nvmf/common.sh@469 -- # nvmfpid=2719654 00:12:33.769 15:13:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:33.769 15:13:32 -- nvmf/common.sh@470 -- # waitforlisten 2719654 00:12:33.769 15:13:32 -- common/autotest_common.sh@829 -- # '[' -z 2719654 ']' 00:12:33.769 15:13:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:33.769 15:13:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:33.769 15:13:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:33.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:33.769 15:13:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:33.769 15:13:32 -- common/autotest_common.sh@10 -- # set +x 00:12:33.769 [2024-11-19 15:13:32.300952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:33.769 [2024-11-19 15:13:32.301038] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:34.029 EAL: No free 2048 kB hugepages reported on node 1 00:12:34.029 [2024-11-19 15:13:32.370936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:34.029 [2024-11-19 15:13:32.479931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:34.029 [2024-11-19 15:13:32.480090] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:34.029 [2024-11-19 15:13:32.480107] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:34.029 [2024-11-19 15:13:32.480119] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:34.029 [2024-11-19 15:13:32.480211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:34.029 [2024-11-19 15:13:32.480258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:34.029 [2024-11-19 15:13:32.480261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:34.963 15:13:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:34.963 15:13:33 -- common/autotest_common.sh@862 -- # return 0 00:12:34.963 15:13:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:34.963 15:13:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 15:13:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:34.963 15:13:33 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 [2024-11-19 15:13:33.306582] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 Malloc0 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 Delay0 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 [2024-11-19 15:13:33.384967] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:34.963 15:13:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.963 15:13:33 -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 15:13:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.963 15:13:33 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:34.963 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.221 [2024-11-19 15:13:33.530807] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:37.123 Initializing NVMe Controllers 00:12:37.124 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:37.124 controller IO queue size 128 less than required 00:12:37.124 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:37.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:37.124 Initialization complete. Launching workers. 00:12:37.124 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 32977 00:12:37.124 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33038, failed to submit 62 00:12:37.124 success 32977, unsuccess 61, failed 0 00:12:37.382 15:13:35 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:37.382 15:13:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.382 15:13:35 -- common/autotest_common.sh@10 -- # set +x 00:12:37.382 15:13:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.382 15:13:35 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:37.382 15:13:35 -- target/abort.sh@38 -- # nvmftestfini 00:12:37.382 15:13:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:37.382 15:13:35 -- nvmf/common.sh@116 -- # sync 00:12:37.382 15:13:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:37.382 15:13:35 -- nvmf/common.sh@119 -- # set +e 00:12:37.382 15:13:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:37.382 15:13:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:37.382 rmmod nvme_tcp 00:12:37.382 rmmod nvme_fabrics 00:12:37.382 rmmod nvme_keyring 00:12:37.382 15:13:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:37.382 15:13:35 -- nvmf/common.sh@123 -- # set -e 00:12:37.382 15:13:35 -- nvmf/common.sh@124 -- # return 0 00:12:37.382 15:13:35 -- nvmf/common.sh@477 -- # '[' -n 2719654 ']' 00:12:37.382 15:13:35 -- nvmf/common.sh@478 -- # killprocess 2719654 00:12:37.382 15:13:35 -- common/autotest_common.sh@936 -- # '[' -z 2719654 ']' 00:12:37.382 15:13:35 -- common/autotest_common.sh@940 -- # kill -0 2719654 00:12:37.382 15:13:35 -- common/autotest_common.sh@941 -- # uname 00:12:37.382 15:13:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:37.382 15:13:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2719654 00:12:37.382 15:13:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:37.382 15:13:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:37.382 15:13:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2719654' 00:12:37.382 killing process with pid 2719654 00:12:37.382 15:13:35 -- common/autotest_common.sh@955 -- # kill 2719654 00:12:37.382 15:13:35 -- common/autotest_common.sh@960 -- # wait 2719654 00:12:37.641 15:13:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:37.641 15:13:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:37.641 15:13:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:37.641 15:13:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:37.641 15:13:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:37.641 15:13:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.642 15:13:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.642 15:13:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:40.178 15:13:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:40.178 00:12:40.178 real 0m8.293s 00:12:40.178 user 0m13.358s 00:12:40.178 sys 0m2.687s 00:12:40.178 15:13:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:40.178 15:13:38 -- common/autotest_common.sh@10 -- # set +x 00:12:40.178 ************************************ 00:12:40.178 END TEST nvmf_abort 00:12:40.178 ************************************ 00:12:40.178 15:13:38 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:40.178 15:13:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:40.178 15:13:38 -- common/autotest_common.sh@10 -- # set +x 00:12:40.178 ************************************ 00:12:40.178 START TEST nvmf_ns_hotplug_stress 00:12:40.178 ************************************ 00:12:40.178 15:13:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:40.178 * Looking for test storage... 00:12:40.178 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:40.178 15:13:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:40.178 15:13:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:40.178 15:13:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:40.178 15:13:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:40.178 15:13:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:40.178 15:13:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:40.178 15:13:38 -- scripts/common.sh@335 -- # IFS=.-: 00:12:40.178 15:13:38 -- scripts/common.sh@335 -- # read -ra ver1 00:12:40.178 15:13:38 -- scripts/common.sh@336 -- # IFS=.-: 00:12:40.178 15:13:38 -- scripts/common.sh@336 -- # read -ra ver2 00:12:40.178 15:13:38 -- scripts/common.sh@337 -- # local 'op=<' 00:12:40.178 15:13:38 -- scripts/common.sh@339 -- # ver1_l=2 00:12:40.178 15:13:38 -- scripts/common.sh@340 -- # ver2_l=1 00:12:40.178 15:13:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:40.178 15:13:38 -- scripts/common.sh@343 -- # case "$op" in 00:12:40.178 15:13:38 -- scripts/common.sh@344 -- # : 1 00:12:40.178 15:13:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:40.178 15:13:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:40.178 15:13:38 -- scripts/common.sh@364 -- # decimal 1 00:12:40.178 15:13:38 -- scripts/common.sh@352 -- # local d=1 00:12:40.178 15:13:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:40.178 15:13:38 -- scripts/common.sh@354 -- # echo 1 00:12:40.178 15:13:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:40.178 15:13:38 -- scripts/common.sh@365 -- # decimal 2 00:12:40.178 15:13:38 -- scripts/common.sh@352 -- # local d=2 00:12:40.178 15:13:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:40.178 15:13:38 -- scripts/common.sh@354 -- # echo 2 00:12:40.178 15:13:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:40.178 15:13:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:40.178 15:13:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:40.178 15:13:38 -- scripts/common.sh@367 -- # return 0 00:12:40.178 15:13:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:40.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.178 --rc genhtml_branch_coverage=1 00:12:40.178 --rc genhtml_function_coverage=1 00:12:40.178 --rc genhtml_legend=1 00:12:40.178 --rc geninfo_all_blocks=1 00:12:40.178 --rc geninfo_unexecuted_blocks=1 00:12:40.178 00:12:40.178 ' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:40.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.178 --rc genhtml_branch_coverage=1 00:12:40.178 --rc genhtml_function_coverage=1 00:12:40.178 --rc genhtml_legend=1 00:12:40.178 --rc geninfo_all_blocks=1 00:12:40.178 --rc geninfo_unexecuted_blocks=1 00:12:40.178 00:12:40.178 ' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:40.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.178 --rc genhtml_branch_coverage=1 00:12:40.178 --rc genhtml_function_coverage=1 00:12:40.178 --rc genhtml_legend=1 00:12:40.178 --rc geninfo_all_blocks=1 00:12:40.178 --rc geninfo_unexecuted_blocks=1 00:12:40.178 00:12:40.178 ' 00:12:40.178 15:13:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:40.178 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:40.178 --rc genhtml_branch_coverage=1 00:12:40.178 --rc genhtml_function_coverage=1 00:12:40.178 --rc genhtml_legend=1 00:12:40.178 --rc geninfo_all_blocks=1 00:12:40.178 --rc geninfo_unexecuted_blocks=1 00:12:40.178 00:12:40.178 ' 00:12:40.178 15:13:38 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:40.178 15:13:38 -- nvmf/common.sh@7 -- # uname -s 00:12:40.178 15:13:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:40.178 15:13:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:40.178 15:13:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:40.178 15:13:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:40.178 15:13:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:40.178 15:13:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:40.178 15:13:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:40.178 15:13:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:40.178 15:13:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:40.178 15:13:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:40.178 15:13:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.178 15:13:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.178 15:13:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:40.178 15:13:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:40.178 15:13:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:40.178 15:13:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:40.178 15:13:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:40.178 15:13:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:40.178 15:13:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:40.178 15:13:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.179 15:13:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.179 15:13:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.179 15:13:38 -- paths/export.sh@5 -- # export PATH 00:12:40.179 15:13:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.179 15:13:38 -- nvmf/common.sh@46 -- # : 0 00:12:40.179 15:13:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:40.179 15:13:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:40.179 15:13:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:40.179 15:13:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:40.179 15:13:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:40.179 15:13:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:40.179 15:13:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:40.179 15:13:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:40.179 15:13:38 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:40.179 15:13:38 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:40.179 15:13:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:40.179 15:13:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:40.179 15:13:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:40.179 15:13:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:40.179 15:13:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:40.179 15:13:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.179 15:13:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.179 15:13:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:40.179 15:13:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:40.179 15:13:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:40.179 15:13:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:40.179 15:13:38 -- common/autotest_common.sh@10 -- # set +x 00:12:42.084 15:13:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:42.084 15:13:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:42.084 15:13:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:42.084 15:13:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:42.084 15:13:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:42.084 15:13:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:42.084 15:13:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:42.084 15:13:40 -- nvmf/common.sh@294 -- # net_devs=() 00:12:42.084 15:13:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:42.084 15:13:40 -- nvmf/common.sh@295 -- # e810=() 00:12:42.084 15:13:40 -- nvmf/common.sh@295 -- # local -ga e810 00:12:42.084 15:13:40 -- nvmf/common.sh@296 -- # x722=() 00:12:42.084 15:13:40 -- nvmf/common.sh@296 -- # local -ga x722 00:12:42.084 15:13:40 -- nvmf/common.sh@297 -- # mlx=() 00:12:42.084 15:13:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:42.084 15:13:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:42.084 15:13:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:42.084 15:13:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:42.084 15:13:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:42.084 15:13:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:42.084 15:13:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:42.084 15:13:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:42.084 15:13:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.084 15:13:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:42.084 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:42.084 15:13:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.084 15:13:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.084 15:13:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.085 15:13:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:42.085 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:42.085 15:13:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:42.085 15:13:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.085 15:13:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.085 15:13:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.085 15:13:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.085 15:13:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:42.085 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:42.085 15:13:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.085 15:13:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.085 15:13:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.085 15:13:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.085 15:13:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.085 15:13:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:42.085 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:42.085 15:13:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.085 15:13:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:42.085 15:13:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:42.085 15:13:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:42.085 15:13:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:42.085 15:13:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:42.085 15:13:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:42.085 15:13:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:42.085 15:13:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:42.085 15:13:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:42.085 15:13:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:42.085 15:13:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:42.085 15:13:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:42.085 15:13:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:42.085 15:13:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:42.085 15:13:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:42.085 15:13:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:42.085 15:13:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:42.085 15:13:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:42.085 15:13:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:42.085 15:13:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:42.085 15:13:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:42.085 15:13:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:42.085 15:13:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:42.085 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:42.085 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:12:42.085 00:12:42.085 --- 10.0.0.2 ping statistics --- 00:12:42.085 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.085 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:12:42.085 15:13:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:42.085 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:42.085 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:12:42.085 00:12:42.085 --- 10.0.0.1 ping statistics --- 00:12:42.085 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.085 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:12:42.085 15:13:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:42.085 15:13:40 -- nvmf/common.sh@410 -- # return 0 00:12:42.085 15:13:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:42.085 15:13:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:42.085 15:13:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:42.085 15:13:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:42.085 15:13:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:42.085 15:13:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:42.085 15:13:40 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:42.085 15:13:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:42.085 15:13:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:42.085 15:13:40 -- common/autotest_common.sh@10 -- # set +x 00:12:42.085 15:13:40 -- nvmf/common.sh@469 -- # nvmfpid=2722039 00:12:42.085 15:13:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:42.085 15:13:40 -- nvmf/common.sh@470 -- # waitforlisten 2722039 00:12:42.085 15:13:40 -- common/autotest_common.sh@829 -- # '[' -z 2722039 ']' 00:12:42.085 15:13:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:42.085 15:13:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:42.085 15:13:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:42.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:42.085 15:13:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:42.085 15:13:40 -- common/autotest_common.sh@10 -- # set +x 00:12:42.085 [2024-11-19 15:13:40.633570] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:42.085 [2024-11-19 15:13:40.633672] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:42.344 EAL: No free 2048 kB hugepages reported on node 1 00:12:42.344 [2024-11-19 15:13:40.703375] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:42.344 [2024-11-19 15:13:40.821658] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:42.344 [2024-11-19 15:13:40.821844] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:42.344 [2024-11-19 15:13:40.821865] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:42.344 [2024-11-19 15:13:40.821880] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:42.344 [2024-11-19 15:13:40.821937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:42.344 [2024-11-19 15:13:40.822004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:42.344 [2024-11-19 15:13:40.822007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:43.278 15:13:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:43.278 15:13:41 -- common/autotest_common.sh@862 -- # return 0 00:12:43.278 15:13:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:43.278 15:13:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:43.278 15:13:41 -- common/autotest_common.sh@10 -- # set +x 00:12:43.278 15:13:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:43.278 15:13:41 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:43.278 15:13:41 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:43.536 [2024-11-19 15:13:41.944806] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:43.536 15:13:41 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:43.793 15:13:42 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:44.051 [2024-11-19 15:13:42.483668] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:44.051 15:13:42 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:44.309 15:13:42 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:44.567 Malloc0 00:12:44.567 15:13:43 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:44.825 Delay0 00:12:44.825 15:13:43 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.083 15:13:43 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:45.341 NULL1 00:12:45.341 15:13:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:45.599 15:13:44 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2722480 00:12:45.599 15:13:44 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:45.599 15:13:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:45.599 15:13:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.599 EAL: No free 2048 kB hugepages reported on node 1 00:12:45.857 15:13:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.115 15:13:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:46.115 15:13:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:46.372 true 00:12:46.373 15:13:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:46.373 15:13:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.630 15:13:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.888 15:13:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:46.888 15:13:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:47.145 true 00:12:47.145 15:13:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:47.145 15:13:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.711 Read completed with error (sct=0, sc=11) 00:12:47.969 15:13:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.969 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.226 15:13:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:48.226 15:13:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:48.226 true 00:12:48.484 15:13:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:48.484 15:13:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.742 15:13:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.742 15:13:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:48.742 15:13:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:49.000 true 00:12:49.000 15:13:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:49.000 15:13:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.931 15:13:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.931 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.189 15:13:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:50.189 15:13:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:50.447 true 00:12:50.447 15:13:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:50.447 15:13:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.704 15:13:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.962 15:13:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:50.962 15:13:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:51.220 true 00:12:51.220 15:13:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:51.220 15:13:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.153 15:13:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.412 15:13:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:52.412 15:13:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:52.670 true 00:12:52.670 15:13:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:52.670 15:13:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.928 15:13:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.186 15:13:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:53.186 15:13:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:53.444 true 00:12:53.444 15:13:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:53.444 15:13:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.378 15:13:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.636 15:13:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:54.636 15:13:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:54.894 true 00:12:54.894 15:13:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:54.894 15:13:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.152 15:13:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.410 15:13:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:55.410 15:13:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:55.668 true 00:12:55.668 15:13:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:55.668 15:13:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.927 15:13:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.185 15:13:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:56.185 15:13:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:56.443 true 00:12:56.443 15:13:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:56.443 15:13:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 15:13:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.816 15:13:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:57.816 15:13:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:58.074 true 00:12:58.074 15:13:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:58.074 15:13:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.009 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:59.009 15:13:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.009 15:13:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:59.009 15:13:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:59.268 true 00:12:59.268 15:13:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:12:59.268 15:13:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.526 15:13:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.784 15:13:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:59.785 15:13:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:00.043 true 00:13:00.043 15:13:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:00.043 15:13:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.976 15:13:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.234 15:13:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:01.234 15:13:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:01.493 true 00:13:01.493 15:13:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:01.493 15:13:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.799 15:14:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.096 15:14:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:02.096 15:14:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:02.372 true 00:13:02.372 15:14:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:02.372 15:14:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.372 15:14:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.630 15:14:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:02.631 15:14:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:02.888 true 00:13:02.888 15:14:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:02.889 15:14:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.263 15:14:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.263 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.263 15:14:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:04.263 15:14:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:04.520 true 00:13:04.520 15:14:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:04.520 15:14:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.778 15:14:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.036 15:14:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:05.036 15:14:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:05.293 true 00:13:05.293 15:14:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:05.293 15:14:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.550 15:14:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.807 15:14:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:05.807 15:14:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:06.064 true 00:13:06.064 15:14:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:06.064 15:14:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.434 15:14:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.434 15:14:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:07.434 15:14:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:07.689 true 00:13:07.689 15:14:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:07.689 15:14:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.945 15:14:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.202 15:14:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:08.202 15:14:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:08.459 true 00:13:08.459 15:14:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:08.459 15:14:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.392 15:14:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.649 15:14:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:09.649 15:14:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:09.906 true 00:13:09.906 15:14:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:09.906 15:14:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.163 15:14:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.420 15:14:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:10.420 15:14:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:10.678 true 00:13:10.678 15:14:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:10.678 15:14:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.610 15:14:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.867 15:14:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:11.867 15:14:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:12.124 true 00:13:12.124 15:14:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:12.124 15:14:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.382 15:14:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.639 15:14:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:12.639 15:14:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:12.897 true 00:13:12.897 15:14:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:12.897 15:14:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.154 15:14:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.411 15:14:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:13.411 15:14:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:13.411 true 00:13:13.411 15:14:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:13.411 15:14:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.784 15:14:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.784 15:14:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:14.784 15:14:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:15.042 true 00:13:15.042 15:14:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:15.042 15:14:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.974 15:14:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.974 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.974 Initializing NVMe Controllers 00:13:15.974 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:15.974 Controller IO queue size 128, less than required. 00:13:15.974 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:15.974 Controller IO queue size 128, less than required. 00:13:15.974 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:15.974 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:15.974 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:15.974 Initialization complete. Launching workers. 00:13:15.974 ======================================================== 00:13:15.974 Latency(us) 00:13:15.974 Device Information : IOPS MiB/s Average min max 00:13:15.974 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1040.26 0.51 60999.56 2375.73 1053296.09 00:13:15.974 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11316.19 5.53 11278.66 1817.92 444388.15 00:13:15.974 ======================================================== 00:13:15.974 Total : 12356.45 6.03 15464.52 1817.92 1053296.09 00:13:15.974 00:13:16.232 15:14:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:16.232 15:14:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:16.489 true 00:13:16.489 15:14:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2722480 00:13:16.489 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2722480) - No such process 00:13:16.489 15:14:14 -- target/ns_hotplug_stress.sh@53 -- # wait 2722480 00:13:16.489 15:14:14 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.746 15:14:15 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.004 15:14:15 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:17.004 15:14:15 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:17.004 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:17.004 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.004 15:14:15 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:17.262 null0 00:13:17.262 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.262 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.262 15:14:15 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:17.519 null1 00:13:17.519 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.519 15:14:15 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.519 15:14:15 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:17.777 null2 00:13:17.777 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.777 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.777 15:14:16 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:18.035 null3 00:13:18.035 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.035 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.035 15:14:16 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:18.293 null4 00:13:18.293 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.293 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.293 15:14:16 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:18.550 null5 00:13:18.550 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.550 15:14:16 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.550 15:14:16 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:18.550 null6 00:13:18.808 15:14:17 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.808 15:14:17 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.808 15:14:17 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:18.808 null7 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@66 -- # wait 2726656 2726657 2726659 2726661 2726663 2726665 2726667 2726669 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.067 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.325 15:14:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.584 15:14:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.842 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.102 15:14:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.361 15:14:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.620 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.878 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.135 15:14:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.392 15:14:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.650 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.908 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.166 15:14:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.166 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.166 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.166 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.424 15:14:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.682 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.940 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.199 15:14:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.456 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.457 15:14:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.714 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.972 15:14:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.231 15:14:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:24.490 15:14:22 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:24.490 15:14:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:24.490 15:14:22 -- nvmf/common.sh@116 -- # sync 00:13:24.490 15:14:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:24.490 15:14:22 -- nvmf/common.sh@119 -- # set +e 00:13:24.490 15:14:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:24.490 15:14:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:24.490 rmmod nvme_tcp 00:13:24.490 rmmod nvme_fabrics 00:13:24.490 rmmod nvme_keyring 00:13:24.490 15:14:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:24.490 15:14:23 -- nvmf/common.sh@123 -- # set -e 00:13:24.490 15:14:23 -- nvmf/common.sh@124 -- # return 0 00:13:24.490 15:14:23 -- nvmf/common.sh@477 -- # '[' -n 2722039 ']' 00:13:24.490 15:14:23 -- nvmf/common.sh@478 -- # killprocess 2722039 00:13:24.490 15:14:23 -- common/autotest_common.sh@936 -- # '[' -z 2722039 ']' 00:13:24.490 15:14:23 -- common/autotest_common.sh@940 -- # kill -0 2722039 00:13:24.748 15:14:23 -- common/autotest_common.sh@941 -- # uname 00:13:24.748 15:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:24.748 15:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2722039 00:13:24.748 15:14:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:24.748 15:14:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:24.748 15:14:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2722039' 00:13:24.748 killing process with pid 2722039 00:13:24.748 15:14:23 -- common/autotest_common.sh@955 -- # kill 2722039 00:13:24.748 15:14:23 -- common/autotest_common.sh@960 -- # wait 2722039 00:13:25.007 15:14:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:25.007 15:14:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:25.007 15:14:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:25.007 15:14:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:25.007 15:14:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:25.007 15:14:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:25.007 15:14:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:25.007 15:14:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:26.908 15:14:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:26.908 00:13:26.908 real 0m47.240s 00:13:26.908 user 3m36.182s 00:13:26.908 sys 0m15.263s 00:13:26.908 15:14:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:26.908 15:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:26.909 ************************************ 00:13:26.909 END TEST nvmf_ns_hotplug_stress 00:13:26.909 ************************************ 00:13:26.909 15:14:25 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:26.909 15:14:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:26.909 15:14:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:26.909 15:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:26.909 ************************************ 00:13:26.909 START TEST nvmf_connect_stress 00:13:26.909 ************************************ 00:13:26.909 15:14:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:27.168 * Looking for test storage... 00:13:27.168 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:27.168 15:14:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:27.168 15:14:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:27.168 15:14:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:27.168 15:14:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:27.168 15:14:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:27.168 15:14:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:27.168 15:14:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:27.168 15:14:25 -- scripts/common.sh@335 -- # IFS=.-: 00:13:27.168 15:14:25 -- scripts/common.sh@335 -- # read -ra ver1 00:13:27.168 15:14:25 -- scripts/common.sh@336 -- # IFS=.-: 00:13:27.168 15:14:25 -- scripts/common.sh@336 -- # read -ra ver2 00:13:27.168 15:14:25 -- scripts/common.sh@337 -- # local 'op=<' 00:13:27.168 15:14:25 -- scripts/common.sh@339 -- # ver1_l=2 00:13:27.168 15:14:25 -- scripts/common.sh@340 -- # ver2_l=1 00:13:27.168 15:14:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:27.168 15:14:25 -- scripts/common.sh@343 -- # case "$op" in 00:13:27.168 15:14:25 -- scripts/common.sh@344 -- # : 1 00:13:27.168 15:14:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:27.168 15:14:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:27.168 15:14:25 -- scripts/common.sh@364 -- # decimal 1 00:13:27.168 15:14:25 -- scripts/common.sh@352 -- # local d=1 00:13:27.168 15:14:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:27.168 15:14:25 -- scripts/common.sh@354 -- # echo 1 00:13:27.168 15:14:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:27.168 15:14:25 -- scripts/common.sh@365 -- # decimal 2 00:13:27.168 15:14:25 -- scripts/common.sh@352 -- # local d=2 00:13:27.168 15:14:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:27.168 15:14:25 -- scripts/common.sh@354 -- # echo 2 00:13:27.168 15:14:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:27.168 15:14:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:27.168 15:14:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:27.168 15:14:25 -- scripts/common.sh@367 -- # return 0 00:13:27.168 15:14:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:27.168 15:14:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:27.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.168 --rc genhtml_branch_coverage=1 00:13:27.168 --rc genhtml_function_coverage=1 00:13:27.168 --rc genhtml_legend=1 00:13:27.168 --rc geninfo_all_blocks=1 00:13:27.168 --rc geninfo_unexecuted_blocks=1 00:13:27.168 00:13:27.168 ' 00:13:27.168 15:14:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:27.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.168 --rc genhtml_branch_coverage=1 00:13:27.168 --rc genhtml_function_coverage=1 00:13:27.168 --rc genhtml_legend=1 00:13:27.168 --rc geninfo_all_blocks=1 00:13:27.168 --rc geninfo_unexecuted_blocks=1 00:13:27.168 00:13:27.168 ' 00:13:27.168 15:14:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:27.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.168 --rc genhtml_branch_coverage=1 00:13:27.168 --rc genhtml_function_coverage=1 00:13:27.168 --rc genhtml_legend=1 00:13:27.168 --rc geninfo_all_blocks=1 00:13:27.168 --rc geninfo_unexecuted_blocks=1 00:13:27.168 00:13:27.168 ' 00:13:27.168 15:14:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:27.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.168 --rc genhtml_branch_coverage=1 00:13:27.168 --rc genhtml_function_coverage=1 00:13:27.168 --rc genhtml_legend=1 00:13:27.168 --rc geninfo_all_blocks=1 00:13:27.168 --rc geninfo_unexecuted_blocks=1 00:13:27.168 00:13:27.168 ' 00:13:27.168 15:14:25 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:27.168 15:14:25 -- nvmf/common.sh@7 -- # uname -s 00:13:27.168 15:14:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:27.168 15:14:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:27.168 15:14:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:27.168 15:14:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:27.169 15:14:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:27.169 15:14:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:27.169 15:14:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:27.169 15:14:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:27.169 15:14:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:27.169 15:14:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:27.169 15:14:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.169 15:14:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.169 15:14:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:27.169 15:14:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:27.169 15:14:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:27.169 15:14:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:27.169 15:14:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:27.169 15:14:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:27.169 15:14:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:27.169 15:14:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.169 15:14:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.169 15:14:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.169 15:14:25 -- paths/export.sh@5 -- # export PATH 00:13:27.169 15:14:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.169 15:14:25 -- nvmf/common.sh@46 -- # : 0 00:13:27.169 15:14:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:27.169 15:14:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:27.169 15:14:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:27.169 15:14:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:27.169 15:14:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:27.169 15:14:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:27.169 15:14:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:27.169 15:14:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:27.169 15:14:25 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:27.169 15:14:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:27.169 15:14:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:27.169 15:14:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:27.169 15:14:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:27.169 15:14:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:27.169 15:14:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.169 15:14:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.169 15:14:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.169 15:14:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:27.169 15:14:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:27.169 15:14:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:27.169 15:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.700 15:14:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:29.700 15:14:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:29.700 15:14:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:29.700 15:14:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:29.700 15:14:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:29.700 15:14:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:29.700 15:14:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:29.700 15:14:27 -- nvmf/common.sh@294 -- # net_devs=() 00:13:29.700 15:14:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:29.700 15:14:27 -- nvmf/common.sh@295 -- # e810=() 00:13:29.700 15:14:27 -- nvmf/common.sh@295 -- # local -ga e810 00:13:29.700 15:14:27 -- nvmf/common.sh@296 -- # x722=() 00:13:29.700 15:14:27 -- nvmf/common.sh@296 -- # local -ga x722 00:13:29.700 15:14:27 -- nvmf/common.sh@297 -- # mlx=() 00:13:29.700 15:14:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:29.700 15:14:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:29.700 15:14:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:29.701 15:14:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:29.701 15:14:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:29.701 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:29.701 15:14:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:29.701 15:14:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:29.701 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:29.701 15:14:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:29.701 15:14:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.701 15:14:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.701 15:14:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:29.701 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:29.701 15:14:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:29.701 15:14:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.701 15:14:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.701 15:14:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:29.701 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:29.701 15:14:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:29.701 15:14:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:29.701 15:14:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:29.701 15:14:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:29.701 15:14:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:29.701 15:14:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:29.701 15:14:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:29.701 15:14:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:29.701 15:14:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:29.701 15:14:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:29.701 15:14:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:29.701 15:14:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:29.701 15:14:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:29.701 15:14:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:29.701 15:14:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:29.701 15:14:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:29.701 15:14:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:29.701 15:14:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:29.701 15:14:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:29.701 15:14:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:29.701 15:14:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:29.701 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:29.701 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:13:29.701 00:13:29.701 --- 10.0.0.2 ping statistics --- 00:13:29.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:29.701 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:13:29.701 15:14:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:29.701 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:29.701 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:13:29.701 00:13:29.701 --- 10.0.0.1 ping statistics --- 00:13:29.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:29.701 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:13:29.701 15:14:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:29.701 15:14:27 -- nvmf/common.sh@410 -- # return 0 00:13:29.701 15:14:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:29.701 15:14:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:29.701 15:14:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:29.701 15:14:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:29.701 15:14:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:29.701 15:14:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:29.701 15:14:27 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:29.701 15:14:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:29.701 15:14:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:29.701 15:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:29.701 15:14:27 -- nvmf/common.sh@469 -- # nvmfpid=2729508 00:13:29.701 15:14:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:29.701 15:14:27 -- nvmf/common.sh@470 -- # waitforlisten 2729508 00:13:29.701 15:14:27 -- common/autotest_common.sh@829 -- # '[' -z 2729508 ']' 00:13:29.701 15:14:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:29.701 15:14:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:29.702 15:14:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:29.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:29.702 15:14:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:29.702 15:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:29.702 [2024-11-19 15:14:27.874306] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:29.702 [2024-11-19 15:14:27.874382] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:29.702 EAL: No free 2048 kB hugepages reported on node 1 00:13:29.702 [2024-11-19 15:14:27.942766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:29.702 [2024-11-19 15:14:28.053310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:29.702 [2024-11-19 15:14:28.053470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:29.702 [2024-11-19 15:14:28.053497] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:29.702 [2024-11-19 15:14:28.053518] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:29.702 [2024-11-19 15:14:28.053626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:29.702 [2024-11-19 15:14:28.053705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:29.702 [2024-11-19 15:14:28.053714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.636 15:14:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:30.636 15:14:28 -- common/autotest_common.sh@862 -- # return 0 00:13:30.636 15:14:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:30.636 15:14:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:30.636 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.636 15:14:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:30.636 15:14:28 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:30.636 15:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.636 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.636 [2024-11-19 15:14:28.881470] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:30.637 15:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.637 15:14:28 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:30.637 15:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.637 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.637 15:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.637 15:14:28 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:30.637 15:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.637 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.637 [2024-11-19 15:14:28.906914] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:30.637 15:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.637 15:14:28 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:30.637 15:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.637 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.637 NULL1 00:13:30.637 15:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.637 15:14:28 -- target/connect_stress.sh@21 -- # PERF_PID=2729622 00:13:30.637 15:14:28 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:30.637 15:14:28 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:30.637 15:14:28 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:30.637 15:14:28 -- target/connect_stress.sh@28 -- # cat 00:13:30.637 15:14:28 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:30.637 15:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.637 15:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.637 15:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.894 15:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.894 15:14:29 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:30.894 15:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.894 15:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.894 15:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.151 15:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.152 15:14:29 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:31.152 15:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.152 15:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.152 15:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.409 15:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.409 15:14:29 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:31.409 15:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.409 15:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.409 15:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.977 15:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.977 15:14:30 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:31.977 15:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.977 15:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.977 15:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.291 15:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.291 15:14:30 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:32.291 15:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.291 15:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.291 15:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.588 15:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.588 15:14:30 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:32.588 15:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.588 15:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.588 15:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.846 15:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.846 15:14:31 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:32.846 15:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.846 15:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.846 15:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:33.103 15:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.103 15:14:31 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:33.104 15:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.104 15:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.104 15:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:33.362 15:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.362 15:14:31 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:33.362 15:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.362 15:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.362 15:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:33.927 15:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.927 15:14:32 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:33.928 15:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.928 15:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.928 15:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:34.185 15:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.185 15:14:32 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:34.185 15:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.185 15:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.185 15:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:34.443 15:14:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.443 15:14:32 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:34.443 15:14:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.443 15:14:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.443 15:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:34.701 15:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.701 15:14:33 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:34.701 15:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.701 15:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.701 15:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:34.958 15:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.958 15:14:33 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:34.958 15:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.958 15:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.959 15:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:35.525 15:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.525 15:14:33 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:35.526 15:14:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.526 15:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.526 15:14:33 -- common/autotest_common.sh@10 -- # set +x 00:13:35.784 15:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.784 15:14:34 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:35.784 15:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.784 15:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.784 15:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:36.041 15:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.042 15:14:34 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:36.042 15:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.042 15:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.042 15:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:36.300 15:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.300 15:14:34 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:36.300 15:14:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.300 15:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.300 15:14:34 -- common/autotest_common.sh@10 -- # set +x 00:13:36.558 15:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.558 15:14:35 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:36.558 15:14:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.558 15:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.558 15:14:35 -- common/autotest_common.sh@10 -- # set +x 00:13:37.124 15:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.124 15:14:35 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:37.124 15:14:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.124 15:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.124 15:14:35 -- common/autotest_common.sh@10 -- # set +x 00:13:37.382 15:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.382 15:14:35 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:37.382 15:14:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.382 15:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.382 15:14:35 -- common/autotest_common.sh@10 -- # set +x 00:13:37.651 15:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.651 15:14:36 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:37.651 15:14:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.651 15:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.651 15:14:36 -- common/autotest_common.sh@10 -- # set +x 00:13:37.909 15:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.909 15:14:36 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:37.909 15:14:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.909 15:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.909 15:14:36 -- common/autotest_common.sh@10 -- # set +x 00:13:38.167 15:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.167 15:14:36 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:38.167 15:14:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.167 15:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.167 15:14:36 -- common/autotest_common.sh@10 -- # set +x 00:13:38.733 15:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.733 15:14:37 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:38.733 15:14:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.733 15:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.733 15:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:38.991 15:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.991 15:14:37 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:38.991 15:14:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.991 15:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.991 15:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:39.249 15:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.249 15:14:37 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:39.249 15:14:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.249 15:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.249 15:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:39.506 15:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.506 15:14:37 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:39.506 15:14:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.506 15:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.506 15:14:37 -- common/autotest_common.sh@10 -- # set +x 00:13:39.764 15:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.764 15:14:38 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:39.764 15:14:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.764 15:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.764 15:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:40.330 15:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.330 15:14:38 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:40.330 15:14:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.330 15:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.330 15:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:40.587 15:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.587 15:14:38 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:40.587 15:14:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.587 15:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.587 15:14:38 -- common/autotest_common.sh@10 -- # set +x 00:13:40.587 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:40.848 15:14:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.848 15:14:39 -- target/connect_stress.sh@34 -- # kill -0 2729622 00:13:40.849 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2729622) - No such process 00:13:40.849 15:14:39 -- target/connect_stress.sh@38 -- # wait 2729622 00:13:40.849 15:14:39 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:40.849 15:14:39 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:40.849 15:14:39 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:40.849 15:14:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:40.849 15:14:39 -- nvmf/common.sh@116 -- # sync 00:13:40.849 15:14:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:40.849 15:14:39 -- nvmf/common.sh@119 -- # set +e 00:13:40.849 15:14:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:40.849 15:14:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:40.849 rmmod nvme_tcp 00:13:40.849 rmmod nvme_fabrics 00:13:40.849 rmmod nvme_keyring 00:13:40.849 15:14:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:40.849 15:14:39 -- nvmf/common.sh@123 -- # set -e 00:13:40.849 15:14:39 -- nvmf/common.sh@124 -- # return 0 00:13:40.849 15:14:39 -- nvmf/common.sh@477 -- # '[' -n 2729508 ']' 00:13:40.849 15:14:39 -- nvmf/common.sh@478 -- # killprocess 2729508 00:13:40.849 15:14:39 -- common/autotest_common.sh@936 -- # '[' -z 2729508 ']' 00:13:40.849 15:14:39 -- common/autotest_common.sh@940 -- # kill -0 2729508 00:13:40.849 15:14:39 -- common/autotest_common.sh@941 -- # uname 00:13:40.849 15:14:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:40.849 15:14:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2729508 00:13:40.849 15:14:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:40.849 15:14:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:40.849 15:14:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2729508' 00:13:40.849 killing process with pid 2729508 00:13:40.849 15:14:39 -- common/autotest_common.sh@955 -- # kill 2729508 00:13:40.849 15:14:39 -- common/autotest_common.sh@960 -- # wait 2729508 00:13:41.107 15:14:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:41.107 15:14:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:41.107 15:14:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:41.107 15:14:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:41.107 15:14:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:41.107 15:14:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:41.107 15:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:41.107 15:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.642 15:14:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:43.642 00:13:43.642 real 0m16.211s 00:13:43.642 user 0m40.885s 00:13:43.642 sys 0m5.975s 00:13:43.642 15:14:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:43.642 15:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:43.642 ************************************ 00:13:43.642 END TEST nvmf_connect_stress 00:13:43.642 ************************************ 00:13:43.642 15:14:41 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:43.642 15:14:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.642 15:14:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.642 15:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:43.642 ************************************ 00:13:43.642 START TEST nvmf_fused_ordering 00:13:43.642 ************************************ 00:13:43.642 15:14:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:43.642 * Looking for test storage... 00:13:43.642 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:43.642 15:14:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:43.642 15:14:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:43.642 15:14:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:43.642 15:14:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:43.642 15:14:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:43.642 15:14:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:43.642 15:14:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:43.642 15:14:41 -- scripts/common.sh@335 -- # IFS=.-: 00:13:43.642 15:14:41 -- scripts/common.sh@335 -- # read -ra ver1 00:13:43.642 15:14:41 -- scripts/common.sh@336 -- # IFS=.-: 00:13:43.642 15:14:41 -- scripts/common.sh@336 -- # read -ra ver2 00:13:43.642 15:14:41 -- scripts/common.sh@337 -- # local 'op=<' 00:13:43.642 15:14:41 -- scripts/common.sh@339 -- # ver1_l=2 00:13:43.642 15:14:41 -- scripts/common.sh@340 -- # ver2_l=1 00:13:43.642 15:14:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:43.642 15:14:41 -- scripts/common.sh@343 -- # case "$op" in 00:13:43.642 15:14:41 -- scripts/common.sh@344 -- # : 1 00:13:43.642 15:14:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:43.642 15:14:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:43.642 15:14:41 -- scripts/common.sh@364 -- # decimal 1 00:13:43.642 15:14:41 -- scripts/common.sh@352 -- # local d=1 00:13:43.642 15:14:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:43.642 15:14:41 -- scripts/common.sh@354 -- # echo 1 00:13:43.642 15:14:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:43.642 15:14:41 -- scripts/common.sh@365 -- # decimal 2 00:13:43.642 15:14:41 -- scripts/common.sh@352 -- # local d=2 00:13:43.642 15:14:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:43.642 15:14:41 -- scripts/common.sh@354 -- # echo 2 00:13:43.642 15:14:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:43.642 15:14:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:43.642 15:14:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:43.642 15:14:41 -- scripts/common.sh@367 -- # return 0 00:13:43.642 15:14:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:43.642 15:14:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:43.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.642 --rc genhtml_branch_coverage=1 00:13:43.642 --rc genhtml_function_coverage=1 00:13:43.642 --rc genhtml_legend=1 00:13:43.642 --rc geninfo_all_blocks=1 00:13:43.642 --rc geninfo_unexecuted_blocks=1 00:13:43.642 00:13:43.642 ' 00:13:43.642 15:14:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:43.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.642 --rc genhtml_branch_coverage=1 00:13:43.642 --rc genhtml_function_coverage=1 00:13:43.642 --rc genhtml_legend=1 00:13:43.642 --rc geninfo_all_blocks=1 00:13:43.642 --rc geninfo_unexecuted_blocks=1 00:13:43.642 00:13:43.642 ' 00:13:43.642 15:14:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:43.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.643 --rc genhtml_branch_coverage=1 00:13:43.643 --rc genhtml_function_coverage=1 00:13:43.643 --rc genhtml_legend=1 00:13:43.643 --rc geninfo_all_blocks=1 00:13:43.643 --rc geninfo_unexecuted_blocks=1 00:13:43.643 00:13:43.643 ' 00:13:43.643 15:14:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:43.643 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.643 --rc genhtml_branch_coverage=1 00:13:43.643 --rc genhtml_function_coverage=1 00:13:43.643 --rc genhtml_legend=1 00:13:43.643 --rc geninfo_all_blocks=1 00:13:43.643 --rc geninfo_unexecuted_blocks=1 00:13:43.643 00:13:43.643 ' 00:13:43.643 15:14:41 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.643 15:14:41 -- nvmf/common.sh@7 -- # uname -s 00:13:43.643 15:14:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.643 15:14:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.643 15:14:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.643 15:14:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.643 15:14:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.643 15:14:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.643 15:14:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.643 15:14:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.643 15:14:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.643 15:14:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.643 15:14:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.643 15:14:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.643 15:14:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.643 15:14:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.643 15:14:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.643 15:14:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:43.643 15:14:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.643 15:14:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.643 15:14:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.643 15:14:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.643 15:14:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.643 15:14:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.643 15:14:41 -- paths/export.sh@5 -- # export PATH 00:13:43.643 15:14:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.643 15:14:41 -- nvmf/common.sh@46 -- # : 0 00:13:43.643 15:14:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:43.643 15:14:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:43.643 15:14:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:43.643 15:14:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.643 15:14:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.643 15:14:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:43.643 15:14:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:43.643 15:14:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:43.643 15:14:41 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:43.643 15:14:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:43.643 15:14:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.643 15:14:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:43.643 15:14:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:43.643 15:14:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:43.643 15:14:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.643 15:14:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.643 15:14:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.643 15:14:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:43.643 15:14:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:43.643 15:14:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:43.643 15:14:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.545 15:14:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:45.545 15:14:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:45.545 15:14:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:45.545 15:14:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:45.545 15:14:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:45.545 15:14:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:45.545 15:14:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:45.545 15:14:43 -- nvmf/common.sh@294 -- # net_devs=() 00:13:45.545 15:14:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:45.545 15:14:43 -- nvmf/common.sh@295 -- # e810=() 00:13:45.545 15:14:43 -- nvmf/common.sh@295 -- # local -ga e810 00:13:45.545 15:14:43 -- nvmf/common.sh@296 -- # x722=() 00:13:45.545 15:14:43 -- nvmf/common.sh@296 -- # local -ga x722 00:13:45.545 15:14:43 -- nvmf/common.sh@297 -- # mlx=() 00:13:45.545 15:14:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:45.545 15:14:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:45.545 15:14:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:45.545 15:14:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:45.545 15:14:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.545 15:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:45.545 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:45.545 15:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.545 15:14:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:45.545 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:45.545 15:14:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.545 15:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.545 15:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.545 15:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:45.545 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:45.545 15:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.545 15:14:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.545 15:14:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.545 15:14:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.545 15:14:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:45.545 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:45.545 15:14:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.545 15:14:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:45.545 15:14:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:45.545 15:14:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:45.545 15:14:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:45.545 15:14:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:45.545 15:14:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:45.545 15:14:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:45.545 15:14:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:45.545 15:14:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:45.545 15:14:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:45.545 15:14:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:45.545 15:14:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:45.545 15:14:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:45.545 15:14:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:45.545 15:14:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:45.545 15:14:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:45.545 15:14:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:45.545 15:14:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:45.545 15:14:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:45.545 15:14:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:45.545 15:14:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:45.545 15:14:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:45.545 15:14:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:45.804 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:45.804 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:13:45.804 00:13:45.804 --- 10.0.0.2 ping statistics --- 00:13:45.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.804 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:13:45.804 15:14:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:45.804 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:45.804 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:13:45.804 00:13:45.804 --- 10.0.0.1 ping statistics --- 00:13:45.804 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.804 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:13:45.804 15:14:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:45.804 15:14:44 -- nvmf/common.sh@410 -- # return 0 00:13:45.804 15:14:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:45.804 15:14:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:45.804 15:14:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:45.804 15:14:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:45.804 15:14:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:45.804 15:14:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:45.804 15:14:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:45.804 15:14:44 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:45.804 15:14:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:45.804 15:14:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:45.804 15:14:44 -- common/autotest_common.sh@10 -- # set +x 00:13:45.804 15:14:44 -- nvmf/common.sh@469 -- # nvmfpid=2732935 00:13:45.804 15:14:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:45.804 15:14:44 -- nvmf/common.sh@470 -- # waitforlisten 2732935 00:13:45.804 15:14:44 -- common/autotest_common.sh@829 -- # '[' -z 2732935 ']' 00:13:45.804 15:14:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:45.804 15:14:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:45.804 15:14:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:45.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:45.804 15:14:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:45.804 15:14:44 -- common/autotest_common.sh@10 -- # set +x 00:13:45.804 [2024-11-19 15:14:44.180374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.804 [2024-11-19 15:14:44.180438] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:45.804 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.804 [2024-11-19 15:14:44.245416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:45.804 [2024-11-19 15:14:44.360651] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:45.804 [2024-11-19 15:14:44.360838] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:45.804 [2024-11-19 15:14:44.360869] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:45.804 [2024-11-19 15:14:44.360891] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:45.804 [2024-11-19 15:14:44.360933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:46.738 15:14:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:46.738 15:14:45 -- common/autotest_common.sh@862 -- # return 0 00:13:46.738 15:14:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:46.738 15:14:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:46.738 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.738 15:14:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:46.738 15:14:45 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:46.738 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.738 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.738 [2024-11-19 15:14:45.151374] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:46.738 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.738 15:14:45 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:46.738 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.738 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.738 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.738 15:14:45 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:46.738 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.738 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.738 [2024-11-19 15:14:45.167572] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:46.738 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.738 15:14:45 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:46.739 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.739 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.739 NULL1 00:13:46.739 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.739 15:14:45 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:46.739 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.739 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.739 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.739 15:14:45 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:46.739 15:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.739 15:14:45 -- common/autotest_common.sh@10 -- # set +x 00:13:46.739 15:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.739 15:14:45 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:46.739 [2024-11-19 15:14:45.212134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:46.739 [2024-11-19 15:14:45.212174] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2733092 ] 00:13:46.739 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.304 Attached to nqn.2016-06.io.spdk:cnode1 00:13:47.304 Namespace ID: 1 size: 1GB 00:13:47.304 fused_ordering(0) 00:13:47.304 fused_ordering(1) 00:13:47.304 fused_ordering(2) 00:13:47.304 fused_ordering(3) 00:13:47.304 fused_ordering(4) 00:13:47.304 fused_ordering(5) 00:13:47.304 fused_ordering(6) 00:13:47.304 fused_ordering(7) 00:13:47.304 fused_ordering(8) 00:13:47.304 fused_ordering(9) 00:13:47.304 fused_ordering(10) 00:13:47.304 fused_ordering(11) 00:13:47.304 fused_ordering(12) 00:13:47.304 fused_ordering(13) 00:13:47.304 fused_ordering(14) 00:13:47.304 fused_ordering(15) 00:13:47.304 fused_ordering(16) 00:13:47.304 fused_ordering(17) 00:13:47.304 fused_ordering(18) 00:13:47.304 fused_ordering(19) 00:13:47.304 fused_ordering(20) 00:13:47.304 fused_ordering(21) 00:13:47.304 fused_ordering(22) 00:13:47.304 fused_ordering(23) 00:13:47.304 fused_ordering(24) 00:13:47.304 fused_ordering(25) 00:13:47.304 fused_ordering(26) 00:13:47.304 fused_ordering(27) 00:13:47.304 fused_ordering(28) 00:13:47.304 fused_ordering(29) 00:13:47.304 fused_ordering(30) 00:13:47.304 fused_ordering(31) 00:13:47.304 fused_ordering(32) 00:13:47.304 fused_ordering(33) 00:13:47.304 fused_ordering(34) 00:13:47.304 fused_ordering(35) 00:13:47.304 fused_ordering(36) 00:13:47.304 fused_ordering(37) 00:13:47.304 fused_ordering(38) 00:13:47.304 fused_ordering(39) 00:13:47.304 fused_ordering(40) 00:13:47.304 fused_ordering(41) 00:13:47.304 fused_ordering(42) 00:13:47.304 fused_ordering(43) 00:13:47.304 fused_ordering(44) 00:13:47.304 fused_ordering(45) 00:13:47.304 fused_ordering(46) 00:13:47.304 fused_ordering(47) 00:13:47.304 fused_ordering(48) 00:13:47.304 fused_ordering(49) 00:13:47.304 fused_ordering(50) 00:13:47.304 fused_ordering(51) 00:13:47.304 fused_ordering(52) 00:13:47.304 fused_ordering(53) 00:13:47.304 fused_ordering(54) 00:13:47.304 fused_ordering(55) 00:13:47.304 fused_ordering(56) 00:13:47.304 fused_ordering(57) 00:13:47.304 fused_ordering(58) 00:13:47.304 fused_ordering(59) 00:13:47.304 fused_ordering(60) 00:13:47.304 fused_ordering(61) 00:13:47.304 fused_ordering(62) 00:13:47.304 fused_ordering(63) 00:13:47.304 fused_ordering(64) 00:13:47.304 fused_ordering(65) 00:13:47.304 fused_ordering(66) 00:13:47.304 fused_ordering(67) 00:13:47.304 fused_ordering(68) 00:13:47.304 fused_ordering(69) 00:13:47.304 fused_ordering(70) 00:13:47.304 fused_ordering(71) 00:13:47.304 fused_ordering(72) 00:13:47.304 fused_ordering(73) 00:13:47.304 fused_ordering(74) 00:13:47.304 fused_ordering(75) 00:13:47.304 fused_ordering(76) 00:13:47.304 fused_ordering(77) 00:13:47.304 fused_ordering(78) 00:13:47.304 fused_ordering(79) 00:13:47.304 fused_ordering(80) 00:13:47.304 fused_ordering(81) 00:13:47.304 fused_ordering(82) 00:13:47.304 fused_ordering(83) 00:13:47.304 fused_ordering(84) 00:13:47.304 fused_ordering(85) 00:13:47.304 fused_ordering(86) 00:13:47.304 fused_ordering(87) 00:13:47.304 fused_ordering(88) 00:13:47.304 fused_ordering(89) 00:13:47.304 fused_ordering(90) 00:13:47.304 fused_ordering(91) 00:13:47.304 fused_ordering(92) 00:13:47.304 fused_ordering(93) 00:13:47.304 fused_ordering(94) 00:13:47.304 fused_ordering(95) 00:13:47.304 fused_ordering(96) 00:13:47.304 fused_ordering(97) 00:13:47.304 fused_ordering(98) 00:13:47.304 fused_ordering(99) 00:13:47.304 fused_ordering(100) 00:13:47.304 fused_ordering(101) 00:13:47.304 fused_ordering(102) 00:13:47.304 fused_ordering(103) 00:13:47.304 fused_ordering(104) 00:13:47.304 fused_ordering(105) 00:13:47.304 fused_ordering(106) 00:13:47.304 fused_ordering(107) 00:13:47.304 fused_ordering(108) 00:13:47.304 fused_ordering(109) 00:13:47.304 fused_ordering(110) 00:13:47.304 fused_ordering(111) 00:13:47.304 fused_ordering(112) 00:13:47.304 fused_ordering(113) 00:13:47.304 fused_ordering(114) 00:13:47.304 fused_ordering(115) 00:13:47.304 fused_ordering(116) 00:13:47.304 fused_ordering(117) 00:13:47.304 fused_ordering(118) 00:13:47.304 fused_ordering(119) 00:13:47.304 fused_ordering(120) 00:13:47.304 fused_ordering(121) 00:13:47.304 fused_ordering(122) 00:13:47.304 fused_ordering(123) 00:13:47.304 fused_ordering(124) 00:13:47.304 fused_ordering(125) 00:13:47.304 fused_ordering(126) 00:13:47.304 fused_ordering(127) 00:13:47.304 fused_ordering(128) 00:13:47.304 fused_ordering(129) 00:13:47.304 fused_ordering(130) 00:13:47.304 fused_ordering(131) 00:13:47.304 fused_ordering(132) 00:13:47.304 fused_ordering(133) 00:13:47.304 fused_ordering(134) 00:13:47.304 fused_ordering(135) 00:13:47.304 fused_ordering(136) 00:13:47.304 fused_ordering(137) 00:13:47.304 fused_ordering(138) 00:13:47.304 fused_ordering(139) 00:13:47.304 fused_ordering(140) 00:13:47.304 fused_ordering(141) 00:13:47.304 fused_ordering(142) 00:13:47.304 fused_ordering(143) 00:13:47.304 fused_ordering(144) 00:13:47.304 fused_ordering(145) 00:13:47.304 fused_ordering(146) 00:13:47.304 fused_ordering(147) 00:13:47.304 fused_ordering(148) 00:13:47.304 fused_ordering(149) 00:13:47.304 fused_ordering(150) 00:13:47.304 fused_ordering(151) 00:13:47.304 fused_ordering(152) 00:13:47.304 fused_ordering(153) 00:13:47.304 fused_ordering(154) 00:13:47.304 fused_ordering(155) 00:13:47.304 fused_ordering(156) 00:13:47.304 fused_ordering(157) 00:13:47.304 fused_ordering(158) 00:13:47.304 fused_ordering(159) 00:13:47.304 fused_ordering(160) 00:13:47.304 fused_ordering(161) 00:13:47.304 fused_ordering(162) 00:13:47.304 fused_ordering(163) 00:13:47.304 fused_ordering(164) 00:13:47.304 fused_ordering(165) 00:13:47.304 fused_ordering(166) 00:13:47.304 fused_ordering(167) 00:13:47.304 fused_ordering(168) 00:13:47.304 fused_ordering(169) 00:13:47.304 fused_ordering(170) 00:13:47.304 fused_ordering(171) 00:13:47.304 fused_ordering(172) 00:13:47.304 fused_ordering(173) 00:13:47.304 fused_ordering(174) 00:13:47.304 fused_ordering(175) 00:13:47.304 fused_ordering(176) 00:13:47.304 fused_ordering(177) 00:13:47.304 fused_ordering(178) 00:13:47.304 fused_ordering(179) 00:13:47.304 fused_ordering(180) 00:13:47.304 fused_ordering(181) 00:13:47.304 fused_ordering(182) 00:13:47.304 fused_ordering(183) 00:13:47.304 fused_ordering(184) 00:13:47.304 fused_ordering(185) 00:13:47.304 fused_ordering(186) 00:13:47.304 fused_ordering(187) 00:13:47.304 fused_ordering(188) 00:13:47.304 fused_ordering(189) 00:13:47.304 fused_ordering(190) 00:13:47.304 fused_ordering(191) 00:13:47.304 fused_ordering(192) 00:13:47.304 fused_ordering(193) 00:13:47.304 fused_ordering(194) 00:13:47.304 fused_ordering(195) 00:13:47.304 fused_ordering(196) 00:13:47.304 fused_ordering(197) 00:13:47.304 fused_ordering(198) 00:13:47.304 fused_ordering(199) 00:13:47.304 fused_ordering(200) 00:13:47.304 fused_ordering(201) 00:13:47.304 fused_ordering(202) 00:13:47.304 fused_ordering(203) 00:13:47.304 fused_ordering(204) 00:13:47.304 fused_ordering(205) 00:13:47.563 fused_ordering(206) 00:13:47.563 fused_ordering(207) 00:13:47.563 fused_ordering(208) 00:13:47.563 fused_ordering(209) 00:13:47.563 fused_ordering(210) 00:13:47.563 fused_ordering(211) 00:13:47.563 fused_ordering(212) 00:13:47.563 fused_ordering(213) 00:13:47.563 fused_ordering(214) 00:13:47.563 fused_ordering(215) 00:13:47.563 fused_ordering(216) 00:13:47.563 fused_ordering(217) 00:13:47.563 fused_ordering(218) 00:13:47.563 fused_ordering(219) 00:13:47.563 fused_ordering(220) 00:13:47.563 fused_ordering(221) 00:13:47.563 fused_ordering(222) 00:13:47.563 fused_ordering(223) 00:13:47.563 fused_ordering(224) 00:13:47.563 fused_ordering(225) 00:13:47.563 fused_ordering(226) 00:13:47.563 fused_ordering(227) 00:13:47.563 fused_ordering(228) 00:13:47.563 fused_ordering(229) 00:13:47.563 fused_ordering(230) 00:13:47.563 fused_ordering(231) 00:13:47.563 fused_ordering(232) 00:13:47.563 fused_ordering(233) 00:13:47.563 fused_ordering(234) 00:13:47.563 fused_ordering(235) 00:13:47.563 fused_ordering(236) 00:13:47.563 fused_ordering(237) 00:13:47.563 fused_ordering(238) 00:13:47.563 fused_ordering(239) 00:13:47.563 fused_ordering(240) 00:13:47.563 fused_ordering(241) 00:13:47.563 fused_ordering(242) 00:13:47.563 fused_ordering(243) 00:13:47.563 fused_ordering(244) 00:13:47.563 fused_ordering(245) 00:13:47.563 fused_ordering(246) 00:13:47.563 fused_ordering(247) 00:13:47.563 fused_ordering(248) 00:13:47.563 fused_ordering(249) 00:13:47.563 fused_ordering(250) 00:13:47.563 fused_ordering(251) 00:13:47.563 fused_ordering(252) 00:13:47.563 fused_ordering(253) 00:13:47.563 fused_ordering(254) 00:13:47.563 fused_ordering(255) 00:13:47.563 fused_ordering(256) 00:13:47.563 fused_ordering(257) 00:13:47.563 fused_ordering(258) 00:13:47.563 fused_ordering(259) 00:13:47.563 fused_ordering(260) 00:13:47.563 fused_ordering(261) 00:13:47.563 fused_ordering(262) 00:13:47.563 fused_ordering(263) 00:13:47.563 fused_ordering(264) 00:13:47.563 fused_ordering(265) 00:13:47.563 fused_ordering(266) 00:13:47.563 fused_ordering(267) 00:13:47.563 fused_ordering(268) 00:13:47.563 fused_ordering(269) 00:13:47.563 fused_ordering(270) 00:13:47.563 fused_ordering(271) 00:13:47.563 fused_ordering(272) 00:13:47.563 fused_ordering(273) 00:13:47.563 fused_ordering(274) 00:13:47.563 fused_ordering(275) 00:13:47.563 fused_ordering(276) 00:13:47.563 fused_ordering(277) 00:13:47.563 fused_ordering(278) 00:13:47.563 fused_ordering(279) 00:13:47.563 fused_ordering(280) 00:13:47.563 fused_ordering(281) 00:13:47.563 fused_ordering(282) 00:13:47.563 fused_ordering(283) 00:13:47.563 fused_ordering(284) 00:13:47.563 fused_ordering(285) 00:13:47.563 fused_ordering(286) 00:13:47.563 fused_ordering(287) 00:13:47.563 fused_ordering(288) 00:13:47.563 fused_ordering(289) 00:13:47.563 fused_ordering(290) 00:13:47.563 fused_ordering(291) 00:13:47.563 fused_ordering(292) 00:13:47.563 fused_ordering(293) 00:13:47.563 fused_ordering(294) 00:13:47.563 fused_ordering(295) 00:13:47.563 fused_ordering(296) 00:13:47.563 fused_ordering(297) 00:13:47.563 fused_ordering(298) 00:13:47.563 fused_ordering(299) 00:13:47.563 fused_ordering(300) 00:13:47.563 fused_ordering(301) 00:13:47.563 fused_ordering(302) 00:13:47.563 fused_ordering(303) 00:13:47.563 fused_ordering(304) 00:13:47.563 fused_ordering(305) 00:13:47.563 fused_ordering(306) 00:13:47.563 fused_ordering(307) 00:13:47.563 fused_ordering(308) 00:13:47.563 fused_ordering(309) 00:13:47.563 fused_ordering(310) 00:13:47.563 fused_ordering(311) 00:13:47.563 fused_ordering(312) 00:13:47.563 fused_ordering(313) 00:13:47.563 fused_ordering(314) 00:13:47.563 fused_ordering(315) 00:13:47.563 fused_ordering(316) 00:13:47.563 fused_ordering(317) 00:13:47.563 fused_ordering(318) 00:13:47.563 fused_ordering(319) 00:13:47.563 fused_ordering(320) 00:13:47.563 fused_ordering(321) 00:13:47.563 fused_ordering(322) 00:13:47.563 fused_ordering(323) 00:13:47.563 fused_ordering(324) 00:13:47.563 fused_ordering(325) 00:13:47.563 fused_ordering(326) 00:13:47.563 fused_ordering(327) 00:13:47.563 fused_ordering(328) 00:13:47.563 fused_ordering(329) 00:13:47.563 fused_ordering(330) 00:13:47.563 fused_ordering(331) 00:13:47.563 fused_ordering(332) 00:13:47.563 fused_ordering(333) 00:13:47.563 fused_ordering(334) 00:13:47.563 fused_ordering(335) 00:13:47.563 fused_ordering(336) 00:13:47.563 fused_ordering(337) 00:13:47.563 fused_ordering(338) 00:13:47.563 fused_ordering(339) 00:13:47.563 fused_ordering(340) 00:13:47.563 fused_ordering(341) 00:13:47.563 fused_ordering(342) 00:13:47.563 fused_ordering(343) 00:13:47.563 fused_ordering(344) 00:13:47.563 fused_ordering(345) 00:13:47.563 fused_ordering(346) 00:13:47.563 fused_ordering(347) 00:13:47.563 fused_ordering(348) 00:13:47.563 fused_ordering(349) 00:13:47.563 fused_ordering(350) 00:13:47.563 fused_ordering(351) 00:13:47.563 fused_ordering(352) 00:13:47.563 fused_ordering(353) 00:13:47.563 fused_ordering(354) 00:13:47.563 fused_ordering(355) 00:13:47.563 fused_ordering(356) 00:13:47.563 fused_ordering(357) 00:13:47.563 fused_ordering(358) 00:13:47.563 fused_ordering(359) 00:13:47.563 fused_ordering(360) 00:13:47.563 fused_ordering(361) 00:13:47.563 fused_ordering(362) 00:13:47.563 fused_ordering(363) 00:13:47.563 fused_ordering(364) 00:13:47.563 fused_ordering(365) 00:13:47.563 fused_ordering(366) 00:13:47.563 fused_ordering(367) 00:13:47.563 fused_ordering(368) 00:13:47.563 fused_ordering(369) 00:13:47.563 fused_ordering(370) 00:13:47.563 fused_ordering(371) 00:13:47.563 fused_ordering(372) 00:13:47.563 fused_ordering(373) 00:13:47.563 fused_ordering(374) 00:13:47.563 fused_ordering(375) 00:13:47.563 fused_ordering(376) 00:13:47.563 fused_ordering(377) 00:13:47.563 fused_ordering(378) 00:13:47.563 fused_ordering(379) 00:13:47.563 fused_ordering(380) 00:13:47.563 fused_ordering(381) 00:13:47.563 fused_ordering(382) 00:13:47.563 fused_ordering(383) 00:13:47.563 fused_ordering(384) 00:13:47.563 fused_ordering(385) 00:13:47.563 fused_ordering(386) 00:13:47.563 fused_ordering(387) 00:13:47.563 fused_ordering(388) 00:13:47.564 fused_ordering(389) 00:13:47.564 fused_ordering(390) 00:13:47.564 fused_ordering(391) 00:13:47.564 fused_ordering(392) 00:13:47.564 fused_ordering(393) 00:13:47.564 fused_ordering(394) 00:13:47.564 fused_ordering(395) 00:13:47.564 fused_ordering(396) 00:13:47.564 fused_ordering(397) 00:13:47.564 fused_ordering(398) 00:13:47.564 fused_ordering(399) 00:13:47.564 fused_ordering(400) 00:13:47.564 fused_ordering(401) 00:13:47.564 fused_ordering(402) 00:13:47.564 fused_ordering(403) 00:13:47.564 fused_ordering(404) 00:13:47.564 fused_ordering(405) 00:13:47.564 fused_ordering(406) 00:13:47.564 fused_ordering(407) 00:13:47.564 fused_ordering(408) 00:13:47.564 fused_ordering(409) 00:13:47.564 fused_ordering(410) 00:13:48.130 fused_ordering(411) 00:13:48.130 fused_ordering(412) 00:13:48.130 fused_ordering(413) 00:13:48.130 fused_ordering(414) 00:13:48.130 fused_ordering(415) 00:13:48.130 fused_ordering(416) 00:13:48.130 fused_ordering(417) 00:13:48.130 fused_ordering(418) 00:13:48.130 fused_ordering(419) 00:13:48.130 fused_ordering(420) 00:13:48.130 fused_ordering(421) 00:13:48.130 fused_ordering(422) 00:13:48.130 fused_ordering(423) 00:13:48.130 fused_ordering(424) 00:13:48.130 fused_ordering(425) 00:13:48.130 fused_ordering(426) 00:13:48.130 fused_ordering(427) 00:13:48.130 fused_ordering(428) 00:13:48.130 fused_ordering(429) 00:13:48.130 fused_ordering(430) 00:13:48.130 fused_ordering(431) 00:13:48.130 fused_ordering(432) 00:13:48.130 fused_ordering(433) 00:13:48.130 fused_ordering(434) 00:13:48.130 fused_ordering(435) 00:13:48.130 fused_ordering(436) 00:13:48.130 fused_ordering(437) 00:13:48.130 fused_ordering(438) 00:13:48.130 fused_ordering(439) 00:13:48.130 fused_ordering(440) 00:13:48.130 fused_ordering(441) 00:13:48.130 fused_ordering(442) 00:13:48.130 fused_ordering(443) 00:13:48.130 fused_ordering(444) 00:13:48.130 fused_ordering(445) 00:13:48.130 fused_ordering(446) 00:13:48.130 fused_ordering(447) 00:13:48.130 fused_ordering(448) 00:13:48.130 fused_ordering(449) 00:13:48.130 fused_ordering(450) 00:13:48.130 fused_ordering(451) 00:13:48.130 fused_ordering(452) 00:13:48.130 fused_ordering(453) 00:13:48.130 fused_ordering(454) 00:13:48.130 fused_ordering(455) 00:13:48.130 fused_ordering(456) 00:13:48.130 fused_ordering(457) 00:13:48.130 fused_ordering(458) 00:13:48.130 fused_ordering(459) 00:13:48.130 fused_ordering(460) 00:13:48.130 fused_ordering(461) 00:13:48.130 fused_ordering(462) 00:13:48.130 fused_ordering(463) 00:13:48.130 fused_ordering(464) 00:13:48.130 fused_ordering(465) 00:13:48.130 fused_ordering(466) 00:13:48.130 fused_ordering(467) 00:13:48.130 fused_ordering(468) 00:13:48.130 fused_ordering(469) 00:13:48.130 fused_ordering(470) 00:13:48.130 fused_ordering(471) 00:13:48.130 fused_ordering(472) 00:13:48.130 fused_ordering(473) 00:13:48.130 fused_ordering(474) 00:13:48.130 fused_ordering(475) 00:13:48.130 fused_ordering(476) 00:13:48.130 fused_ordering(477) 00:13:48.130 fused_ordering(478) 00:13:48.130 fused_ordering(479) 00:13:48.130 fused_ordering(480) 00:13:48.130 fused_ordering(481) 00:13:48.130 fused_ordering(482) 00:13:48.130 fused_ordering(483) 00:13:48.130 fused_ordering(484) 00:13:48.130 fused_ordering(485) 00:13:48.130 fused_ordering(486) 00:13:48.130 fused_ordering(487) 00:13:48.130 fused_ordering(488) 00:13:48.130 fused_ordering(489) 00:13:48.130 fused_ordering(490) 00:13:48.130 fused_ordering(491) 00:13:48.130 fused_ordering(492) 00:13:48.130 fused_ordering(493) 00:13:48.130 fused_ordering(494) 00:13:48.130 fused_ordering(495) 00:13:48.130 fused_ordering(496) 00:13:48.130 fused_ordering(497) 00:13:48.130 fused_ordering(498) 00:13:48.130 fused_ordering(499) 00:13:48.130 fused_ordering(500) 00:13:48.130 fused_ordering(501) 00:13:48.130 fused_ordering(502) 00:13:48.130 fused_ordering(503) 00:13:48.130 fused_ordering(504) 00:13:48.130 fused_ordering(505) 00:13:48.130 fused_ordering(506) 00:13:48.130 fused_ordering(507) 00:13:48.130 fused_ordering(508) 00:13:48.130 fused_ordering(509) 00:13:48.130 fused_ordering(510) 00:13:48.130 fused_ordering(511) 00:13:48.130 fused_ordering(512) 00:13:48.130 fused_ordering(513) 00:13:48.130 fused_ordering(514) 00:13:48.130 fused_ordering(515) 00:13:48.130 fused_ordering(516) 00:13:48.130 fused_ordering(517) 00:13:48.130 fused_ordering(518) 00:13:48.130 fused_ordering(519) 00:13:48.130 fused_ordering(520) 00:13:48.130 fused_ordering(521) 00:13:48.130 fused_ordering(522) 00:13:48.130 fused_ordering(523) 00:13:48.130 fused_ordering(524) 00:13:48.130 fused_ordering(525) 00:13:48.130 fused_ordering(526) 00:13:48.130 fused_ordering(527) 00:13:48.130 fused_ordering(528) 00:13:48.130 fused_ordering(529) 00:13:48.130 fused_ordering(530) 00:13:48.130 fused_ordering(531) 00:13:48.130 fused_ordering(532) 00:13:48.130 fused_ordering(533) 00:13:48.130 fused_ordering(534) 00:13:48.130 fused_ordering(535) 00:13:48.130 fused_ordering(536) 00:13:48.130 fused_ordering(537) 00:13:48.130 fused_ordering(538) 00:13:48.130 fused_ordering(539) 00:13:48.130 fused_ordering(540) 00:13:48.130 fused_ordering(541) 00:13:48.130 fused_ordering(542) 00:13:48.130 fused_ordering(543) 00:13:48.130 fused_ordering(544) 00:13:48.130 fused_ordering(545) 00:13:48.130 fused_ordering(546) 00:13:48.130 fused_ordering(547) 00:13:48.130 fused_ordering(548) 00:13:48.130 fused_ordering(549) 00:13:48.130 fused_ordering(550) 00:13:48.130 fused_ordering(551) 00:13:48.130 fused_ordering(552) 00:13:48.130 fused_ordering(553) 00:13:48.130 fused_ordering(554) 00:13:48.130 fused_ordering(555) 00:13:48.130 fused_ordering(556) 00:13:48.130 fused_ordering(557) 00:13:48.130 fused_ordering(558) 00:13:48.130 fused_ordering(559) 00:13:48.130 fused_ordering(560) 00:13:48.130 fused_ordering(561) 00:13:48.130 fused_ordering(562) 00:13:48.130 fused_ordering(563) 00:13:48.130 fused_ordering(564) 00:13:48.130 fused_ordering(565) 00:13:48.130 fused_ordering(566) 00:13:48.130 fused_ordering(567) 00:13:48.130 fused_ordering(568) 00:13:48.130 fused_ordering(569) 00:13:48.130 fused_ordering(570) 00:13:48.130 fused_ordering(571) 00:13:48.130 fused_ordering(572) 00:13:48.130 fused_ordering(573) 00:13:48.130 fused_ordering(574) 00:13:48.130 fused_ordering(575) 00:13:48.130 fused_ordering(576) 00:13:48.130 fused_ordering(577) 00:13:48.130 fused_ordering(578) 00:13:48.130 fused_ordering(579) 00:13:48.130 fused_ordering(580) 00:13:48.130 fused_ordering(581) 00:13:48.130 fused_ordering(582) 00:13:48.130 fused_ordering(583) 00:13:48.130 fused_ordering(584) 00:13:48.131 fused_ordering(585) 00:13:48.131 fused_ordering(586) 00:13:48.131 fused_ordering(587) 00:13:48.131 fused_ordering(588) 00:13:48.131 fused_ordering(589) 00:13:48.131 fused_ordering(590) 00:13:48.131 fused_ordering(591) 00:13:48.131 fused_ordering(592) 00:13:48.131 fused_ordering(593) 00:13:48.131 fused_ordering(594) 00:13:48.131 fused_ordering(595) 00:13:48.131 fused_ordering(596) 00:13:48.131 fused_ordering(597) 00:13:48.131 fused_ordering(598) 00:13:48.131 fused_ordering(599) 00:13:48.131 fused_ordering(600) 00:13:48.131 fused_ordering(601) 00:13:48.131 fused_ordering(602) 00:13:48.131 fused_ordering(603) 00:13:48.131 fused_ordering(604) 00:13:48.131 fused_ordering(605) 00:13:48.131 fused_ordering(606) 00:13:48.131 fused_ordering(607) 00:13:48.131 fused_ordering(608) 00:13:48.131 fused_ordering(609) 00:13:48.131 fused_ordering(610) 00:13:48.131 fused_ordering(611) 00:13:48.131 fused_ordering(612) 00:13:48.131 fused_ordering(613) 00:13:48.131 fused_ordering(614) 00:13:48.131 fused_ordering(615) 00:13:48.696 fused_ordering(616) 00:13:48.696 fused_ordering(617) 00:13:48.696 fused_ordering(618) 00:13:48.696 fused_ordering(619) 00:13:48.696 fused_ordering(620) 00:13:48.696 fused_ordering(621) 00:13:48.696 fused_ordering(622) 00:13:48.696 fused_ordering(623) 00:13:48.696 fused_ordering(624) 00:13:48.696 fused_ordering(625) 00:13:48.696 fused_ordering(626) 00:13:48.696 fused_ordering(627) 00:13:48.696 fused_ordering(628) 00:13:48.696 fused_ordering(629) 00:13:48.696 fused_ordering(630) 00:13:48.696 fused_ordering(631) 00:13:48.696 fused_ordering(632) 00:13:48.696 fused_ordering(633) 00:13:48.696 fused_ordering(634) 00:13:48.696 fused_ordering(635) 00:13:48.696 fused_ordering(636) 00:13:48.696 fused_ordering(637) 00:13:48.696 fused_ordering(638) 00:13:48.696 fused_ordering(639) 00:13:48.696 fused_ordering(640) 00:13:48.696 fused_ordering(641) 00:13:48.696 fused_ordering(642) 00:13:48.696 fused_ordering(643) 00:13:48.696 fused_ordering(644) 00:13:48.696 fused_ordering(645) 00:13:48.696 fused_ordering(646) 00:13:48.696 fused_ordering(647) 00:13:48.696 fused_ordering(648) 00:13:48.696 fused_ordering(649) 00:13:48.696 fused_ordering(650) 00:13:48.696 fused_ordering(651) 00:13:48.696 fused_ordering(652) 00:13:48.697 fused_ordering(653) 00:13:48.697 fused_ordering(654) 00:13:48.697 fused_ordering(655) 00:13:48.697 fused_ordering(656) 00:13:48.697 fused_ordering(657) 00:13:48.697 fused_ordering(658) 00:13:48.697 fused_ordering(659) 00:13:48.697 fused_ordering(660) 00:13:48.697 fused_ordering(661) 00:13:48.697 fused_ordering(662) 00:13:48.697 fused_ordering(663) 00:13:48.697 fused_ordering(664) 00:13:48.697 fused_ordering(665) 00:13:48.697 fused_ordering(666) 00:13:48.697 fused_ordering(667) 00:13:48.697 fused_ordering(668) 00:13:48.697 fused_ordering(669) 00:13:48.697 fused_ordering(670) 00:13:48.697 fused_ordering(671) 00:13:48.697 fused_ordering(672) 00:13:48.697 fused_ordering(673) 00:13:48.697 fused_ordering(674) 00:13:48.697 fused_ordering(675) 00:13:48.697 fused_ordering(676) 00:13:48.697 fused_ordering(677) 00:13:48.697 fused_ordering(678) 00:13:48.697 fused_ordering(679) 00:13:48.697 fused_ordering(680) 00:13:48.697 fused_ordering(681) 00:13:48.697 fused_ordering(682) 00:13:48.697 fused_ordering(683) 00:13:48.697 fused_ordering(684) 00:13:48.697 fused_ordering(685) 00:13:48.697 fused_ordering(686) 00:13:48.697 fused_ordering(687) 00:13:48.697 fused_ordering(688) 00:13:48.697 fused_ordering(689) 00:13:48.697 fused_ordering(690) 00:13:48.697 fused_ordering(691) 00:13:48.697 fused_ordering(692) 00:13:48.697 fused_ordering(693) 00:13:48.697 fused_ordering(694) 00:13:48.697 fused_ordering(695) 00:13:48.697 fused_ordering(696) 00:13:48.697 fused_ordering(697) 00:13:48.697 fused_ordering(698) 00:13:48.697 fused_ordering(699) 00:13:48.697 fused_ordering(700) 00:13:48.697 fused_ordering(701) 00:13:48.697 fused_ordering(702) 00:13:48.697 fused_ordering(703) 00:13:48.697 fused_ordering(704) 00:13:48.697 fused_ordering(705) 00:13:48.697 fused_ordering(706) 00:13:48.697 fused_ordering(707) 00:13:48.697 fused_ordering(708) 00:13:48.697 fused_ordering(709) 00:13:48.697 fused_ordering(710) 00:13:48.697 fused_ordering(711) 00:13:48.697 fused_ordering(712) 00:13:48.697 fused_ordering(713) 00:13:48.697 fused_ordering(714) 00:13:48.697 fused_ordering(715) 00:13:48.697 fused_ordering(716) 00:13:48.697 fused_ordering(717) 00:13:48.697 fused_ordering(718) 00:13:48.697 fused_ordering(719) 00:13:48.697 fused_ordering(720) 00:13:48.697 fused_ordering(721) 00:13:48.697 fused_ordering(722) 00:13:48.697 fused_ordering(723) 00:13:48.697 fused_ordering(724) 00:13:48.697 fused_ordering(725) 00:13:48.697 fused_ordering(726) 00:13:48.697 fused_ordering(727) 00:13:48.697 fused_ordering(728) 00:13:48.697 fused_ordering(729) 00:13:48.697 fused_ordering(730) 00:13:48.697 fused_ordering(731) 00:13:48.697 fused_ordering(732) 00:13:48.697 fused_ordering(733) 00:13:48.697 fused_ordering(734) 00:13:48.697 fused_ordering(735) 00:13:48.697 fused_ordering(736) 00:13:48.697 fused_ordering(737) 00:13:48.697 fused_ordering(738) 00:13:48.697 fused_ordering(739) 00:13:48.697 fused_ordering(740) 00:13:48.697 fused_ordering(741) 00:13:48.697 fused_ordering(742) 00:13:48.697 fused_ordering(743) 00:13:48.697 fused_ordering(744) 00:13:48.697 fused_ordering(745) 00:13:48.697 fused_ordering(746) 00:13:48.697 fused_ordering(747) 00:13:48.697 fused_ordering(748) 00:13:48.697 fused_ordering(749) 00:13:48.697 fused_ordering(750) 00:13:48.697 fused_ordering(751) 00:13:48.697 fused_ordering(752) 00:13:48.697 fused_ordering(753) 00:13:48.697 fused_ordering(754) 00:13:48.697 fused_ordering(755) 00:13:48.697 fused_ordering(756) 00:13:48.697 fused_ordering(757) 00:13:48.697 fused_ordering(758) 00:13:48.697 fused_ordering(759) 00:13:48.697 fused_ordering(760) 00:13:48.697 fused_ordering(761) 00:13:48.697 fused_ordering(762) 00:13:48.697 fused_ordering(763) 00:13:48.697 fused_ordering(764) 00:13:48.697 fused_ordering(765) 00:13:48.697 fused_ordering(766) 00:13:48.697 fused_ordering(767) 00:13:48.697 fused_ordering(768) 00:13:48.697 fused_ordering(769) 00:13:48.697 fused_ordering(770) 00:13:48.697 fused_ordering(771) 00:13:48.697 fused_ordering(772) 00:13:48.697 fused_ordering(773) 00:13:48.697 fused_ordering(774) 00:13:48.697 fused_ordering(775) 00:13:48.697 fused_ordering(776) 00:13:48.697 fused_ordering(777) 00:13:48.697 fused_ordering(778) 00:13:48.697 fused_ordering(779) 00:13:48.697 fused_ordering(780) 00:13:48.697 fused_ordering(781) 00:13:48.697 fused_ordering(782) 00:13:48.697 fused_ordering(783) 00:13:48.697 fused_ordering(784) 00:13:48.697 fused_ordering(785) 00:13:48.697 fused_ordering(786) 00:13:48.697 fused_ordering(787) 00:13:48.697 fused_ordering(788) 00:13:48.697 fused_ordering(789) 00:13:48.697 fused_ordering(790) 00:13:48.697 fused_ordering(791) 00:13:48.697 fused_ordering(792) 00:13:48.697 fused_ordering(793) 00:13:48.697 fused_ordering(794) 00:13:48.697 fused_ordering(795) 00:13:48.697 fused_ordering(796) 00:13:48.697 fused_ordering(797) 00:13:48.697 fused_ordering(798) 00:13:48.697 fused_ordering(799) 00:13:48.697 fused_ordering(800) 00:13:48.697 fused_ordering(801) 00:13:48.697 fused_ordering(802) 00:13:48.697 fused_ordering(803) 00:13:48.697 fused_ordering(804) 00:13:48.697 fused_ordering(805) 00:13:48.697 fused_ordering(806) 00:13:48.697 fused_ordering(807) 00:13:48.697 fused_ordering(808) 00:13:48.697 fused_ordering(809) 00:13:48.697 fused_ordering(810) 00:13:48.697 fused_ordering(811) 00:13:48.697 fused_ordering(812) 00:13:48.697 fused_ordering(813) 00:13:48.697 fused_ordering(814) 00:13:48.697 fused_ordering(815) 00:13:48.697 fused_ordering(816) 00:13:48.697 fused_ordering(817) 00:13:48.697 fused_ordering(818) 00:13:48.697 fused_ordering(819) 00:13:48.697 fused_ordering(820) 00:13:49.264 fused_ordering(821) 00:13:49.264 fused_ordering(822) 00:13:49.264 fused_ordering(823) 00:13:49.264 fused_ordering(824) 00:13:49.264 fused_ordering(825) 00:13:49.264 fused_ordering(826) 00:13:49.264 fused_ordering(827) 00:13:49.264 fused_ordering(828) 00:13:49.264 fused_ordering(829) 00:13:49.264 fused_ordering(830) 00:13:49.264 fused_ordering(831) 00:13:49.264 fused_ordering(832) 00:13:49.264 fused_ordering(833) 00:13:49.264 fused_ordering(834) 00:13:49.264 fused_ordering(835) 00:13:49.264 fused_ordering(836) 00:13:49.264 fused_ordering(837) 00:13:49.264 fused_ordering(838) 00:13:49.264 fused_ordering(839) 00:13:49.264 fused_ordering(840) 00:13:49.264 fused_ordering(841) 00:13:49.264 fused_ordering(842) 00:13:49.264 fused_ordering(843) 00:13:49.264 fused_ordering(844) 00:13:49.264 fused_ordering(845) 00:13:49.264 fused_ordering(846) 00:13:49.264 fused_ordering(847) 00:13:49.264 fused_ordering(848) 00:13:49.264 fused_ordering(849) 00:13:49.264 fused_ordering(850) 00:13:49.264 fused_ordering(851) 00:13:49.264 fused_ordering(852) 00:13:49.264 fused_ordering(853) 00:13:49.264 fused_ordering(854) 00:13:49.264 fused_ordering(855) 00:13:49.264 fused_ordering(856) 00:13:49.264 fused_ordering(857) 00:13:49.264 fused_ordering(858) 00:13:49.264 fused_ordering(859) 00:13:49.264 fused_ordering(860) 00:13:49.264 fused_ordering(861) 00:13:49.264 fused_ordering(862) 00:13:49.264 fused_ordering(863) 00:13:49.264 fused_ordering(864) 00:13:49.264 fused_ordering(865) 00:13:49.264 fused_ordering(866) 00:13:49.264 fused_ordering(867) 00:13:49.264 fused_ordering(868) 00:13:49.264 fused_ordering(869) 00:13:49.264 fused_ordering(870) 00:13:49.264 fused_ordering(871) 00:13:49.264 fused_ordering(872) 00:13:49.264 fused_ordering(873) 00:13:49.264 fused_ordering(874) 00:13:49.264 fused_ordering(875) 00:13:49.264 fused_ordering(876) 00:13:49.264 fused_ordering(877) 00:13:49.264 fused_ordering(878) 00:13:49.264 fused_ordering(879) 00:13:49.264 fused_ordering(880) 00:13:49.264 fused_ordering(881) 00:13:49.264 fused_ordering(882) 00:13:49.264 fused_ordering(883) 00:13:49.264 fused_ordering(884) 00:13:49.264 fused_ordering(885) 00:13:49.264 fused_ordering(886) 00:13:49.264 fused_ordering(887) 00:13:49.264 fused_ordering(888) 00:13:49.264 fused_ordering(889) 00:13:49.264 fused_ordering(890) 00:13:49.264 fused_ordering(891) 00:13:49.264 fused_ordering(892) 00:13:49.264 fused_ordering(893) 00:13:49.264 fused_ordering(894) 00:13:49.264 fused_ordering(895) 00:13:49.264 fused_ordering(896) 00:13:49.264 fused_ordering(897) 00:13:49.264 fused_ordering(898) 00:13:49.264 fused_ordering(899) 00:13:49.264 fused_ordering(900) 00:13:49.264 fused_ordering(901) 00:13:49.264 fused_ordering(902) 00:13:49.264 fused_ordering(903) 00:13:49.264 fused_ordering(904) 00:13:49.264 fused_ordering(905) 00:13:49.264 fused_ordering(906) 00:13:49.264 fused_ordering(907) 00:13:49.264 fused_ordering(908) 00:13:49.264 fused_ordering(909) 00:13:49.264 fused_ordering(910) 00:13:49.264 fused_ordering(911) 00:13:49.264 fused_ordering(912) 00:13:49.264 fused_ordering(913) 00:13:49.264 fused_ordering(914) 00:13:49.264 fused_ordering(915) 00:13:49.264 fused_ordering(916) 00:13:49.264 fused_ordering(917) 00:13:49.264 fused_ordering(918) 00:13:49.264 fused_ordering(919) 00:13:49.264 fused_ordering(920) 00:13:49.264 fused_ordering(921) 00:13:49.264 fused_ordering(922) 00:13:49.264 fused_ordering(923) 00:13:49.264 fused_ordering(924) 00:13:49.264 fused_ordering(925) 00:13:49.264 fused_ordering(926) 00:13:49.264 fused_ordering(927) 00:13:49.264 fused_ordering(928) 00:13:49.264 fused_ordering(929) 00:13:49.264 fused_ordering(930) 00:13:49.264 fused_ordering(931) 00:13:49.264 fused_ordering(932) 00:13:49.264 fused_ordering(933) 00:13:49.264 fused_ordering(934) 00:13:49.264 fused_ordering(935) 00:13:49.264 fused_ordering(936) 00:13:49.264 fused_ordering(937) 00:13:49.264 fused_ordering(938) 00:13:49.264 fused_ordering(939) 00:13:49.264 fused_ordering(940) 00:13:49.264 fused_ordering(941) 00:13:49.264 fused_ordering(942) 00:13:49.264 fused_ordering(943) 00:13:49.264 fused_ordering(944) 00:13:49.264 fused_ordering(945) 00:13:49.264 fused_ordering(946) 00:13:49.264 fused_ordering(947) 00:13:49.264 fused_ordering(948) 00:13:49.264 fused_ordering(949) 00:13:49.264 fused_ordering(950) 00:13:49.264 fused_ordering(951) 00:13:49.264 fused_ordering(952) 00:13:49.264 fused_ordering(953) 00:13:49.264 fused_ordering(954) 00:13:49.264 fused_ordering(955) 00:13:49.264 fused_ordering(956) 00:13:49.264 fused_ordering(957) 00:13:49.264 fused_ordering(958) 00:13:49.264 fused_ordering(959) 00:13:49.264 fused_ordering(960) 00:13:49.264 fused_ordering(961) 00:13:49.264 fused_ordering(962) 00:13:49.264 fused_ordering(963) 00:13:49.264 fused_ordering(964) 00:13:49.264 fused_ordering(965) 00:13:49.264 fused_ordering(966) 00:13:49.264 fused_ordering(967) 00:13:49.264 fused_ordering(968) 00:13:49.264 fused_ordering(969) 00:13:49.264 fused_ordering(970) 00:13:49.264 fused_ordering(971) 00:13:49.264 fused_ordering(972) 00:13:49.264 fused_ordering(973) 00:13:49.264 fused_ordering(974) 00:13:49.264 fused_ordering(975) 00:13:49.264 fused_ordering(976) 00:13:49.264 fused_ordering(977) 00:13:49.264 fused_ordering(978) 00:13:49.264 fused_ordering(979) 00:13:49.264 fused_ordering(980) 00:13:49.264 fused_ordering(981) 00:13:49.264 fused_ordering(982) 00:13:49.264 fused_ordering(983) 00:13:49.264 fused_ordering(984) 00:13:49.264 fused_ordering(985) 00:13:49.264 fused_ordering(986) 00:13:49.264 fused_ordering(987) 00:13:49.264 fused_ordering(988) 00:13:49.264 fused_ordering(989) 00:13:49.264 fused_ordering(990) 00:13:49.264 fused_ordering(991) 00:13:49.264 fused_ordering(992) 00:13:49.264 fused_ordering(993) 00:13:49.264 fused_ordering(994) 00:13:49.264 fused_ordering(995) 00:13:49.264 fused_ordering(996) 00:13:49.264 fused_ordering(997) 00:13:49.264 fused_ordering(998) 00:13:49.264 fused_ordering(999) 00:13:49.264 fused_ordering(1000) 00:13:49.264 fused_ordering(1001) 00:13:49.264 fused_ordering(1002) 00:13:49.264 fused_ordering(1003) 00:13:49.264 fused_ordering(1004) 00:13:49.264 fused_ordering(1005) 00:13:49.264 fused_ordering(1006) 00:13:49.264 fused_ordering(1007) 00:13:49.264 fused_ordering(1008) 00:13:49.264 fused_ordering(1009) 00:13:49.264 fused_ordering(1010) 00:13:49.264 fused_ordering(1011) 00:13:49.264 fused_ordering(1012) 00:13:49.264 fused_ordering(1013) 00:13:49.264 fused_ordering(1014) 00:13:49.264 fused_ordering(1015) 00:13:49.264 fused_ordering(1016) 00:13:49.264 fused_ordering(1017) 00:13:49.264 fused_ordering(1018) 00:13:49.264 fused_ordering(1019) 00:13:49.264 fused_ordering(1020) 00:13:49.264 fused_ordering(1021) 00:13:49.264 fused_ordering(1022) 00:13:49.264 fused_ordering(1023) 00:13:49.264 15:14:47 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:49.264 15:14:47 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:49.264 15:14:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:49.264 15:14:47 -- nvmf/common.sh@116 -- # sync 00:13:49.264 15:14:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:49.264 15:14:47 -- nvmf/common.sh@119 -- # set +e 00:13:49.264 15:14:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:49.264 15:14:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:49.264 rmmod nvme_tcp 00:13:49.264 rmmod nvme_fabrics 00:13:49.265 rmmod nvme_keyring 00:13:49.265 15:14:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:49.265 15:14:47 -- nvmf/common.sh@123 -- # set -e 00:13:49.265 15:14:47 -- nvmf/common.sh@124 -- # return 0 00:13:49.265 15:14:47 -- nvmf/common.sh@477 -- # '[' -n 2732935 ']' 00:13:49.265 15:14:47 -- nvmf/common.sh@478 -- # killprocess 2732935 00:13:49.265 15:14:47 -- common/autotest_common.sh@936 -- # '[' -z 2732935 ']' 00:13:49.265 15:14:47 -- common/autotest_common.sh@940 -- # kill -0 2732935 00:13:49.265 15:14:47 -- common/autotest_common.sh@941 -- # uname 00:13:49.265 15:14:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:49.265 15:14:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2732935 00:13:49.265 15:14:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:49.265 15:14:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:49.265 15:14:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2732935' 00:13:49.265 killing process with pid 2732935 00:13:49.265 15:14:47 -- common/autotest_common.sh@955 -- # kill 2732935 00:13:49.265 15:14:47 -- common/autotest_common.sh@960 -- # wait 2732935 00:13:49.833 15:14:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:49.833 15:14:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:49.833 15:14:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:49.833 15:14:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:49.833 15:14:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:49.833 15:14:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.833 15:14:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.833 15:14:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.736 15:14:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:51.736 00:13:51.736 real 0m8.462s 00:13:51.736 user 0m6.129s 00:13:51.736 sys 0m3.258s 00:13:51.736 15:14:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:51.736 15:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:51.736 ************************************ 00:13:51.736 END TEST nvmf_fused_ordering 00:13:51.736 ************************************ 00:13:51.736 15:14:50 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:51.736 15:14:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:51.736 15:14:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:51.736 15:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:51.736 ************************************ 00:13:51.736 START TEST nvmf_delete_subsystem 00:13:51.736 ************************************ 00:13:51.736 15:14:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:51.736 * Looking for test storage... 00:13:51.736 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:51.736 15:14:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:51.736 15:14:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:51.736 15:14:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:51.736 15:14:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:51.736 15:14:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:51.736 15:14:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:51.736 15:14:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:51.736 15:14:50 -- scripts/common.sh@335 -- # IFS=.-: 00:13:51.736 15:14:50 -- scripts/common.sh@335 -- # read -ra ver1 00:13:51.736 15:14:50 -- scripts/common.sh@336 -- # IFS=.-: 00:13:51.736 15:14:50 -- scripts/common.sh@336 -- # read -ra ver2 00:13:51.736 15:14:50 -- scripts/common.sh@337 -- # local 'op=<' 00:13:51.736 15:14:50 -- scripts/common.sh@339 -- # ver1_l=2 00:13:51.736 15:14:50 -- scripts/common.sh@340 -- # ver2_l=1 00:13:51.736 15:14:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:51.736 15:14:50 -- scripts/common.sh@343 -- # case "$op" in 00:13:51.736 15:14:50 -- scripts/common.sh@344 -- # : 1 00:13:51.736 15:14:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:51.736 15:14:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:51.736 15:14:50 -- scripts/common.sh@364 -- # decimal 1 00:13:51.736 15:14:50 -- scripts/common.sh@352 -- # local d=1 00:13:51.736 15:14:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:51.736 15:14:50 -- scripts/common.sh@354 -- # echo 1 00:13:51.736 15:14:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:51.736 15:14:50 -- scripts/common.sh@365 -- # decimal 2 00:13:51.736 15:14:50 -- scripts/common.sh@352 -- # local d=2 00:13:51.736 15:14:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:51.736 15:14:50 -- scripts/common.sh@354 -- # echo 2 00:13:51.736 15:14:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:51.736 15:14:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:51.736 15:14:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:51.736 15:14:50 -- scripts/common.sh@367 -- # return 0 00:13:51.995 15:14:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:51.995 15:14:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:51.995 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.995 --rc genhtml_branch_coverage=1 00:13:51.995 --rc genhtml_function_coverage=1 00:13:51.995 --rc genhtml_legend=1 00:13:51.995 --rc geninfo_all_blocks=1 00:13:51.995 --rc geninfo_unexecuted_blocks=1 00:13:51.995 00:13:51.995 ' 00:13:51.995 15:14:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:51.995 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.995 --rc genhtml_branch_coverage=1 00:13:51.995 --rc genhtml_function_coverage=1 00:13:51.995 --rc genhtml_legend=1 00:13:51.995 --rc geninfo_all_blocks=1 00:13:51.995 --rc geninfo_unexecuted_blocks=1 00:13:51.996 00:13:51.996 ' 00:13:51.996 15:14:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:51.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.996 --rc genhtml_branch_coverage=1 00:13:51.996 --rc genhtml_function_coverage=1 00:13:51.996 --rc genhtml_legend=1 00:13:51.996 --rc geninfo_all_blocks=1 00:13:51.996 --rc geninfo_unexecuted_blocks=1 00:13:51.996 00:13:51.996 ' 00:13:51.996 15:14:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:51.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.996 --rc genhtml_branch_coverage=1 00:13:51.996 --rc genhtml_function_coverage=1 00:13:51.996 --rc genhtml_legend=1 00:13:51.996 --rc geninfo_all_blocks=1 00:13:51.996 --rc geninfo_unexecuted_blocks=1 00:13:51.996 00:13:51.996 ' 00:13:51.996 15:14:50 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:51.996 15:14:50 -- nvmf/common.sh@7 -- # uname -s 00:13:51.996 15:14:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.996 15:14:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.996 15:14:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.996 15:14:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.996 15:14:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.996 15:14:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.996 15:14:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.996 15:14:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.996 15:14:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.996 15:14:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.996 15:14:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.996 15:14:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.996 15:14:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.996 15:14:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.996 15:14:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:51.996 15:14:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:51.996 15:14:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.996 15:14:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.996 15:14:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.996 15:14:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.996 15:14:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.996 15:14:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.996 15:14:50 -- paths/export.sh@5 -- # export PATH 00:13:51.996 15:14:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.996 15:14:50 -- nvmf/common.sh@46 -- # : 0 00:13:51.996 15:14:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:51.996 15:14:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:51.996 15:14:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:51.996 15:14:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.996 15:14:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.996 15:14:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:51.996 15:14:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:51.996 15:14:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:51.996 15:14:50 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:51.996 15:14:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:51.996 15:14:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:51.996 15:14:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:51.996 15:14:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:51.996 15:14:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:51.996 15:14:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.996 15:14:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.996 15:14:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.996 15:14:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:51.996 15:14:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:51.996 15:14:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:51.996 15:14:50 -- common/autotest_common.sh@10 -- # set +x 00:13:53.902 15:14:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:53.902 15:14:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:53.902 15:14:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:53.902 15:14:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:53.902 15:14:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:53.902 15:14:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:53.902 15:14:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:53.902 15:14:52 -- nvmf/common.sh@294 -- # net_devs=() 00:13:53.902 15:14:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:53.902 15:14:52 -- nvmf/common.sh@295 -- # e810=() 00:13:53.902 15:14:52 -- nvmf/common.sh@295 -- # local -ga e810 00:13:53.902 15:14:52 -- nvmf/common.sh@296 -- # x722=() 00:13:53.902 15:14:52 -- nvmf/common.sh@296 -- # local -ga x722 00:13:53.902 15:14:52 -- nvmf/common.sh@297 -- # mlx=() 00:13:53.902 15:14:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:53.902 15:14:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:53.902 15:14:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:53.902 15:14:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:53.902 15:14:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.902 15:14:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:53.902 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:53.902 15:14:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.902 15:14:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:53.902 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:53.902 15:14:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.902 15:14:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.902 15:14:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.902 15:14:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:53.902 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:53.902 15:14:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.902 15:14:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.902 15:14:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.902 15:14:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.902 15:14:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:53.902 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:53.902 15:14:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.902 15:14:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:53.902 15:14:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:53.902 15:14:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:53.902 15:14:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:53.902 15:14:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:53.902 15:14:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:53.902 15:14:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:53.902 15:14:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:53.902 15:14:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:53.902 15:14:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:53.902 15:14:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:53.902 15:14:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:53.902 15:14:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:53.902 15:14:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:53.902 15:14:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:53.902 15:14:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:53.902 15:14:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:53.902 15:14:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:53.902 15:14:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:53.902 15:14:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:54.162 15:14:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:54.162 15:14:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:54.162 15:14:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:54.162 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:54.162 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:13:54.162 00:13:54.162 --- 10.0.0.2 ping statistics --- 00:13:54.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.162 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:13:54.162 15:14:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:54.162 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:54.162 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:13:54.162 00:13:54.162 --- 10.0.0.1 ping statistics --- 00:13:54.162 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.162 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:13:54.162 15:14:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:54.162 15:14:52 -- nvmf/common.sh@410 -- # return 0 00:13:54.162 15:14:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:54.162 15:14:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:54.162 15:14:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:54.162 15:14:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:54.162 15:14:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:54.162 15:14:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:54.162 15:14:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:54.162 15:14:52 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:54.162 15:14:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:54.162 15:14:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:54.162 15:14:52 -- common/autotest_common.sh@10 -- # set +x 00:13:54.162 15:14:52 -- nvmf/common.sh@469 -- # nvmfpid=2735321 00:13:54.162 15:14:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:54.162 15:14:52 -- nvmf/common.sh@470 -- # waitforlisten 2735321 00:13:54.162 15:14:52 -- common/autotest_common.sh@829 -- # '[' -z 2735321 ']' 00:13:54.162 15:14:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:54.162 15:14:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:54.162 15:14:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:54.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:54.162 15:14:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:54.162 15:14:52 -- common/autotest_common.sh@10 -- # set +x 00:13:54.162 [2024-11-19 15:14:52.576342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:54.162 [2024-11-19 15:14:52.576435] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.162 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.162 [2024-11-19 15:14:52.639211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:54.420 [2024-11-19 15:14:52.750050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.421 [2024-11-19 15:14:52.750206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.421 [2024-11-19 15:14:52.750223] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.421 [2024-11-19 15:14:52.750236] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.421 [2024-11-19 15:14:52.750313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.421 [2024-11-19 15:14:52.750317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.355 15:14:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:55.355 15:14:53 -- common/autotest_common.sh@862 -- # return 0 00:13:55.355 15:14:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.355 15:14:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 15:14:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 [2024-11-19 15:14:53.625376] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 [2024-11-19 15:14:53.641625] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 NULL1 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 Delay0 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.355 15:14:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.355 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:55.355 15:14:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@28 -- # perf_pid=2735480 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:55.355 15:14:53 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:55.355 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.355 [2024-11-19 15:14:53.716314] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:57.254 15:14:55 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:57.254 15:14:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.254 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 starting I/O failed: -6 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 [2024-11-19 15:14:55.835467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9f8800c1d0 is same with the state(5) to be set 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Write completed with error (sct=0, sc=8) 00:13:57.512 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 starting I/O failed: -6 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 [2024-11-19 15:14:55.837608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19e43d0 is same with the state(5) to be set 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Write completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:57.513 Read completed with error (sct=0, sc=8) 00:13:58.448 [2024-11-19 15:14:56.813092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19dd960 is same with the state(5) to be set 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 [2024-11-19 15:14:56.837543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19c44c0 is same with the state(5) to be set 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 [2024-11-19 15:14:56.837960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19c4a20 is same with the state(5) to be set 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 [2024-11-19 15:14:56.839600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9f8800c480 is same with the state(5) to be set 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.448 Read completed with error (sct=0, sc=8) 00:13:58.448 Write completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 Read completed with error (sct=0, sc=8) 00:13:58.449 [2024-11-19 15:14:56.840339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9f8800bf20 is same with the state(5) to be set 00:13:58.449 [2024-11-19 15:14:56.840844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19dd960 (9): Bad file descriptor 00:13:58.449 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:58.449 15:14:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.449 15:14:56 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:58.449 15:14:56 -- target/delete_subsystem.sh@35 -- # kill -0 2735480 00:13:58.449 15:14:56 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:58.449 Initializing NVMe Controllers 00:13:58.449 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:58.449 Controller IO queue size 128, less than required. 00:13:58.449 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:58.449 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:58.449 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:58.449 Initialization complete. Launching workers. 00:13:58.449 ======================================================== 00:13:58.449 Latency(us) 00:13:58.449 Device Information : IOPS MiB/s Average min max 00:13:58.449 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 148.42 0.07 1035867.55 341.17 2002254.76 00:13:58.449 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 163.31 0.08 910830.01 418.38 1010729.78 00:13:58.449 ======================================================== 00:13:58.449 Total : 311.73 0.15 970362.21 341.17 2002254.76 00:13:58.449 00:13:59.015 15:14:57 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:59.015 15:14:57 -- target/delete_subsystem.sh@35 -- # kill -0 2735480 00:13:59.015 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2735480) - No such process 00:13:59.015 15:14:57 -- target/delete_subsystem.sh@45 -- # NOT wait 2735480 00:13:59.015 15:14:57 -- common/autotest_common.sh@650 -- # local es=0 00:13:59.015 15:14:57 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2735480 00:13:59.015 15:14:57 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:59.015 15:14:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:59.015 15:14:57 -- common/autotest_common.sh@642 -- # type -t wait 00:13:59.015 15:14:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:59.015 15:14:57 -- common/autotest_common.sh@653 -- # wait 2735480 00:13:59.015 15:14:57 -- common/autotest_common.sh@653 -- # es=1 00:13:59.015 15:14:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:59.015 15:14:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:59.015 15:14:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:59.015 15:14:57 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:59.015 15:14:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.015 15:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:59.015 15:14:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.015 15:14:57 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:59.015 15:14:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.016 15:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:59.016 [2024-11-19 15:14:57.361353] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.016 15:14:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.016 15:14:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.016 15:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:59.016 15:14:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@54 -- # perf_pid=2736013 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:13:59.016 15:14:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:59.016 EAL: No free 2048 kB hugepages reported on node 1 00:13:59.016 [2024-11-19 15:14:57.418430] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:59.581 15:14:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:59.581 15:14:57 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:13:59.581 15:14:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:59.838 15:14:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:59.838 15:14:58 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:13:59.838 15:14:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.403 15:14:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.403 15:14:58 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:14:00.403 15:14:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.967 15:14:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.967 15:14:59 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:14:00.967 15:14:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:01.532 15:14:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:01.532 15:14:59 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:14:01.532 15:14:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.097 15:15:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.097 15:15:00 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:14:02.097 15:15:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.356 Initializing NVMe Controllers 00:14:02.356 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:02.356 Controller IO queue size 128, less than required. 00:14:02.356 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:02.356 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:02.356 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:02.356 Initialization complete. Launching workers. 00:14:02.356 ======================================================== 00:14:02.356 Latency(us) 00:14:02.356 Device Information : IOPS MiB/s Average min max 00:14:02.356 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004275.95 1000155.26 1010946.86 00:14:02.356 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004128.40 1000210.46 1041080.17 00:14:02.356 ======================================================== 00:14:02.356 Total : 256.00 0.12 1004202.18 1000155.26 1041080.17 00:14:02.356 00:14:02.356 15:15:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.356 15:15:00 -- target/delete_subsystem.sh@57 -- # kill -0 2736013 00:14:02.356 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2736013) - No such process 00:14:02.356 15:15:00 -- target/delete_subsystem.sh@67 -- # wait 2736013 00:14:02.356 15:15:00 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:02.356 15:15:00 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:02.356 15:15:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:02.356 15:15:00 -- nvmf/common.sh@116 -- # sync 00:14:02.356 15:15:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:02.356 15:15:00 -- nvmf/common.sh@119 -- # set +e 00:14:02.356 15:15:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:02.356 15:15:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:02.356 rmmod nvme_tcp 00:14:02.614 rmmod nvme_fabrics 00:14:02.614 rmmod nvme_keyring 00:14:02.614 15:15:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:02.614 15:15:00 -- nvmf/common.sh@123 -- # set -e 00:14:02.614 15:15:00 -- nvmf/common.sh@124 -- # return 0 00:14:02.614 15:15:00 -- nvmf/common.sh@477 -- # '[' -n 2735321 ']' 00:14:02.614 15:15:00 -- nvmf/common.sh@478 -- # killprocess 2735321 00:14:02.614 15:15:00 -- common/autotest_common.sh@936 -- # '[' -z 2735321 ']' 00:14:02.614 15:15:00 -- common/autotest_common.sh@940 -- # kill -0 2735321 00:14:02.614 15:15:00 -- common/autotest_common.sh@941 -- # uname 00:14:02.614 15:15:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:02.614 15:15:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2735321 00:14:02.614 15:15:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:02.614 15:15:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:02.614 15:15:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2735321' 00:14:02.614 killing process with pid 2735321 00:14:02.614 15:15:01 -- common/autotest_common.sh@955 -- # kill 2735321 00:14:02.614 15:15:01 -- common/autotest_common.sh@960 -- # wait 2735321 00:14:02.872 15:15:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:02.872 15:15:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:02.872 15:15:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:02.872 15:15:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:02.872 15:15:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:02.872 15:15:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:02.872 15:15:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:02.872 15:15:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:04.774 15:15:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:04.774 00:14:04.774 real 0m13.137s 00:14:04.774 user 0m29.714s 00:14:04.774 sys 0m2.967s 00:14:04.774 15:15:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:04.774 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:04.775 ************************************ 00:14:04.775 END TEST nvmf_delete_subsystem 00:14:04.775 ************************************ 00:14:04.775 15:15:03 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:04.775 15:15:03 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:04.775 15:15:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:04.775 15:15:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:04.775 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:04.775 ************************************ 00:14:04.775 START TEST nvmf_nvme_cli 00:14:04.775 ************************************ 00:14:04.775 15:15:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:05.071 * Looking for test storage... 00:14:05.072 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:05.072 15:15:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:05.072 15:15:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:05.072 15:15:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:05.072 15:15:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:05.072 15:15:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:05.072 15:15:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:05.072 15:15:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:05.072 15:15:03 -- scripts/common.sh@335 -- # IFS=.-: 00:14:05.072 15:15:03 -- scripts/common.sh@335 -- # read -ra ver1 00:14:05.072 15:15:03 -- scripts/common.sh@336 -- # IFS=.-: 00:14:05.072 15:15:03 -- scripts/common.sh@336 -- # read -ra ver2 00:14:05.072 15:15:03 -- scripts/common.sh@337 -- # local 'op=<' 00:14:05.072 15:15:03 -- scripts/common.sh@339 -- # ver1_l=2 00:14:05.072 15:15:03 -- scripts/common.sh@340 -- # ver2_l=1 00:14:05.072 15:15:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:05.072 15:15:03 -- scripts/common.sh@343 -- # case "$op" in 00:14:05.072 15:15:03 -- scripts/common.sh@344 -- # : 1 00:14:05.072 15:15:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:05.072 15:15:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:05.072 15:15:03 -- scripts/common.sh@364 -- # decimal 1 00:14:05.072 15:15:03 -- scripts/common.sh@352 -- # local d=1 00:14:05.072 15:15:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:05.072 15:15:03 -- scripts/common.sh@354 -- # echo 1 00:14:05.072 15:15:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:05.072 15:15:03 -- scripts/common.sh@365 -- # decimal 2 00:14:05.072 15:15:03 -- scripts/common.sh@352 -- # local d=2 00:14:05.072 15:15:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:05.072 15:15:03 -- scripts/common.sh@354 -- # echo 2 00:14:05.072 15:15:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:05.072 15:15:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:05.072 15:15:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:05.072 15:15:03 -- scripts/common.sh@367 -- # return 0 00:14:05.072 15:15:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:05.072 15:15:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:05.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.072 --rc genhtml_branch_coverage=1 00:14:05.072 --rc genhtml_function_coverage=1 00:14:05.072 --rc genhtml_legend=1 00:14:05.072 --rc geninfo_all_blocks=1 00:14:05.072 --rc geninfo_unexecuted_blocks=1 00:14:05.072 00:14:05.072 ' 00:14:05.072 15:15:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:05.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.072 --rc genhtml_branch_coverage=1 00:14:05.072 --rc genhtml_function_coverage=1 00:14:05.072 --rc genhtml_legend=1 00:14:05.072 --rc geninfo_all_blocks=1 00:14:05.072 --rc geninfo_unexecuted_blocks=1 00:14:05.072 00:14:05.072 ' 00:14:05.072 15:15:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:05.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.072 --rc genhtml_branch_coverage=1 00:14:05.072 --rc genhtml_function_coverage=1 00:14:05.072 --rc genhtml_legend=1 00:14:05.072 --rc geninfo_all_blocks=1 00:14:05.072 --rc geninfo_unexecuted_blocks=1 00:14:05.072 00:14:05.072 ' 00:14:05.072 15:15:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:05.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.072 --rc genhtml_branch_coverage=1 00:14:05.072 --rc genhtml_function_coverage=1 00:14:05.072 --rc genhtml_legend=1 00:14:05.072 --rc geninfo_all_blocks=1 00:14:05.072 --rc geninfo_unexecuted_blocks=1 00:14:05.072 00:14:05.072 ' 00:14:05.072 15:15:03 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:05.072 15:15:03 -- nvmf/common.sh@7 -- # uname -s 00:14:05.072 15:15:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:05.072 15:15:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:05.072 15:15:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:05.072 15:15:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:05.072 15:15:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:05.072 15:15:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:05.072 15:15:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:05.072 15:15:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:05.072 15:15:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:05.072 15:15:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:05.072 15:15:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.072 15:15:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.072 15:15:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:05.072 15:15:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:05.072 15:15:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:05.072 15:15:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:05.072 15:15:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:05.072 15:15:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:05.072 15:15:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:05.072 15:15:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.072 15:15:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.072 15:15:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.072 15:15:03 -- paths/export.sh@5 -- # export PATH 00:14:05.072 15:15:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.072 15:15:03 -- nvmf/common.sh@46 -- # : 0 00:14:05.072 15:15:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:05.072 15:15:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:05.072 15:15:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:05.072 15:15:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:05.072 15:15:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:05.072 15:15:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:05.072 15:15:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:05.072 15:15:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:05.072 15:15:03 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:05.072 15:15:03 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:05.072 15:15:03 -- target/nvme_cli.sh@14 -- # devs=() 00:14:05.072 15:15:03 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:05.072 15:15:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:05.072 15:15:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:05.072 15:15:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:05.072 15:15:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:05.072 15:15:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:05.072 15:15:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.072 15:15:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.072 15:15:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.072 15:15:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:05.072 15:15:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:05.072 15:15:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:05.072 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.002 15:15:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:07.002 15:15:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:07.002 15:15:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:07.002 15:15:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:07.002 15:15:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:07.002 15:15:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:07.002 15:15:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:07.002 15:15:05 -- nvmf/common.sh@294 -- # net_devs=() 00:14:07.002 15:15:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:07.002 15:15:05 -- nvmf/common.sh@295 -- # e810=() 00:14:07.002 15:15:05 -- nvmf/common.sh@295 -- # local -ga e810 00:14:07.002 15:15:05 -- nvmf/common.sh@296 -- # x722=() 00:14:07.002 15:15:05 -- nvmf/common.sh@296 -- # local -ga x722 00:14:07.002 15:15:05 -- nvmf/common.sh@297 -- # mlx=() 00:14:07.002 15:15:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:07.002 15:15:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:07.002 15:15:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:07.002 15:15:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:07.002 15:15:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:07.003 15:15:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:07.003 15:15:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:07.003 15:15:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:07.003 15:15:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.003 15:15:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:07.003 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:07.003 15:15:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.003 15:15:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.003 15:15:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:07.003 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:07.262 15:15:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:07.262 15:15:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.262 15:15:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.262 15:15:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.262 15:15:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.262 15:15:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:07.262 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:07.262 15:15:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.262 15:15:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.262 15:15:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.262 15:15:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.262 15:15:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.262 15:15:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:07.262 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:07.262 15:15:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.262 15:15:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:07.262 15:15:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:07.262 15:15:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:07.262 15:15:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:07.262 15:15:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:07.262 15:15:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:07.262 15:15:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:07.262 15:15:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:07.262 15:15:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:07.262 15:15:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:07.262 15:15:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:07.262 15:15:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:07.262 15:15:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:07.262 15:15:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:07.262 15:15:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:07.262 15:15:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:07.262 15:15:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:07.262 15:15:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:07.262 15:15:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:07.262 15:15:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:07.262 15:15:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:07.262 15:15:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:07.262 15:15:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:07.262 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:07.262 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:14:07.262 00:14:07.262 --- 10.0.0.2 ping statistics --- 00:14:07.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.262 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:14:07.262 15:15:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:07.262 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:07.262 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:14:07.262 00:14:07.262 --- 10.0.0.1 ping statistics --- 00:14:07.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.262 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:14:07.262 15:15:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:07.262 15:15:05 -- nvmf/common.sh@410 -- # return 0 00:14:07.262 15:15:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:07.262 15:15:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:07.262 15:15:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:07.262 15:15:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:07.262 15:15:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:07.262 15:15:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:07.262 15:15:05 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:07.262 15:15:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:07.262 15:15:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:07.262 15:15:05 -- common/autotest_common.sh@10 -- # set +x 00:14:07.262 15:15:05 -- nvmf/common.sh@469 -- # nvmfpid=2738506 00:14:07.262 15:15:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:07.262 15:15:05 -- nvmf/common.sh@470 -- # waitforlisten 2738506 00:14:07.262 15:15:05 -- common/autotest_common.sh@829 -- # '[' -z 2738506 ']' 00:14:07.262 15:15:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:07.262 15:15:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:07.262 15:15:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:07.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:07.262 15:15:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:07.262 15:15:05 -- common/autotest_common.sh@10 -- # set +x 00:14:07.262 [2024-11-19 15:15:05.757232] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:07.262 [2024-11-19 15:15:05.757301] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:07.262 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.262 [2024-11-19 15:15:05.821947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:07.521 [2024-11-19 15:15:05.930814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:07.521 [2024-11-19 15:15:05.930963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:07.521 [2024-11-19 15:15:05.930980] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:07.521 [2024-11-19 15:15:05.930992] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:07.521 [2024-11-19 15:15:05.931041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:07.521 [2024-11-19 15:15:05.931067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:07.521 [2024-11-19 15:15:05.931133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:07.521 [2024-11-19 15:15:05.931136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:08.455 15:15:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:08.455 15:15:06 -- common/autotest_common.sh@862 -- # return 0 00:14:08.455 15:15:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:08.455 15:15:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 15:15:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:08.455 15:15:06 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 [2024-11-19 15:15:06.807475] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 Malloc0 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 Malloc1 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 [2024-11-19 15:15:06.894069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:08.455 15:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.455 15:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:08.455 15:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.455 15:15:06 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:08.713 00:14:08.713 Discovery Log Number of Records 2, Generation counter 2 00:14:08.713 =====Discovery Log Entry 0====== 00:14:08.713 trtype: tcp 00:14:08.713 adrfam: ipv4 00:14:08.713 subtype: current discovery subsystem 00:14:08.713 treq: not required 00:14:08.713 portid: 0 00:14:08.713 trsvcid: 4420 00:14:08.713 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:08.713 traddr: 10.0.0.2 00:14:08.713 eflags: explicit discovery connections, duplicate discovery information 00:14:08.713 sectype: none 00:14:08.713 =====Discovery Log Entry 1====== 00:14:08.713 trtype: tcp 00:14:08.713 adrfam: ipv4 00:14:08.713 subtype: nvme subsystem 00:14:08.713 treq: not required 00:14:08.713 portid: 0 00:14:08.713 trsvcid: 4420 00:14:08.713 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:08.713 traddr: 10.0.0.2 00:14:08.713 eflags: none 00:14:08.713 sectype: none 00:14:08.713 15:15:07 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:08.713 15:15:07 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:08.713 15:15:07 -- nvmf/common.sh@510 -- # local dev _ 00:14:08.713 15:15:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:08.713 15:15:07 -- nvmf/common.sh@509 -- # nvme list 00:14:08.713 15:15:07 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:08.713 15:15:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:08.713 15:15:07 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:08.713 15:15:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:08.713 15:15:07 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:08.713 15:15:07 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:09.288 15:15:07 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:09.288 15:15:07 -- common/autotest_common.sh@1187 -- # local i=0 00:14:09.288 15:15:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:09.288 15:15:07 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:09.288 15:15:07 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:09.288 15:15:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:11.184 15:15:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:11.184 15:15:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:11.184 15:15:09 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:11.184 15:15:09 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:11.184 15:15:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:11.184 15:15:09 -- common/autotest_common.sh@1197 -- # return 0 00:14:11.184 15:15:09 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:11.184 15:15:09 -- nvmf/common.sh@510 -- # local dev _ 00:14:11.184 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.184 15:15:09 -- nvmf/common.sh@509 -- # nvme list 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:11.442 /dev/nvme0n2 ]] 00:14:11.442 15:15:09 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:11.442 15:15:09 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:11.442 15:15:09 -- nvmf/common.sh@510 -- # local dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@509 -- # nvme list 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:11.442 15:15:09 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:11.442 15:15:09 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.442 15:15:09 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:11.442 15:15:09 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:11.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:11.700 15:15:10 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:11.700 15:15:10 -- common/autotest_common.sh@1208 -- # local i=0 00:14:11.700 15:15:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:11.700 15:15:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:11.700 15:15:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:11.700 15:15:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:11.700 15:15:10 -- common/autotest_common.sh@1220 -- # return 0 00:14:11.700 15:15:10 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:11.700 15:15:10 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:11.700 15:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.700 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:11.700 15:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.700 15:15:10 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:11.700 15:15:10 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:11.700 15:15:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:11.700 15:15:10 -- nvmf/common.sh@116 -- # sync 00:14:11.700 15:15:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:11.700 15:15:10 -- nvmf/common.sh@119 -- # set +e 00:14:11.700 15:15:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:11.700 15:15:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:11.700 rmmod nvme_tcp 00:14:11.958 rmmod nvme_fabrics 00:14:11.958 rmmod nvme_keyring 00:14:11.958 15:15:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:11.958 15:15:10 -- nvmf/common.sh@123 -- # set -e 00:14:11.958 15:15:10 -- nvmf/common.sh@124 -- # return 0 00:14:11.958 15:15:10 -- nvmf/common.sh@477 -- # '[' -n 2738506 ']' 00:14:11.958 15:15:10 -- nvmf/common.sh@478 -- # killprocess 2738506 00:14:11.958 15:15:10 -- common/autotest_common.sh@936 -- # '[' -z 2738506 ']' 00:14:11.958 15:15:10 -- common/autotest_common.sh@940 -- # kill -0 2738506 00:14:11.958 15:15:10 -- common/autotest_common.sh@941 -- # uname 00:14:11.958 15:15:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:11.958 15:15:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2738506 00:14:11.958 15:15:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:11.958 15:15:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:11.958 15:15:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2738506' 00:14:11.958 killing process with pid 2738506 00:14:11.958 15:15:10 -- common/autotest_common.sh@955 -- # kill 2738506 00:14:11.958 15:15:10 -- common/autotest_common.sh@960 -- # wait 2738506 00:14:12.218 15:15:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:12.218 15:15:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:12.218 15:15:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:12.218 15:15:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:12.218 15:15:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:12.218 15:15:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.218 15:15:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.218 15:15:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:14.753 15:15:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:14.753 00:14:14.753 real 0m9.370s 00:14:14.753 user 0m19.455s 00:14:14.753 sys 0m2.385s 00:14:14.753 15:15:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:14.753 15:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:14.753 ************************************ 00:14:14.753 END TEST nvmf_nvme_cli 00:14:14.753 ************************************ 00:14:14.753 15:15:12 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:14.753 15:15:12 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:14.753 15:15:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:14.753 15:15:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:14.753 15:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:14.753 ************************************ 00:14:14.753 START TEST nvmf_host_management 00:14:14.753 ************************************ 00:14:14.753 15:15:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:14.753 * Looking for test storage... 00:14:14.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:14.753 15:15:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:14.753 15:15:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:14.753 15:15:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:14.753 15:15:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:14.753 15:15:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:14.753 15:15:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:14.753 15:15:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:14.754 15:15:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:14.754 15:15:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:14.754 15:15:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:14.754 15:15:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:14.754 15:15:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:14.754 15:15:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:14.754 15:15:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:14.754 15:15:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:14.754 15:15:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:14.754 15:15:12 -- scripts/common.sh@344 -- # : 1 00:14:14.754 15:15:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:14.754 15:15:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:14.754 15:15:12 -- scripts/common.sh@364 -- # decimal 1 00:14:14.754 15:15:12 -- scripts/common.sh@352 -- # local d=1 00:14:14.754 15:15:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:14.754 15:15:12 -- scripts/common.sh@354 -- # echo 1 00:14:14.754 15:15:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:14.754 15:15:12 -- scripts/common.sh@365 -- # decimal 2 00:14:14.754 15:15:12 -- scripts/common.sh@352 -- # local d=2 00:14:14.754 15:15:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:14.754 15:15:12 -- scripts/common.sh@354 -- # echo 2 00:14:14.754 15:15:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:14.754 15:15:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:14.754 15:15:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:14.754 15:15:12 -- scripts/common.sh@367 -- # return 0 00:14:14.754 15:15:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:14.754 15:15:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:14.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:14.754 --rc genhtml_branch_coverage=1 00:14:14.754 --rc genhtml_function_coverage=1 00:14:14.754 --rc genhtml_legend=1 00:14:14.754 --rc geninfo_all_blocks=1 00:14:14.754 --rc geninfo_unexecuted_blocks=1 00:14:14.754 00:14:14.754 ' 00:14:14.754 15:15:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:14.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:14.754 --rc genhtml_branch_coverage=1 00:14:14.754 --rc genhtml_function_coverage=1 00:14:14.754 --rc genhtml_legend=1 00:14:14.754 --rc geninfo_all_blocks=1 00:14:14.754 --rc geninfo_unexecuted_blocks=1 00:14:14.754 00:14:14.754 ' 00:14:14.754 15:15:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:14.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:14.754 --rc genhtml_branch_coverage=1 00:14:14.754 --rc genhtml_function_coverage=1 00:14:14.754 --rc genhtml_legend=1 00:14:14.754 --rc geninfo_all_blocks=1 00:14:14.754 --rc geninfo_unexecuted_blocks=1 00:14:14.754 00:14:14.754 ' 00:14:14.754 15:15:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:14.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:14.754 --rc genhtml_branch_coverage=1 00:14:14.754 --rc genhtml_function_coverage=1 00:14:14.754 --rc genhtml_legend=1 00:14:14.754 --rc geninfo_all_blocks=1 00:14:14.754 --rc geninfo_unexecuted_blocks=1 00:14:14.754 00:14:14.754 ' 00:14:14.754 15:15:12 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:14.754 15:15:12 -- nvmf/common.sh@7 -- # uname -s 00:14:14.754 15:15:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:14.754 15:15:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:14.754 15:15:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:14.754 15:15:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:14.754 15:15:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:14.754 15:15:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:14.754 15:15:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:14.754 15:15:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:14.754 15:15:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:14.754 15:15:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:14.754 15:15:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:14.754 15:15:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:14.754 15:15:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:14.754 15:15:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:14.754 15:15:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:14.754 15:15:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:14.754 15:15:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:14.754 15:15:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:14.754 15:15:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:14.754 15:15:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.754 15:15:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.754 15:15:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.754 15:15:12 -- paths/export.sh@5 -- # export PATH 00:14:14.754 15:15:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.754 15:15:12 -- nvmf/common.sh@46 -- # : 0 00:14:14.754 15:15:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:14.754 15:15:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:14.754 15:15:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:14.754 15:15:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:14.754 15:15:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:14.754 15:15:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:14.754 15:15:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:14.754 15:15:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:14.754 15:15:12 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:14.754 15:15:12 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:14.754 15:15:12 -- target/host_management.sh@104 -- # nvmftestinit 00:14:14.754 15:15:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:14.754 15:15:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:14.754 15:15:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:14.754 15:15:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:14.754 15:15:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:14.754 15:15:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.754 15:15:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.754 15:15:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:14.754 15:15:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:14.754 15:15:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:14.754 15:15:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:14.754 15:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.655 15:15:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:16.655 15:15:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:16.655 15:15:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:16.655 15:15:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:16.655 15:15:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:16.655 15:15:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:16.655 15:15:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:16.655 15:15:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:16.655 15:15:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:16.655 15:15:14 -- nvmf/common.sh@295 -- # e810=() 00:14:16.655 15:15:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:16.655 15:15:14 -- nvmf/common.sh@296 -- # x722=() 00:14:16.655 15:15:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:16.655 15:15:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:16.655 15:15:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:16.655 15:15:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:16.655 15:15:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:16.655 15:15:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:16.655 15:15:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:16.655 15:15:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:16.655 15:15:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:16.655 15:15:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:16.655 15:15:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.655 15:15:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:16.655 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:16.655 15:15:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.655 15:15:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.655 15:15:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.656 15:15:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:16.656 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:16.656 15:15:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:16.656 15:15:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.656 15:15:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.656 15:15:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.656 15:15:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.656 15:15:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:16.656 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:16.656 15:15:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.656 15:15:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.656 15:15:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.656 15:15:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.656 15:15:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.656 15:15:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:16.656 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:16.656 15:15:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.656 15:15:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:16.656 15:15:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:16.656 15:15:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:16.656 15:15:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:16.656 15:15:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:16.656 15:15:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:16.656 15:15:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:16.656 15:15:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:16.656 15:15:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:16.656 15:15:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:16.656 15:15:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:16.656 15:15:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:16.656 15:15:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:16.656 15:15:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:16.656 15:15:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:16.656 15:15:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:16.656 15:15:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:16.656 15:15:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:16.656 15:15:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:16.656 15:15:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:16.656 15:15:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:16.656 15:15:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:16.656 15:15:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:16.656 15:15:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:16.656 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:16.656 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.351 ms 00:14:16.656 00:14:16.656 --- 10.0.0.2 ping statistics --- 00:14:16.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.656 rtt min/avg/max/mdev = 0.351/0.351/0.351/0.000 ms 00:14:16.656 15:15:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:16.656 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:16.656 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:14:16.656 00:14:16.656 --- 10.0.0.1 ping statistics --- 00:14:16.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.656 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:14:16.656 15:15:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:16.656 15:15:15 -- nvmf/common.sh@410 -- # return 0 00:14:16.656 15:15:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:16.656 15:15:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:16.656 15:15:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:16.656 15:15:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:16.656 15:15:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:16.656 15:15:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:16.656 15:15:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:16.656 15:15:15 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:16.656 15:15:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:16.656 15:15:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:16.656 15:15:15 -- common/autotest_common.sh@10 -- # set +x 00:14:16.656 ************************************ 00:14:16.656 START TEST nvmf_host_management 00:14:16.656 ************************************ 00:14:16.656 15:15:15 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:16.656 15:15:15 -- target/host_management.sh@69 -- # starttarget 00:14:16.656 15:15:15 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:16.656 15:15:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:16.656 15:15:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:16.656 15:15:15 -- common/autotest_common.sh@10 -- # set +x 00:14:16.656 15:15:15 -- nvmf/common.sh@469 -- # nvmfpid=2741564 00:14:16.656 15:15:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:16.656 15:15:15 -- nvmf/common.sh@470 -- # waitforlisten 2741564 00:14:16.656 15:15:15 -- common/autotest_common.sh@829 -- # '[' -z 2741564 ']' 00:14:16.656 15:15:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:16.656 15:15:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:16.656 15:15:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:16.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:16.656 15:15:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:16.656 15:15:15 -- common/autotest_common.sh@10 -- # set +x 00:14:16.915 [2024-11-19 15:15:15.231194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:16.915 [2024-11-19 15:15:15.231288] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:16.915 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.915 [2024-11-19 15:15:15.294856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:16.915 [2024-11-19 15:15:15.404243] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:16.915 [2024-11-19 15:15:15.404418] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:16.915 [2024-11-19 15:15:15.404436] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:16.915 [2024-11-19 15:15:15.404449] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:16.915 [2024-11-19 15:15:15.404523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:16.915 [2024-11-19 15:15:15.404582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:16.915 [2024-11-19 15:15:15.404648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:16.915 [2024-11-19 15:15:15.404650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:17.849 15:15:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:17.849 15:15:16 -- common/autotest_common.sh@862 -- # return 0 00:14:17.849 15:15:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:17.849 15:15:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 15:15:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:17.849 15:15:16 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:17.849 15:15:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 [2024-11-19 15:15:16.229304] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:17.849 15:15:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.849 15:15:16 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:17.849 15:15:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 15:15:16 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:17.849 15:15:16 -- target/host_management.sh@23 -- # cat 00:14:17.849 15:15:16 -- target/host_management.sh@30 -- # rpc_cmd 00:14:17.849 15:15:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 Malloc0 00:14:17.849 [2024-11-19 15:15:16.289055] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.849 15:15:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.849 15:15:16 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:17.849 15:15:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 15:15:16 -- target/host_management.sh@73 -- # perfpid=2741741 00:14:17.849 15:15:16 -- target/host_management.sh@74 -- # waitforlisten 2741741 /var/tmp/bdevperf.sock 00:14:17.849 15:15:16 -- common/autotest_common.sh@829 -- # '[' -z 2741741 ']' 00:14:17.849 15:15:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:17.849 15:15:16 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:17.849 15:15:16 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:17.849 15:15:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:17.849 15:15:16 -- nvmf/common.sh@520 -- # config=() 00:14:17.849 15:15:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:17.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:17.849 15:15:16 -- nvmf/common.sh@520 -- # local subsystem config 00:14:17.849 15:15:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:17.849 15:15:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:17.849 15:15:16 -- common/autotest_common.sh@10 -- # set +x 00:14:17.849 15:15:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:17.849 { 00:14:17.849 "params": { 00:14:17.849 "name": "Nvme$subsystem", 00:14:17.849 "trtype": "$TEST_TRANSPORT", 00:14:17.849 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:17.849 "adrfam": "ipv4", 00:14:17.849 "trsvcid": "$NVMF_PORT", 00:14:17.849 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:17.849 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:17.849 "hdgst": ${hdgst:-false}, 00:14:17.849 "ddgst": ${ddgst:-false} 00:14:17.849 }, 00:14:17.849 "method": "bdev_nvme_attach_controller" 00:14:17.849 } 00:14:17.849 EOF 00:14:17.849 )") 00:14:17.849 15:15:16 -- nvmf/common.sh@542 -- # cat 00:14:17.849 15:15:16 -- nvmf/common.sh@544 -- # jq . 00:14:17.849 15:15:16 -- nvmf/common.sh@545 -- # IFS=, 00:14:17.849 15:15:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:17.849 "params": { 00:14:17.849 "name": "Nvme0", 00:14:17.849 "trtype": "tcp", 00:14:17.849 "traddr": "10.0.0.2", 00:14:17.850 "adrfam": "ipv4", 00:14:17.850 "trsvcid": "4420", 00:14:17.850 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:17.850 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:17.850 "hdgst": false, 00:14:17.850 "ddgst": false 00:14:17.850 }, 00:14:17.850 "method": "bdev_nvme_attach_controller" 00:14:17.850 }' 00:14:17.850 [2024-11-19 15:15:16.363541] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:17.850 [2024-11-19 15:15:16.363614] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2741741 ] 00:14:17.850 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.108 [2024-11-19 15:15:16.423660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:18.108 [2024-11-19 15:15:16.531511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:18.365 Running I/O for 10 seconds... 00:14:18.933 15:15:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:18.933 15:15:17 -- common/autotest_common.sh@862 -- # return 0 00:14:18.933 15:15:17 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:18.933 15:15:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.933 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:18.933 15:15:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.933 15:15:17 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:18.933 15:15:17 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:18.933 15:15:17 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:18.933 15:15:17 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:18.933 15:15:17 -- target/host_management.sh@52 -- # local ret=1 00:14:18.933 15:15:17 -- target/host_management.sh@53 -- # local i 00:14:18.933 15:15:17 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:18.933 15:15:17 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:18.933 15:15:17 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:18.933 15:15:17 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:18.933 15:15:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.933 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:18.933 15:15:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.933 15:15:17 -- target/host_management.sh@55 -- # read_io_count=2361 00:14:18.933 15:15:17 -- target/host_management.sh@58 -- # '[' 2361 -ge 100 ']' 00:14:18.933 15:15:17 -- target/host_management.sh@59 -- # ret=0 00:14:18.933 15:15:17 -- target/host_management.sh@60 -- # break 00:14:18.933 15:15:17 -- target/host_management.sh@64 -- # return 0 00:14:18.933 15:15:17 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:18.933 15:15:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.933 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:18.933 [2024-11-19 15:15:17.369564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.369730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc30e60 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.371369] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:18.933 [2024-11-19 15:15:17.371409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.371428] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:18.933 [2024-11-19 15:15:17.371442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.371457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:18.933 [2024-11-19 15:15:17.371470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.371483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:18.933 [2024-11-19 15:15:17.371495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.371508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x165b160 is same with the state(5) to be set 00:14:18.933 [2024-11-19 15:15:17.372123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:59520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:59648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:59776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:59904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:60032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:60160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:60288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:60416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:60544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:60672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:60800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:60928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:61056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:61184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:61312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:61440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:61568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:61696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:61824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:61952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:62080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.933 [2024-11-19 15:15:17.372785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:62208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.933 [2024-11-19 15:15:17.372799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:62336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:62464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:62592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:62720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:62848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:62976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.372969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.372994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:63104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:63232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:63360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:63488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:63616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:63744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:54400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 15:15:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.934 [2024-11-19 15:15:17.373198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:54784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:63872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:64000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:64128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:64256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 15:15:17 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:18.934 [2024-11-19 15:15:17.373341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:64384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:64512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:64640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:64768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:55040 len:12 15:15:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.934 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:64896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:65024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:65152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:18.934 [2024-11-19 15:15:17.373577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:55296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:55424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:55936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:56320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:56448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:57344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:57472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:57728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:57984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:65280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:58112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.934 [2024-11-19 15:15:17.373896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.934 [2024-11-19 15:15:17.373911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:58240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.935 [2024-11-19 15:15:17.373925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.935 [2024-11-19 15:15:17.373941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:58368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.935 [2024-11-19 15:15:17.373954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.935 [2024-11-19 15:15:17.373969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:58624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.935 [2024-11-19 15:15:17.373985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.935 [2024-11-19 15:15:17.374001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:58752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.935 [2024-11-19 15:15:17.374015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.935 [2024-11-19 15:15:17.374029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:59136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.935 [2024-11-19 15:15:17.374043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.935 [2024-11-19 15:15:17.374122] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1659030 was disconnected and freed. reset controller. 00:14:18.935 [2024-11-19 15:15:17.375329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:18.935 task offset: 59520 on job bdev=Nvme0n1 fails 00:14:18.935 00:14:18.935 Latency(us) 00:14:18.935 [2024-11-19T14:15:17.498Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.935 [2024-11-19T14:15:17.498Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:18.935 [2024-11-19T14:15:17.498Z] Job: Nvme0n1 ended in about 0.66 seconds with error 00:14:18.935 Verification LBA range: start 0x0 length 0x400 00:14:18.935 Nvme0n1 : 0.66 3778.22 236.14 96.92 0.00 16273.75 2366.58 23787.14 00:14:18.935 [2024-11-19T14:15:17.498Z] =================================================================================================================== 00:14:18.935 [2024-11-19T14:15:17.498Z] Total : 3778.22 236.14 96.92 0.00 16273.75 2366.58 23787.14 00:14:18.935 [2024-11-19 15:15:17.377235] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:18.935 [2024-11-19 15:15:17.377262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x165b160 (9): Bad file descriptor 00:14:18.935 15:15:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.935 15:15:17 -- target/host_management.sh@87 -- # sleep 1 00:14:18.935 [2024-11-19 15:15:17.428832] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:19.868 15:15:18 -- target/host_management.sh@91 -- # kill -9 2741741 00:14:19.868 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2741741) - No such process 00:14:19.868 15:15:18 -- target/host_management.sh@91 -- # true 00:14:19.868 15:15:18 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:19.868 15:15:18 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:19.868 15:15:18 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:19.868 15:15:18 -- nvmf/common.sh@520 -- # config=() 00:14:19.868 15:15:18 -- nvmf/common.sh@520 -- # local subsystem config 00:14:19.868 15:15:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:19.868 15:15:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:19.868 { 00:14:19.868 "params": { 00:14:19.868 "name": "Nvme$subsystem", 00:14:19.868 "trtype": "$TEST_TRANSPORT", 00:14:19.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:19.868 "adrfam": "ipv4", 00:14:19.868 "trsvcid": "$NVMF_PORT", 00:14:19.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:19.868 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:19.868 "hdgst": ${hdgst:-false}, 00:14:19.868 "ddgst": ${ddgst:-false} 00:14:19.868 }, 00:14:19.868 "method": "bdev_nvme_attach_controller" 00:14:19.868 } 00:14:19.868 EOF 00:14:19.868 )") 00:14:19.868 15:15:18 -- nvmf/common.sh@542 -- # cat 00:14:19.868 15:15:18 -- nvmf/common.sh@544 -- # jq . 00:14:19.868 15:15:18 -- nvmf/common.sh@545 -- # IFS=, 00:14:19.868 15:15:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:19.868 "params": { 00:14:19.868 "name": "Nvme0", 00:14:19.868 "trtype": "tcp", 00:14:19.868 "traddr": "10.0.0.2", 00:14:19.868 "adrfam": "ipv4", 00:14:19.868 "trsvcid": "4420", 00:14:19.868 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.868 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:19.868 "hdgst": false, 00:14:19.868 "ddgst": false 00:14:19.868 }, 00:14:19.868 "method": "bdev_nvme_attach_controller" 00:14:19.868 }' 00:14:19.868 [2024-11-19 15:15:18.427233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:19.868 [2024-11-19 15:15:18.427317] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2742021 ] 00:14:20.126 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.126 [2024-11-19 15:15:18.487087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:20.126 [2024-11-19 15:15:18.594747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.384 Running I/O for 1 seconds... 00:14:21.318 00:14:21.318 Latency(us) 00:14:21.318 [2024-11-19T14:15:19.881Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:21.318 [2024-11-19T14:15:19.881Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:21.318 Verification LBA range: start 0x0 length 0x400 00:14:21.318 Nvme0n1 : 1.01 3987.03 249.19 0.00 0.00 15784.83 1395.67 23884.23 00:14:21.318 [2024-11-19T14:15:19.881Z] =================================================================================================================== 00:14:21.318 [2024-11-19T14:15:19.881Z] Total : 3987.03 249.19 0.00 0.00 15784.83 1395.67 23884.23 00:14:21.576 15:15:20 -- target/host_management.sh@101 -- # stoptarget 00:14:21.576 15:15:20 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:21.576 15:15:20 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:21.576 15:15:20 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:21.576 15:15:20 -- target/host_management.sh@40 -- # nvmftestfini 00:14:21.576 15:15:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:21.576 15:15:20 -- nvmf/common.sh@116 -- # sync 00:14:21.576 15:15:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:21.576 15:15:20 -- nvmf/common.sh@119 -- # set +e 00:14:21.576 15:15:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:21.576 15:15:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:21.576 rmmod nvme_tcp 00:14:21.576 rmmod nvme_fabrics 00:14:21.576 rmmod nvme_keyring 00:14:21.576 15:15:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:21.576 15:15:20 -- nvmf/common.sh@123 -- # set -e 00:14:21.576 15:15:20 -- nvmf/common.sh@124 -- # return 0 00:14:21.576 15:15:20 -- nvmf/common.sh@477 -- # '[' -n 2741564 ']' 00:14:21.576 15:15:20 -- nvmf/common.sh@478 -- # killprocess 2741564 00:14:21.576 15:15:20 -- common/autotest_common.sh@936 -- # '[' -z 2741564 ']' 00:14:21.576 15:15:20 -- common/autotest_common.sh@940 -- # kill -0 2741564 00:14:21.576 15:15:20 -- common/autotest_common.sh@941 -- # uname 00:14:21.576 15:15:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:21.576 15:15:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2741564 00:14:21.835 15:15:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:21.835 15:15:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:21.835 15:15:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2741564' 00:14:21.835 killing process with pid 2741564 00:14:21.835 15:15:20 -- common/autotest_common.sh@955 -- # kill 2741564 00:14:21.835 15:15:20 -- common/autotest_common.sh@960 -- # wait 2741564 00:14:22.094 [2024-11-19 15:15:20.408500] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:22.094 15:15:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:22.094 15:15:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:22.095 15:15:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:22.095 15:15:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:22.095 15:15:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:22.095 15:15:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:22.095 15:15:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:22.095 15:15:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.999 15:15:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:23.999 00:14:23.999 real 0m7.297s 00:14:23.999 user 0m22.260s 00:14:23.999 sys 0m1.475s 00:14:23.999 15:15:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:23.999 15:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:23.999 ************************************ 00:14:23.999 END TEST nvmf_host_management 00:14:23.999 ************************************ 00:14:23.999 15:15:22 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:23.999 00:14:23.999 real 0m9.769s 00:14:23.999 user 0m23.189s 00:14:23.999 sys 0m2.962s 00:14:23.999 15:15:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:23.999 15:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:23.999 ************************************ 00:14:23.999 END TEST nvmf_host_management 00:14:23.999 ************************************ 00:14:23.999 15:15:22 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:23.999 15:15:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:23.999 15:15:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:23.999 15:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:23.999 ************************************ 00:14:23.999 START TEST nvmf_lvol 00:14:23.999 ************************************ 00:14:23.999 15:15:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:24.258 * Looking for test storage... 00:14:24.258 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:24.258 15:15:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:24.258 15:15:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:24.258 15:15:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:24.258 15:15:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:24.258 15:15:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:24.258 15:15:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:24.258 15:15:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:24.258 15:15:22 -- scripts/common.sh@335 -- # IFS=.-: 00:14:24.258 15:15:22 -- scripts/common.sh@335 -- # read -ra ver1 00:14:24.258 15:15:22 -- scripts/common.sh@336 -- # IFS=.-: 00:14:24.258 15:15:22 -- scripts/common.sh@336 -- # read -ra ver2 00:14:24.258 15:15:22 -- scripts/common.sh@337 -- # local 'op=<' 00:14:24.258 15:15:22 -- scripts/common.sh@339 -- # ver1_l=2 00:14:24.258 15:15:22 -- scripts/common.sh@340 -- # ver2_l=1 00:14:24.258 15:15:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:24.258 15:15:22 -- scripts/common.sh@343 -- # case "$op" in 00:14:24.258 15:15:22 -- scripts/common.sh@344 -- # : 1 00:14:24.258 15:15:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:24.258 15:15:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:24.258 15:15:22 -- scripts/common.sh@364 -- # decimal 1 00:14:24.258 15:15:22 -- scripts/common.sh@352 -- # local d=1 00:14:24.258 15:15:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:24.258 15:15:22 -- scripts/common.sh@354 -- # echo 1 00:14:24.258 15:15:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:24.258 15:15:22 -- scripts/common.sh@365 -- # decimal 2 00:14:24.258 15:15:22 -- scripts/common.sh@352 -- # local d=2 00:14:24.258 15:15:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:24.258 15:15:22 -- scripts/common.sh@354 -- # echo 2 00:14:24.258 15:15:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:24.258 15:15:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:24.258 15:15:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:24.258 15:15:22 -- scripts/common.sh@367 -- # return 0 00:14:24.258 15:15:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:24.258 15:15:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:24.258 --rc genhtml_branch_coverage=1 00:14:24.258 --rc genhtml_function_coverage=1 00:14:24.258 --rc genhtml_legend=1 00:14:24.258 --rc geninfo_all_blocks=1 00:14:24.258 --rc geninfo_unexecuted_blocks=1 00:14:24.258 00:14:24.258 ' 00:14:24.258 15:15:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:24.258 --rc genhtml_branch_coverage=1 00:14:24.258 --rc genhtml_function_coverage=1 00:14:24.258 --rc genhtml_legend=1 00:14:24.258 --rc geninfo_all_blocks=1 00:14:24.258 --rc geninfo_unexecuted_blocks=1 00:14:24.258 00:14:24.258 ' 00:14:24.258 15:15:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:24.258 --rc genhtml_branch_coverage=1 00:14:24.258 --rc genhtml_function_coverage=1 00:14:24.258 --rc genhtml_legend=1 00:14:24.258 --rc geninfo_all_blocks=1 00:14:24.258 --rc geninfo_unexecuted_blocks=1 00:14:24.258 00:14:24.258 ' 00:14:24.258 15:15:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:24.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:24.258 --rc genhtml_branch_coverage=1 00:14:24.258 --rc genhtml_function_coverage=1 00:14:24.258 --rc genhtml_legend=1 00:14:24.258 --rc geninfo_all_blocks=1 00:14:24.258 --rc geninfo_unexecuted_blocks=1 00:14:24.258 00:14:24.258 ' 00:14:24.258 15:15:22 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:24.258 15:15:22 -- nvmf/common.sh@7 -- # uname -s 00:14:24.258 15:15:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:24.258 15:15:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:24.258 15:15:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:24.258 15:15:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:24.258 15:15:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:24.258 15:15:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:24.258 15:15:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:24.258 15:15:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:24.258 15:15:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:24.258 15:15:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:24.258 15:15:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:24.258 15:15:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:24.258 15:15:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:24.258 15:15:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:24.258 15:15:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:24.258 15:15:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:24.258 15:15:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:24.258 15:15:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:24.258 15:15:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:24.258 15:15:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.259 15:15:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.259 15:15:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.259 15:15:22 -- paths/export.sh@5 -- # export PATH 00:14:24.259 15:15:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.259 15:15:22 -- nvmf/common.sh@46 -- # : 0 00:14:24.259 15:15:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:24.259 15:15:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:24.259 15:15:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:24.259 15:15:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:24.259 15:15:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:24.259 15:15:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:24.259 15:15:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:24.259 15:15:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:24.259 15:15:22 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:24.259 15:15:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:24.259 15:15:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:24.259 15:15:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:24.259 15:15:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:24.259 15:15:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:24.259 15:15:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.259 15:15:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.259 15:15:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.259 15:15:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:24.259 15:15:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:24.259 15:15:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:24.259 15:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:26.161 15:15:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:26.161 15:15:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:26.161 15:15:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:26.161 15:15:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:26.161 15:15:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:26.161 15:15:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:26.161 15:15:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:26.161 15:15:24 -- nvmf/common.sh@294 -- # net_devs=() 00:14:26.161 15:15:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:26.161 15:15:24 -- nvmf/common.sh@295 -- # e810=() 00:14:26.161 15:15:24 -- nvmf/common.sh@295 -- # local -ga e810 00:14:26.161 15:15:24 -- nvmf/common.sh@296 -- # x722=() 00:14:26.161 15:15:24 -- nvmf/common.sh@296 -- # local -ga x722 00:14:26.161 15:15:24 -- nvmf/common.sh@297 -- # mlx=() 00:14:26.161 15:15:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:26.161 15:15:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:26.161 15:15:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:26.161 15:15:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:26.161 15:15:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.161 15:15:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:26.161 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:26.161 15:15:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.161 15:15:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:26.161 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:26.161 15:15:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.161 15:15:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.161 15:15:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.161 15:15:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:26.161 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:26.161 15:15:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.161 15:15:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.161 15:15:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.161 15:15:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.161 15:15:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:26.161 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:26.161 15:15:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.161 15:15:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:26.161 15:15:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:26.161 15:15:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:26.161 15:15:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:26.161 15:15:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:26.161 15:15:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:26.161 15:15:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:26.161 15:15:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:26.161 15:15:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:26.161 15:15:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:26.161 15:15:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:26.161 15:15:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:26.161 15:15:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:26.161 15:15:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:26.161 15:15:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:26.161 15:15:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:26.161 15:15:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:26.161 15:15:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:26.161 15:15:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:26.161 15:15:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:26.161 15:15:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:26.161 15:15:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:26.161 15:15:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:26.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:26.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:14:26.420 00:14:26.420 --- 10.0.0.2 ping statistics --- 00:14:26.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.420 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:14:26.420 15:15:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:26.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:26.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:14:26.420 00:14:26.420 --- 10.0.0.1 ping statistics --- 00:14:26.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.420 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:14:26.420 15:15:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:26.420 15:15:24 -- nvmf/common.sh@410 -- # return 0 00:14:26.420 15:15:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:26.420 15:15:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:26.420 15:15:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:26.420 15:15:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:26.420 15:15:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:26.420 15:15:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:26.420 15:15:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:26.420 15:15:24 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:26.420 15:15:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:26.420 15:15:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:26.420 15:15:24 -- common/autotest_common.sh@10 -- # set +x 00:14:26.420 15:15:24 -- nvmf/common.sh@469 -- # nvmfpid=2744258 00:14:26.420 15:15:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:26.420 15:15:24 -- nvmf/common.sh@470 -- # waitforlisten 2744258 00:14:26.420 15:15:24 -- common/autotest_common.sh@829 -- # '[' -z 2744258 ']' 00:14:26.420 15:15:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:26.420 15:15:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:26.420 15:15:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:26.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:26.420 15:15:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:26.420 15:15:24 -- common/autotest_common.sh@10 -- # set +x 00:14:26.420 [2024-11-19 15:15:24.802308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:26.420 [2024-11-19 15:15:24.802389] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:26.420 EAL: No free 2048 kB hugepages reported on node 1 00:14:26.420 [2024-11-19 15:15:24.870854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:26.678 [2024-11-19 15:15:24.985031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:26.679 [2024-11-19 15:15:24.985188] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:26.679 [2024-11-19 15:15:24.985208] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:26.679 [2024-11-19 15:15:24.985223] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:26.679 [2024-11-19 15:15:24.985280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:26.679 [2024-11-19 15:15:24.985316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:26.679 [2024-11-19 15:15:24.985319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:27.243 15:15:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:27.243 15:15:25 -- common/autotest_common.sh@862 -- # return 0 00:14:27.243 15:15:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:27.243 15:15:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:27.243 15:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:27.501 15:15:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:27.501 15:15:25 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:27.501 [2024-11-19 15:15:26.044368] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:27.759 15:15:26 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:28.017 15:15:26 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:28.017 15:15:26 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:28.275 15:15:26 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:28.275 15:15:26 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:28.533 15:15:26 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:28.790 15:15:27 -- target/nvmf_lvol.sh@29 -- # lvs=23c2eb64-5d32-41a1-8299-e6f7fa290330 00:14:28.791 15:15:27 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 23c2eb64-5d32-41a1-8299-e6f7fa290330 lvol 20 00:14:29.048 15:15:27 -- target/nvmf_lvol.sh@32 -- # lvol=8756063f-4c20-4125-be2d-1301b522965e 00:14:29.048 15:15:27 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:29.305 15:15:27 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8756063f-4c20-4125-be2d-1301b522965e 00:14:29.563 15:15:27 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:29.820 [2024-11-19 15:15:28.198800] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:29.820 15:15:28 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:30.078 15:15:28 -- target/nvmf_lvol.sh@42 -- # perf_pid=2744703 00:14:30.078 15:15:28 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:30.078 15:15:28 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:30.078 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.011 15:15:29 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 8756063f-4c20-4125-be2d-1301b522965e MY_SNAPSHOT 00:14:31.270 15:15:29 -- target/nvmf_lvol.sh@47 -- # snapshot=4c49db84-0e0c-4a1e-a792-64886823e2f7 00:14:31.270 15:15:29 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 8756063f-4c20-4125-be2d-1301b522965e 30 00:14:31.528 15:15:30 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 4c49db84-0e0c-4a1e-a792-64886823e2f7 MY_CLONE 00:14:32.095 15:15:30 -- target/nvmf_lvol.sh@49 -- # clone=9ec45ae7-9633-4082-9665-137e647770c4 00:14:32.095 15:15:30 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 9ec45ae7-9633-4082-9665-137e647770c4 00:14:32.662 15:15:30 -- target/nvmf_lvol.sh@53 -- # wait 2744703 00:14:40.774 Initializing NVMe Controllers 00:14:40.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:40.774 Controller IO queue size 128, less than required. 00:14:40.774 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:40.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:40.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:40.774 Initialization complete. Launching workers. 00:14:40.774 ======================================================== 00:14:40.774 Latency(us) 00:14:40.774 Device Information : IOPS MiB/s Average min max 00:14:40.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10847.68 42.37 11803.75 498.64 111929.15 00:14:40.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10837.18 42.33 11815.68 2414.55 52579.02 00:14:40.774 ======================================================== 00:14:40.774 Total : 21684.86 84.71 11809.71 498.64 111929.15 00:14:40.774 00:14:40.774 15:15:38 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:40.774 15:15:39 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8756063f-4c20-4125-be2d-1301b522965e 00:14:41.032 15:15:39 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 23c2eb64-5d32-41a1-8299-e6f7fa290330 00:14:41.289 15:15:39 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:41.289 15:15:39 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:41.289 15:15:39 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:41.289 15:15:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:41.289 15:15:39 -- nvmf/common.sh@116 -- # sync 00:14:41.289 15:15:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:41.289 15:15:39 -- nvmf/common.sh@119 -- # set +e 00:14:41.289 15:15:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:41.289 15:15:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:41.289 rmmod nvme_tcp 00:14:41.289 rmmod nvme_fabrics 00:14:41.289 rmmod nvme_keyring 00:14:41.289 15:15:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:41.289 15:15:39 -- nvmf/common.sh@123 -- # set -e 00:14:41.289 15:15:39 -- nvmf/common.sh@124 -- # return 0 00:14:41.289 15:15:39 -- nvmf/common.sh@477 -- # '[' -n 2744258 ']' 00:14:41.289 15:15:39 -- nvmf/common.sh@478 -- # killprocess 2744258 00:14:41.289 15:15:39 -- common/autotest_common.sh@936 -- # '[' -z 2744258 ']' 00:14:41.289 15:15:39 -- common/autotest_common.sh@940 -- # kill -0 2744258 00:14:41.289 15:15:39 -- common/autotest_common.sh@941 -- # uname 00:14:41.289 15:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:41.289 15:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2744258 00:14:41.289 15:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:41.289 15:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:41.289 15:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2744258' 00:14:41.289 killing process with pid 2744258 00:14:41.289 15:15:39 -- common/autotest_common.sh@955 -- # kill 2744258 00:14:41.289 15:15:39 -- common/autotest_common.sh@960 -- # wait 2744258 00:14:41.855 15:15:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.855 15:15:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.855 15:15:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.855 15:15:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.855 15:15:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.855 15:15:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.855 15:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.855 15:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:43.834 15:15:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:43.834 00:14:43.834 real 0m19.668s 00:14:43.834 user 1m6.608s 00:14:43.834 sys 0m5.656s 00:14:43.834 15:15:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:43.834 15:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:43.834 ************************************ 00:14:43.834 END TEST nvmf_lvol 00:14:43.834 ************************************ 00:14:43.834 15:15:42 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:43.834 15:15:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:43.834 15:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:43.834 15:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:43.834 ************************************ 00:14:43.834 START TEST nvmf_lvs_grow 00:14:43.834 ************************************ 00:14:43.834 15:15:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:43.834 * Looking for test storage... 00:14:43.834 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:43.834 15:15:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:43.834 15:15:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:43.834 15:15:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:43.834 15:15:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:43.834 15:15:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:43.834 15:15:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:43.834 15:15:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:43.834 15:15:42 -- scripts/common.sh@335 -- # IFS=.-: 00:14:43.834 15:15:42 -- scripts/common.sh@335 -- # read -ra ver1 00:14:43.834 15:15:42 -- scripts/common.sh@336 -- # IFS=.-: 00:14:43.834 15:15:42 -- scripts/common.sh@336 -- # read -ra ver2 00:14:43.834 15:15:42 -- scripts/common.sh@337 -- # local 'op=<' 00:14:43.834 15:15:42 -- scripts/common.sh@339 -- # ver1_l=2 00:14:43.834 15:15:42 -- scripts/common.sh@340 -- # ver2_l=1 00:14:43.834 15:15:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:43.834 15:15:42 -- scripts/common.sh@343 -- # case "$op" in 00:14:43.834 15:15:42 -- scripts/common.sh@344 -- # : 1 00:14:43.834 15:15:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:43.834 15:15:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:43.834 15:15:42 -- scripts/common.sh@364 -- # decimal 1 00:14:43.834 15:15:42 -- scripts/common.sh@352 -- # local d=1 00:14:43.834 15:15:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:43.834 15:15:42 -- scripts/common.sh@354 -- # echo 1 00:14:43.834 15:15:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:43.834 15:15:42 -- scripts/common.sh@365 -- # decimal 2 00:14:43.834 15:15:42 -- scripts/common.sh@352 -- # local d=2 00:14:43.834 15:15:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:43.834 15:15:42 -- scripts/common.sh@354 -- # echo 2 00:14:43.834 15:15:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:43.834 15:15:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:43.834 15:15:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:43.834 15:15:42 -- scripts/common.sh@367 -- # return 0 00:14:43.834 15:15:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:43.834 15:15:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:43.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.834 --rc genhtml_branch_coverage=1 00:14:43.834 --rc genhtml_function_coverage=1 00:14:43.834 --rc genhtml_legend=1 00:14:43.834 --rc geninfo_all_blocks=1 00:14:43.834 --rc geninfo_unexecuted_blocks=1 00:14:43.834 00:14:43.834 ' 00:14:43.835 15:15:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.835 --rc genhtml_branch_coverage=1 00:14:43.835 --rc genhtml_function_coverage=1 00:14:43.835 --rc genhtml_legend=1 00:14:43.835 --rc geninfo_all_blocks=1 00:14:43.835 --rc geninfo_unexecuted_blocks=1 00:14:43.835 00:14:43.835 ' 00:14:43.835 15:15:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.835 --rc genhtml_branch_coverage=1 00:14:43.835 --rc genhtml_function_coverage=1 00:14:43.835 --rc genhtml_legend=1 00:14:43.835 --rc geninfo_all_blocks=1 00:14:43.835 --rc geninfo_unexecuted_blocks=1 00:14:43.835 00:14:43.835 ' 00:14:43.835 15:15:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.835 --rc genhtml_branch_coverage=1 00:14:43.835 --rc genhtml_function_coverage=1 00:14:43.835 --rc genhtml_legend=1 00:14:43.835 --rc geninfo_all_blocks=1 00:14:43.835 --rc geninfo_unexecuted_blocks=1 00:14:43.835 00:14:43.835 ' 00:14:43.835 15:15:42 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:43.835 15:15:42 -- nvmf/common.sh@7 -- # uname -s 00:14:43.835 15:15:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:43.835 15:15:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:43.835 15:15:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:43.835 15:15:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:43.835 15:15:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:43.835 15:15:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:43.835 15:15:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:43.835 15:15:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:43.835 15:15:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.095 15:15:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.095 15:15:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.095 15:15:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.095 15:15:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.095 15:15:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.095 15:15:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.095 15:15:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:44.095 15:15:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.095 15:15:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.095 15:15:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.095 15:15:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.095 15:15:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.095 15:15:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.095 15:15:42 -- paths/export.sh@5 -- # export PATH 00:14:44.095 15:15:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.095 15:15:42 -- nvmf/common.sh@46 -- # : 0 00:14:44.095 15:15:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:44.095 15:15:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:44.095 15:15:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:44.095 15:15:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.095 15:15:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.095 15:15:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:44.095 15:15:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:44.095 15:15:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:44.095 15:15:42 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:44.095 15:15:42 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:44.095 15:15:42 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:44.095 15:15:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:44.095 15:15:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.095 15:15:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:44.095 15:15:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:44.095 15:15:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:44.095 15:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.095 15:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.095 15:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.095 15:15:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:44.095 15:15:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:44.095 15:15:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:44.095 15:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:45.998 15:15:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:45.998 15:15:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:45.998 15:15:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:45.998 15:15:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:45.998 15:15:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:45.998 15:15:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:45.998 15:15:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:45.998 15:15:44 -- nvmf/common.sh@294 -- # net_devs=() 00:14:45.998 15:15:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:45.998 15:15:44 -- nvmf/common.sh@295 -- # e810=() 00:14:45.998 15:15:44 -- nvmf/common.sh@295 -- # local -ga e810 00:14:45.998 15:15:44 -- nvmf/common.sh@296 -- # x722=() 00:14:45.998 15:15:44 -- nvmf/common.sh@296 -- # local -ga x722 00:14:45.998 15:15:44 -- nvmf/common.sh@297 -- # mlx=() 00:14:45.998 15:15:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:45.998 15:15:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:45.998 15:15:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:45.998 15:15:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:45.998 15:15:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:45.998 15:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:45.998 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:45.998 15:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:45.998 15:15:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:45.998 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:45.998 15:15:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:45.998 15:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.998 15:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.998 15:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:45.998 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:45.998 15:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.998 15:15:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:45.998 15:15:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.998 15:15:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.998 15:15:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:45.998 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:45.998 15:15:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.998 15:15:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:45.998 15:15:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:45.998 15:15:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:45.998 15:15:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:45.998 15:15:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:45.998 15:15:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:45.998 15:15:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:45.998 15:15:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:45.998 15:15:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:45.998 15:15:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:45.998 15:15:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:45.998 15:15:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:45.998 15:15:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:45.998 15:15:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:45.998 15:15:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:45.998 15:15:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:45.998 15:15:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:45.998 15:15:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:45.998 15:15:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:45.998 15:15:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:45.998 15:15:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:45.998 15:15:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:46.257 15:15:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:46.257 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:46.257 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:14:46.257 00:14:46.257 --- 10.0.0.2 ping statistics --- 00:14:46.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.257 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:14:46.257 15:15:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:46.257 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:46.257 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:14:46.257 00:14:46.257 --- 10.0.0.1 ping statistics --- 00:14:46.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.257 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:14:46.257 15:15:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:46.257 15:15:44 -- nvmf/common.sh@410 -- # return 0 00:14:46.257 15:15:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:46.257 15:15:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:46.257 15:15:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:46.257 15:15:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:46.257 15:15:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:46.257 15:15:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:46.257 15:15:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:46.257 15:15:44 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:46.257 15:15:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:46.257 15:15:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:46.257 15:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:46.257 15:15:44 -- nvmf/common.sh@469 -- # nvmfpid=2748032 00:14:46.257 15:15:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:46.257 15:15:44 -- nvmf/common.sh@470 -- # waitforlisten 2748032 00:14:46.257 15:15:44 -- common/autotest_common.sh@829 -- # '[' -z 2748032 ']' 00:14:46.257 15:15:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:46.257 15:15:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:46.257 15:15:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:46.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:46.257 15:15:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:46.257 15:15:44 -- common/autotest_common.sh@10 -- # set +x 00:14:46.257 [2024-11-19 15:15:44.634796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:46.257 [2024-11-19 15:15:44.634864] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:46.257 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.257 [2024-11-19 15:15:44.699560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:46.257 [2024-11-19 15:15:44.804660] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:46.257 [2024-11-19 15:15:44.804845] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.257 [2024-11-19 15:15:44.804864] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.257 [2024-11-19 15:15:44.804877] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.257 [2024-11-19 15:15:44.804907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:47.191 15:15:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:47.191 15:15:45 -- common/autotest_common.sh@862 -- # return 0 00:14:47.191 15:15:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.191 15:15:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:47.191 15:15:45 -- common/autotest_common.sh@10 -- # set +x 00:14:47.191 15:15:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:47.191 15:15:45 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:47.450 [2024-11-19 15:15:45.960029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:47.450 15:15:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:47.450 15:15:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:47.450 15:15:45 -- common/autotest_common.sh@10 -- # set +x 00:14:47.450 ************************************ 00:14:47.450 START TEST lvs_grow_clean 00:14:47.450 ************************************ 00:14:47.450 15:15:45 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:47.450 15:15:45 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:47.709 15:15:46 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:47.709 15:15:46 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:47.967 15:15:46 -- target/nvmf_lvs_grow.sh@28 -- # lvs=58e46f42-ba81-4d1c-acb9-391f77951453 00:14:47.967 15:15:46 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:14:47.967 15:15:46 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:48.225 15:15:46 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:48.225 15:15:46 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:48.225 15:15:46 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 58e46f42-ba81-4d1c-acb9-391f77951453 lvol 150 00:14:48.791 15:15:47 -- target/nvmf_lvs_grow.sh@33 -- # lvol=86aa9305-cc97-4408-8166-acb5aa9b1d81 00:14:48.791 15:15:47 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:48.791 15:15:47 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:48.791 [2024-11-19 15:15:47.298135] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:48.791 [2024-11-19 15:15:47.298247] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:48.791 true 00:14:48.791 15:15:47 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:14:48.791 15:15:47 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:49.050 15:15:47 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:49.050 15:15:47 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:49.307 15:15:47 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 86aa9305-cc97-4408-8166-acb5aa9b1d81 00:14:49.874 15:15:48 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:49.874 [2024-11-19 15:15:48.393518] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:49.874 15:15:48 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:50.132 15:15:48 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2748612 00:14:50.132 15:15:48 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:50.132 15:15:48 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2748612 /var/tmp/bdevperf.sock 00:14:50.132 15:15:48 -- common/autotest_common.sh@829 -- # '[' -z 2748612 ']' 00:14:50.132 15:15:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:50.132 15:15:48 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:50.132 15:15:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:50.132 15:15:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:50.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:50.132 15:15:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:50.132 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:50.390 [2024-11-19 15:15:48.699114] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:50.390 [2024-11-19 15:15:48.699200] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2748612 ] 00:14:50.390 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.390 [2024-11-19 15:15:48.764352] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:50.390 [2024-11-19 15:15:48.878890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.325 15:15:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:51.325 15:15:49 -- common/autotest_common.sh@862 -- # return 0 00:14:51.325 15:15:49 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:51.583 Nvme0n1 00:14:51.583 15:15:50 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:51.842 [ 00:14:51.842 { 00:14:51.842 "name": "Nvme0n1", 00:14:51.842 "aliases": [ 00:14:51.842 "86aa9305-cc97-4408-8166-acb5aa9b1d81" 00:14:51.842 ], 00:14:51.842 "product_name": "NVMe disk", 00:14:51.842 "block_size": 4096, 00:14:51.842 "num_blocks": 38912, 00:14:51.842 "uuid": "86aa9305-cc97-4408-8166-acb5aa9b1d81", 00:14:51.842 "assigned_rate_limits": { 00:14:51.842 "rw_ios_per_sec": 0, 00:14:51.842 "rw_mbytes_per_sec": 0, 00:14:51.842 "r_mbytes_per_sec": 0, 00:14:51.842 "w_mbytes_per_sec": 0 00:14:51.842 }, 00:14:51.842 "claimed": false, 00:14:51.842 "zoned": false, 00:14:51.842 "supported_io_types": { 00:14:51.842 "read": true, 00:14:51.842 "write": true, 00:14:51.842 "unmap": true, 00:14:51.842 "write_zeroes": true, 00:14:51.842 "flush": true, 00:14:51.842 "reset": true, 00:14:51.842 "compare": true, 00:14:51.842 "compare_and_write": true, 00:14:51.842 "abort": true, 00:14:51.842 "nvme_admin": true, 00:14:51.842 "nvme_io": true 00:14:51.842 }, 00:14:51.842 "driver_specific": { 00:14:51.842 "nvme": [ 00:14:51.842 { 00:14:51.842 "trid": { 00:14:51.842 "trtype": "TCP", 00:14:51.842 "adrfam": "IPv4", 00:14:51.842 "traddr": "10.0.0.2", 00:14:51.842 "trsvcid": "4420", 00:14:51.842 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:51.842 }, 00:14:51.842 "ctrlr_data": { 00:14:51.842 "cntlid": 1, 00:14:51.842 "vendor_id": "0x8086", 00:14:51.842 "model_number": "SPDK bdev Controller", 00:14:51.842 "serial_number": "SPDK0", 00:14:51.842 "firmware_revision": "24.01.1", 00:14:51.842 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:51.842 "oacs": { 00:14:51.842 "security": 0, 00:14:51.842 "format": 0, 00:14:51.842 "firmware": 0, 00:14:51.842 "ns_manage": 0 00:14:51.842 }, 00:14:51.842 "multi_ctrlr": true, 00:14:51.842 "ana_reporting": false 00:14:51.842 }, 00:14:51.842 "vs": { 00:14:51.842 "nvme_version": "1.3" 00:14:51.842 }, 00:14:51.842 "ns_data": { 00:14:51.842 "id": 1, 00:14:51.842 "can_share": true 00:14:51.842 } 00:14:51.842 } 00:14:51.842 ], 00:14:51.842 "mp_policy": "active_passive" 00:14:51.842 } 00:14:51.842 } 00:14:51.842 ] 00:14:51.842 15:15:50 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2748766 00:14:51.842 15:15:50 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:51.842 15:15:50 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:52.101 Running I/O for 10 seconds... 00:14:53.037 Latency(us) 00:14:53.037 [2024-11-19T14:15:51.600Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:53.037 [2024-11-19T14:15:51.600Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.037 Nvme0n1 : 1.00 15059.00 58.82 0.00 0.00 0.00 0.00 0.00 00:14:53.037 [2024-11-19T14:15:51.600Z] =================================================================================================================== 00:14:53.037 [2024-11-19T14:15:51.600Z] Total : 15059.00 58.82 0.00 0.00 0.00 0.00 0.00 00:14:53.037 00:14:53.973 15:15:52 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:14:53.973 [2024-11-19T14:15:52.536Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.973 Nvme0n1 : 2.00 15382.50 60.09 0.00 0.00 0.00 0.00 0.00 00:14:53.973 [2024-11-19T14:15:52.536Z] =================================================================================================================== 00:14:53.973 [2024-11-19T14:15:52.536Z] Total : 15382.50 60.09 0.00 0.00 0.00 0.00 0.00 00:14:53.973 00:14:54.231 true 00:14:54.231 15:15:52 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:14:54.231 15:15:52 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:54.490 15:15:52 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:54.490 15:15:52 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:54.490 15:15:52 -- target/nvmf_lvs_grow.sh@65 -- # wait 2748766 00:14:55.056 [2024-11-19T14:15:53.619Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.056 Nvme0n1 : 3.00 15378.67 60.07 0.00 0.00 0.00 0.00 0.00 00:14:55.056 [2024-11-19T14:15:53.619Z] =================================================================================================================== 00:14:55.056 [2024-11-19T14:15:53.619Z] Total : 15378.67 60.07 0.00 0.00 0.00 0.00 0.00 00:14:55.056 00:14:55.990 [2024-11-19T14:15:54.553Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.990 Nvme0n1 : 4.00 15158.50 59.21 0.00 0.00 0.00 0.00 0.00 00:14:55.990 [2024-11-19T14:15:54.553Z] =================================================================================================================== 00:14:55.990 [2024-11-19T14:15:54.553Z] Total : 15158.50 59.21 0.00 0.00 0.00 0.00 0.00 00:14:55.990 00:14:56.925 [2024-11-19T14:15:55.488Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.925 Nvme0n1 : 5.00 15029.20 58.71 0.00 0.00 0.00 0.00 0.00 00:14:56.925 [2024-11-19T14:15:55.488Z] =================================================================================================================== 00:14:56.925 [2024-11-19T14:15:55.488Z] Total : 15029.20 58.71 0.00 0.00 0.00 0.00 0.00 00:14:56.925 00:14:58.301 [2024-11-19T14:15:56.864Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.301 Nvme0n1 : 6.00 14941.67 58.37 0.00 0.00 0.00 0.00 0.00 00:14:58.301 [2024-11-19T14:15:56.864Z] =================================================================================================================== 00:14:58.301 [2024-11-19T14:15:56.864Z] Total : 14941.67 58.37 0.00 0.00 0.00 0.00 0.00 00:14:58.301 00:14:59.235 [2024-11-19T14:15:57.798Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.235 Nvme0n1 : 7.00 14879.14 58.12 0.00 0.00 0.00 0.00 0.00 00:14:59.235 [2024-11-19T14:15:57.798Z] =================================================================================================================== 00:14:59.235 [2024-11-19T14:15:57.798Z] Total : 14879.14 58.12 0.00 0.00 0.00 0.00 0.00 00:14:59.235 00:15:00.168 [2024-11-19T14:15:58.731Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.168 Nvme0n1 : 8.00 14845.25 57.99 0.00 0.00 0.00 0.00 0.00 00:15:00.168 [2024-11-19T14:15:58.731Z] =================================================================================================================== 00:15:00.168 [2024-11-19T14:15:58.731Z] Total : 14845.25 57.99 0.00 0.00 0.00 0.00 0.00 00:15:00.168 00:15:01.103 [2024-11-19T14:15:59.666Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.103 Nvme0n1 : 9.00 14813.56 57.87 0.00 0.00 0.00 0.00 0.00 00:15:01.103 [2024-11-19T14:15:59.666Z] =================================================================================================================== 00:15:01.103 [2024-11-19T14:15:59.666Z] Total : 14813.56 57.87 0.00 0.00 0.00 0.00 0.00 00:15:01.103 00:15:02.038 [2024-11-19T14:16:00.601Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.038 Nvme0n1 : 10.00 14786.60 57.76 0.00 0.00 0.00 0.00 0.00 00:15:02.038 [2024-11-19T14:16:00.601Z] =================================================================================================================== 00:15:02.038 [2024-11-19T14:16:00.601Z] Total : 14786.60 57.76 0.00 0.00 0.00 0.00 0.00 00:15:02.038 00:15:02.038 00:15:02.038 Latency(us) 00:15:02.038 [2024-11-19T14:16:00.601Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.038 [2024-11-19T14:16:00.601Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.038 Nvme0n1 : 10.01 14786.46 57.76 0.00 0.00 8648.37 2427.26 18350.08 00:15:02.038 [2024-11-19T14:16:00.601Z] =================================================================================================================== 00:15:02.038 [2024-11-19T14:16:00.601Z] Total : 14786.46 57.76 0.00 0.00 8648.37 2427.26 18350.08 00:15:02.038 0 00:15:02.038 15:16:00 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2748612 00:15:02.038 15:16:00 -- common/autotest_common.sh@936 -- # '[' -z 2748612 ']' 00:15:02.038 15:16:00 -- common/autotest_common.sh@940 -- # kill -0 2748612 00:15:02.038 15:16:00 -- common/autotest_common.sh@941 -- # uname 00:15:02.038 15:16:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:02.038 15:16:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2748612 00:15:02.038 15:16:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:02.038 15:16:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:02.038 15:16:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2748612' 00:15:02.038 killing process with pid 2748612 00:15:02.038 15:16:00 -- common/autotest_common.sh@955 -- # kill 2748612 00:15:02.038 Received shutdown signal, test time was about 10.000000 seconds 00:15:02.038 00:15:02.038 Latency(us) 00:15:02.038 [2024-11-19T14:16:00.601Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.038 [2024-11-19T14:16:00.601Z] =================================================================================================================== 00:15:02.038 [2024-11-19T14:16:00.601Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:02.038 15:16:00 -- common/autotest_common.sh@960 -- # wait 2748612 00:15:02.312 15:16:00 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:02.571 15:16:01 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:02.571 15:16:01 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:02.828 15:16:01 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:02.828 15:16:01 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:02.828 15:16:01 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:03.086 [2024-11-19 15:16:01.571498] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:03.086 15:16:01 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:03.086 15:16:01 -- common/autotest_common.sh@650 -- # local es=0 00:15:03.086 15:16:01 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:03.087 15:16:01 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.087 15:16:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.087 15:16:01 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.087 15:16:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.087 15:16:01 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.087 15:16:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.087 15:16:01 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.087 15:16:01 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:03.087 15:16:01 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:03.345 request: 00:15:03.345 { 00:15:03.345 "uuid": "58e46f42-ba81-4d1c-acb9-391f77951453", 00:15:03.345 "method": "bdev_lvol_get_lvstores", 00:15:03.345 "req_id": 1 00:15:03.345 } 00:15:03.345 Got JSON-RPC error response 00:15:03.345 response: 00:15:03.345 { 00:15:03.345 "code": -19, 00:15:03.345 "message": "No such device" 00:15:03.345 } 00:15:03.345 15:16:01 -- common/autotest_common.sh@653 -- # es=1 00:15:03.345 15:16:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:03.345 15:16:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:03.345 15:16:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:03.345 15:16:01 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:03.604 aio_bdev 00:15:03.604 15:16:02 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 86aa9305-cc97-4408-8166-acb5aa9b1d81 00:15:03.604 15:16:02 -- common/autotest_common.sh@897 -- # local bdev_name=86aa9305-cc97-4408-8166-acb5aa9b1d81 00:15:03.604 15:16:02 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:03.604 15:16:02 -- common/autotest_common.sh@899 -- # local i 00:15:03.604 15:16:02 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:03.604 15:16:02 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:03.604 15:16:02 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:03.863 15:16:02 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 86aa9305-cc97-4408-8166-acb5aa9b1d81 -t 2000 00:15:04.121 [ 00:15:04.121 { 00:15:04.121 "name": "86aa9305-cc97-4408-8166-acb5aa9b1d81", 00:15:04.121 "aliases": [ 00:15:04.121 "lvs/lvol" 00:15:04.121 ], 00:15:04.121 "product_name": "Logical Volume", 00:15:04.121 "block_size": 4096, 00:15:04.121 "num_blocks": 38912, 00:15:04.121 "uuid": "86aa9305-cc97-4408-8166-acb5aa9b1d81", 00:15:04.121 "assigned_rate_limits": { 00:15:04.121 "rw_ios_per_sec": 0, 00:15:04.121 "rw_mbytes_per_sec": 0, 00:15:04.121 "r_mbytes_per_sec": 0, 00:15:04.122 "w_mbytes_per_sec": 0 00:15:04.122 }, 00:15:04.122 "claimed": false, 00:15:04.122 "zoned": false, 00:15:04.122 "supported_io_types": { 00:15:04.122 "read": true, 00:15:04.122 "write": true, 00:15:04.122 "unmap": true, 00:15:04.122 "write_zeroes": true, 00:15:04.122 "flush": false, 00:15:04.122 "reset": true, 00:15:04.122 "compare": false, 00:15:04.122 "compare_and_write": false, 00:15:04.122 "abort": false, 00:15:04.122 "nvme_admin": false, 00:15:04.122 "nvme_io": false 00:15:04.122 }, 00:15:04.122 "driver_specific": { 00:15:04.122 "lvol": { 00:15:04.122 "lvol_store_uuid": "58e46f42-ba81-4d1c-acb9-391f77951453", 00:15:04.122 "base_bdev": "aio_bdev", 00:15:04.122 "thin_provision": false, 00:15:04.122 "snapshot": false, 00:15:04.122 "clone": false, 00:15:04.122 "esnap_clone": false 00:15:04.122 } 00:15:04.122 } 00:15:04.122 } 00:15:04.122 ] 00:15:04.122 15:16:02 -- common/autotest_common.sh@905 -- # return 0 00:15:04.122 15:16:02 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:04.122 15:16:02 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:04.379 15:16:02 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:04.379 15:16:02 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:04.379 15:16:02 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:04.638 15:16:03 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:04.638 15:16:03 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 86aa9305-cc97-4408-8166-acb5aa9b1d81 00:15:04.896 15:16:03 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 58e46f42-ba81-4d1c-acb9-391f77951453 00:15:05.155 15:16:03 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.413 00:15:05.413 real 0m17.924s 00:15:05.413 user 0m16.888s 00:15:05.413 sys 0m2.249s 00:15:05.413 15:16:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:05.413 15:16:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.413 ************************************ 00:15:05.413 END TEST lvs_grow_clean 00:15:05.413 ************************************ 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:05.413 15:16:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:05.413 15:16:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:05.413 15:16:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.413 ************************************ 00:15:05.413 START TEST lvs_grow_dirty 00:15:05.413 ************************************ 00:15:05.413 15:16:03 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.413 15:16:03 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:05.671 15:16:04 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:05.671 15:16:04 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:05.944 15:16:04 -- target/nvmf_lvs_grow.sh@28 -- # lvs=c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:05.944 15:16:04 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:05.944 15:16:04 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:06.511 15:16:04 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:06.511 15:16:04 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:06.511 15:16:04 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 lvol 150 00:15:06.511 15:16:05 -- target/nvmf_lvs_grow.sh@33 -- # lvol=7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:06.511 15:16:05 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:06.511 15:16:05 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:06.769 [2024-11-19 15:16:05.263126] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:06.769 [2024-11-19 15:16:05.263220] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:06.769 true 00:15:06.769 15:16:05 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:06.769 15:16:05 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:07.027 15:16:05 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:07.027 15:16:05 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:07.285 15:16:05 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:07.543 15:16:06 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:07.801 15:16:06 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:08.059 15:16:06 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2750849 00:15:08.059 15:16:06 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:08.059 15:16:06 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:08.059 15:16:06 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2750849 /var/tmp/bdevperf.sock 00:15:08.059 15:16:06 -- common/autotest_common.sh@829 -- # '[' -z 2750849 ']' 00:15:08.059 15:16:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:08.059 15:16:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:08.059 15:16:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:08.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:08.059 15:16:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:08.059 15:16:06 -- common/autotest_common.sh@10 -- # set +x 00:15:08.317 [2024-11-19 15:16:06.625584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:08.317 [2024-11-19 15:16:06.625667] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2750849 ] 00:15:08.317 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.317 [2024-11-19 15:16:06.687570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:08.317 [2024-11-19 15:16:06.802303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:09.251 15:16:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:09.251 15:16:07 -- common/autotest_common.sh@862 -- # return 0 00:15:09.251 15:16:07 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:09.817 Nvme0n1 00:15:09.817 15:16:08 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:09.817 [ 00:15:09.817 { 00:15:09.817 "name": "Nvme0n1", 00:15:09.817 "aliases": [ 00:15:09.817 "7fee1ae7-fa61-43cb-a123-a89090764bb0" 00:15:09.817 ], 00:15:09.817 "product_name": "NVMe disk", 00:15:09.817 "block_size": 4096, 00:15:09.817 "num_blocks": 38912, 00:15:09.817 "uuid": "7fee1ae7-fa61-43cb-a123-a89090764bb0", 00:15:09.817 "assigned_rate_limits": { 00:15:09.817 "rw_ios_per_sec": 0, 00:15:09.817 "rw_mbytes_per_sec": 0, 00:15:09.817 "r_mbytes_per_sec": 0, 00:15:09.817 "w_mbytes_per_sec": 0 00:15:09.817 }, 00:15:09.817 "claimed": false, 00:15:09.817 "zoned": false, 00:15:09.817 "supported_io_types": { 00:15:09.817 "read": true, 00:15:09.817 "write": true, 00:15:09.817 "unmap": true, 00:15:09.817 "write_zeroes": true, 00:15:09.817 "flush": true, 00:15:09.817 "reset": true, 00:15:09.817 "compare": true, 00:15:09.817 "compare_and_write": true, 00:15:09.817 "abort": true, 00:15:09.817 "nvme_admin": true, 00:15:09.817 "nvme_io": true 00:15:09.817 }, 00:15:09.817 "driver_specific": { 00:15:09.817 "nvme": [ 00:15:09.817 { 00:15:09.817 "trid": { 00:15:09.817 "trtype": "TCP", 00:15:09.817 "adrfam": "IPv4", 00:15:09.817 "traddr": "10.0.0.2", 00:15:09.817 "trsvcid": "4420", 00:15:09.817 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:09.817 }, 00:15:09.817 "ctrlr_data": { 00:15:09.817 "cntlid": 1, 00:15:09.817 "vendor_id": "0x8086", 00:15:09.817 "model_number": "SPDK bdev Controller", 00:15:09.817 "serial_number": "SPDK0", 00:15:09.817 "firmware_revision": "24.01.1", 00:15:09.817 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:09.817 "oacs": { 00:15:09.817 "security": 0, 00:15:09.817 "format": 0, 00:15:09.817 "firmware": 0, 00:15:09.817 "ns_manage": 0 00:15:09.817 }, 00:15:09.817 "multi_ctrlr": true, 00:15:09.817 "ana_reporting": false 00:15:09.817 }, 00:15:09.817 "vs": { 00:15:09.817 "nvme_version": "1.3" 00:15:09.817 }, 00:15:09.817 "ns_data": { 00:15:09.817 "id": 1, 00:15:09.817 "can_share": true 00:15:09.817 } 00:15:09.817 } 00:15:09.817 ], 00:15:09.817 "mp_policy": "active_passive" 00:15:09.817 } 00:15:09.817 } 00:15:09.817 ] 00:15:10.075 15:16:08 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2751007 00:15:10.075 15:16:08 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:10.075 15:16:08 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:10.075 Running I/O for 10 seconds... 00:15:11.011 Latency(us) 00:15:11.011 [2024-11-19T14:16:09.574Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:11.011 [2024-11-19T14:16:09.574Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.011 Nvme0n1 : 1.00 14683.00 57.36 0.00 0.00 0.00 0.00 0.00 00:15:11.011 [2024-11-19T14:16:09.574Z] =================================================================================================================== 00:15:11.011 [2024-11-19T14:16:09.574Z] Total : 14683.00 57.36 0.00 0.00 0.00 0.00 0.00 00:15:11.011 00:15:11.946 15:16:10 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:11.946 [2024-11-19T14:16:10.509Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.946 Nvme0n1 : 2.00 14878.50 58.12 0.00 0.00 0.00 0.00 0.00 00:15:11.946 [2024-11-19T14:16:10.509Z] =================================================================================================================== 00:15:11.946 [2024-11-19T14:16:10.509Z] Total : 14878.50 58.12 0.00 0.00 0.00 0.00 0.00 00:15:11.946 00:15:12.204 true 00:15:12.204 15:16:10 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:12.204 15:16:10 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:12.461 15:16:10 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:12.461 15:16:10 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:12.461 15:16:10 -- target/nvmf_lvs_grow.sh@65 -- # wait 2751007 00:15:13.027 [2024-11-19T14:16:11.590Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.027 Nvme0n1 : 3.00 14983.33 58.53 0.00 0.00 0.00 0.00 0.00 00:15:13.027 [2024-11-19T14:16:11.590Z] =================================================================================================================== 00:15:13.027 [2024-11-19T14:16:11.590Z] Total : 14983.33 58.53 0.00 0.00 0.00 0.00 0.00 00:15:13.027 00:15:13.963 [2024-11-19T14:16:12.526Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.963 Nvme0n1 : 4.00 15087.75 58.94 0.00 0.00 0.00 0.00 0.00 00:15:13.963 [2024-11-19T14:16:12.526Z] =================================================================================================================== 00:15:13.963 [2024-11-19T14:16:12.526Z] Total : 15087.75 58.94 0.00 0.00 0.00 0.00 0.00 00:15:13.963 00:15:14.945 [2024-11-19T14:16:13.508Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.945 Nvme0n1 : 5.00 15135.20 59.12 0.00 0.00 0.00 0.00 0.00 00:15:14.945 [2024-11-19T14:16:13.508Z] =================================================================================================================== 00:15:14.945 [2024-11-19T14:16:13.508Z] Total : 15135.20 59.12 0.00 0.00 0.00 0.00 0.00 00:15:14.945 00:15:16.342 [2024-11-19T14:16:14.905Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.342 Nvme0n1 : 6.00 15206.33 59.40 0.00 0.00 0.00 0.00 0.00 00:15:16.342 [2024-11-19T14:16:14.905Z] =================================================================================================================== 00:15:16.342 [2024-11-19T14:16:14.905Z] Total : 15206.33 59.40 0.00 0.00 0.00 0.00 0.00 00:15:16.342 00:15:17.277 [2024-11-19T14:16:15.840Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.277 Nvme0n1 : 7.00 15238.00 59.52 0.00 0.00 0.00 0.00 0.00 00:15:17.277 [2024-11-19T14:16:15.840Z] =================================================================================================================== 00:15:17.277 [2024-11-19T14:16:15.840Z] Total : 15238.00 59.52 0.00 0.00 0.00 0.00 0.00 00:15:17.277 00:15:18.212 [2024-11-19T14:16:16.775Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.212 Nvme0n1 : 8.00 15278.38 59.68 0.00 0.00 0.00 0.00 0.00 00:15:18.212 [2024-11-19T14:16:16.775Z] =================================================================================================================== 00:15:18.212 [2024-11-19T14:16:16.775Z] Total : 15278.38 59.68 0.00 0.00 0.00 0.00 0.00 00:15:18.212 00:15:19.146 [2024-11-19T14:16:17.709Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.146 Nvme0n1 : 9.00 15313.67 59.82 0.00 0.00 0.00 0.00 0.00 00:15:19.146 [2024-11-19T14:16:17.709Z] =================================================================================================================== 00:15:19.146 [2024-11-19T14:16:17.709Z] Total : 15313.67 59.82 0.00 0.00 0.00 0.00 0.00 00:15:19.146 00:15:20.081 [2024-11-19T14:16:18.644Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.081 Nvme0n1 : 10.00 15345.70 59.94 0.00 0.00 0.00 0.00 0.00 00:15:20.081 [2024-11-19T14:16:18.644Z] =================================================================================================================== 00:15:20.081 [2024-11-19T14:16:18.644Z] Total : 15345.70 59.94 0.00 0.00 0.00 0.00 0.00 00:15:20.081 00:15:20.081 00:15:20.081 Latency(us) 00:15:20.081 [2024-11-19T14:16:18.644Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.081 [2024-11-19T14:16:18.644Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.081 Nvme0n1 : 10.01 15347.76 59.95 0.00 0.00 8334.10 4830.25 16893.72 00:15:20.081 [2024-11-19T14:16:18.644Z] =================================================================================================================== 00:15:20.081 [2024-11-19T14:16:18.644Z] Total : 15347.76 59.95 0.00 0.00 8334.10 4830.25 16893.72 00:15:20.081 0 00:15:20.081 15:16:18 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2750849 00:15:20.081 15:16:18 -- common/autotest_common.sh@936 -- # '[' -z 2750849 ']' 00:15:20.081 15:16:18 -- common/autotest_common.sh@940 -- # kill -0 2750849 00:15:20.081 15:16:18 -- common/autotest_common.sh@941 -- # uname 00:15:20.081 15:16:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:20.081 15:16:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2750849 00:15:20.081 15:16:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:20.081 15:16:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:20.081 15:16:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2750849' 00:15:20.081 killing process with pid 2750849 00:15:20.081 15:16:18 -- common/autotest_common.sh@955 -- # kill 2750849 00:15:20.081 Received shutdown signal, test time was about 10.000000 seconds 00:15:20.081 00:15:20.081 Latency(us) 00:15:20.081 [2024-11-19T14:16:18.644Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.081 [2024-11-19T14:16:18.644Z] =================================================================================================================== 00:15:20.081 [2024-11-19T14:16:18.644Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:20.081 15:16:18 -- common/autotest_common.sh@960 -- # wait 2750849 00:15:20.339 15:16:18 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:20.597 15:16:19 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:20.597 15:16:19 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2748032 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@74 -- # wait 2748032 00:15:20.854 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2748032 Killed "${NVMF_APP[@]}" "$@" 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:20.854 15:16:19 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:20.854 15:16:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:20.854 15:16:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:20.854 15:16:19 -- common/autotest_common.sh@10 -- # set +x 00:15:20.854 15:16:19 -- nvmf/common.sh@469 -- # nvmfpid=2752368 00:15:20.854 15:16:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:20.854 15:16:19 -- nvmf/common.sh@470 -- # waitforlisten 2752368 00:15:20.854 15:16:19 -- common/autotest_common.sh@829 -- # '[' -z 2752368 ']' 00:15:20.854 15:16:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.854 15:16:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:20.854 15:16:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.854 15:16:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:20.854 15:16:19 -- common/autotest_common.sh@10 -- # set +x 00:15:20.854 [2024-11-19 15:16:19.406629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.854 [2024-11-19 15:16:19.406748] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:21.112 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.112 [2024-11-19 15:16:19.474753] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.112 [2024-11-19 15:16:19.585106] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:21.112 [2024-11-19 15:16:19.585259] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.112 [2024-11-19 15:16:19.585276] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.112 [2024-11-19 15:16:19.585288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.112 [2024-11-19 15:16:19.585318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:22.045 15:16:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:22.045 15:16:20 -- common/autotest_common.sh@862 -- # return 0 00:15:22.045 15:16:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:22.045 15:16:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:22.045 15:16:20 -- common/autotest_common.sh@10 -- # set +x 00:15:22.045 15:16:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:22.045 15:16:20 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:22.304 [2024-11-19 15:16:20.652432] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:22.304 [2024-11-19 15:16:20.652584] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:22.304 [2024-11-19 15:16:20.652650] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:22.304 15:16:20 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:22.304 15:16:20 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:22.304 15:16:20 -- common/autotest_common.sh@897 -- # local bdev_name=7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:22.304 15:16:20 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:22.304 15:16:20 -- common/autotest_common.sh@899 -- # local i 00:15:22.304 15:16:20 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:22.304 15:16:20 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:22.304 15:16:20 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:22.562 15:16:20 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7fee1ae7-fa61-43cb-a123-a89090764bb0 -t 2000 00:15:22.821 [ 00:15:22.821 { 00:15:22.821 "name": "7fee1ae7-fa61-43cb-a123-a89090764bb0", 00:15:22.821 "aliases": [ 00:15:22.821 "lvs/lvol" 00:15:22.821 ], 00:15:22.821 "product_name": "Logical Volume", 00:15:22.821 "block_size": 4096, 00:15:22.821 "num_blocks": 38912, 00:15:22.821 "uuid": "7fee1ae7-fa61-43cb-a123-a89090764bb0", 00:15:22.821 "assigned_rate_limits": { 00:15:22.821 "rw_ios_per_sec": 0, 00:15:22.821 "rw_mbytes_per_sec": 0, 00:15:22.821 "r_mbytes_per_sec": 0, 00:15:22.821 "w_mbytes_per_sec": 0 00:15:22.821 }, 00:15:22.821 "claimed": false, 00:15:22.821 "zoned": false, 00:15:22.821 "supported_io_types": { 00:15:22.821 "read": true, 00:15:22.821 "write": true, 00:15:22.821 "unmap": true, 00:15:22.821 "write_zeroes": true, 00:15:22.821 "flush": false, 00:15:22.821 "reset": true, 00:15:22.821 "compare": false, 00:15:22.821 "compare_and_write": false, 00:15:22.821 "abort": false, 00:15:22.821 "nvme_admin": false, 00:15:22.821 "nvme_io": false 00:15:22.821 }, 00:15:22.821 "driver_specific": { 00:15:22.821 "lvol": { 00:15:22.821 "lvol_store_uuid": "c0d11b9e-71ac-4116-9387-b60b7c8ca535", 00:15:22.821 "base_bdev": "aio_bdev", 00:15:22.821 "thin_provision": false, 00:15:22.821 "snapshot": false, 00:15:22.821 "clone": false, 00:15:22.821 "esnap_clone": false 00:15:22.821 } 00:15:22.821 } 00:15:22.821 } 00:15:22.821 ] 00:15:22.821 15:16:21 -- common/autotest_common.sh@905 -- # return 0 00:15:22.821 15:16:21 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:22.821 15:16:21 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:23.079 15:16:21 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:23.079 15:16:21 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:23.079 15:16:21 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:23.337 15:16:21 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:23.337 15:16:21 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:23.596 [2024-11-19 15:16:22.057913] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:23.596 15:16:22 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:23.596 15:16:22 -- common/autotest_common.sh@650 -- # local es=0 00:15:23.596 15:16:22 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:23.596 15:16:22 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.596 15:16:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.596 15:16:22 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.596 15:16:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.596 15:16:22 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.596 15:16:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.596 15:16:22 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.596 15:16:22 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:23.596 15:16:22 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:23.854 request: 00:15:23.854 { 00:15:23.854 "uuid": "c0d11b9e-71ac-4116-9387-b60b7c8ca535", 00:15:23.854 "method": "bdev_lvol_get_lvstores", 00:15:23.854 "req_id": 1 00:15:23.854 } 00:15:23.854 Got JSON-RPC error response 00:15:23.854 response: 00:15:23.854 { 00:15:23.854 "code": -19, 00:15:23.854 "message": "No such device" 00:15:23.854 } 00:15:23.854 15:16:22 -- common/autotest_common.sh@653 -- # es=1 00:15:23.854 15:16:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:23.854 15:16:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:23.854 15:16:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:23.854 15:16:22 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.113 aio_bdev 00:15:24.113 15:16:22 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:24.113 15:16:22 -- common/autotest_common.sh@897 -- # local bdev_name=7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:24.113 15:16:22 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:24.113 15:16:22 -- common/autotest_common.sh@899 -- # local i 00:15:24.113 15:16:22 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:24.113 15:16:22 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:24.113 15:16:22 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:24.680 15:16:22 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7fee1ae7-fa61-43cb-a123-a89090764bb0 -t 2000 00:15:24.680 [ 00:15:24.680 { 00:15:24.680 "name": "7fee1ae7-fa61-43cb-a123-a89090764bb0", 00:15:24.680 "aliases": [ 00:15:24.680 "lvs/lvol" 00:15:24.680 ], 00:15:24.680 "product_name": "Logical Volume", 00:15:24.680 "block_size": 4096, 00:15:24.680 "num_blocks": 38912, 00:15:24.680 "uuid": "7fee1ae7-fa61-43cb-a123-a89090764bb0", 00:15:24.680 "assigned_rate_limits": { 00:15:24.680 "rw_ios_per_sec": 0, 00:15:24.681 "rw_mbytes_per_sec": 0, 00:15:24.681 "r_mbytes_per_sec": 0, 00:15:24.681 "w_mbytes_per_sec": 0 00:15:24.681 }, 00:15:24.681 "claimed": false, 00:15:24.681 "zoned": false, 00:15:24.681 "supported_io_types": { 00:15:24.681 "read": true, 00:15:24.681 "write": true, 00:15:24.681 "unmap": true, 00:15:24.681 "write_zeroes": true, 00:15:24.681 "flush": false, 00:15:24.681 "reset": true, 00:15:24.681 "compare": false, 00:15:24.681 "compare_and_write": false, 00:15:24.681 "abort": false, 00:15:24.681 "nvme_admin": false, 00:15:24.681 "nvme_io": false 00:15:24.681 }, 00:15:24.681 "driver_specific": { 00:15:24.681 "lvol": { 00:15:24.681 "lvol_store_uuid": "c0d11b9e-71ac-4116-9387-b60b7c8ca535", 00:15:24.681 "base_bdev": "aio_bdev", 00:15:24.681 "thin_provision": false, 00:15:24.681 "snapshot": false, 00:15:24.681 "clone": false, 00:15:24.681 "esnap_clone": false 00:15:24.681 } 00:15:24.681 } 00:15:24.681 } 00:15:24.681 ] 00:15:24.681 15:16:23 -- common/autotest_common.sh@905 -- # return 0 00:15:24.681 15:16:23 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:24.681 15:16:23 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:24.939 15:16:23 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:24.939 15:16:23 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:24.939 15:16:23 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:25.198 15:16:23 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:25.198 15:16:23 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7fee1ae7-fa61-43cb-a123-a89090764bb0 00:15:25.764 15:16:24 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c0d11b9e-71ac-4116-9387-b60b7c8ca535 00:15:26.022 15:16:24 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:26.281 15:16:24 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:26.281 00:15:26.281 real 0m20.684s 00:15:26.281 user 0m51.509s 00:15:26.281 sys 0m4.695s 00:15:26.281 15:16:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:26.281 15:16:24 -- common/autotest_common.sh@10 -- # set +x 00:15:26.281 ************************************ 00:15:26.281 END TEST lvs_grow_dirty 00:15:26.281 ************************************ 00:15:26.281 15:16:24 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:26.281 15:16:24 -- common/autotest_common.sh@806 -- # type=--id 00:15:26.281 15:16:24 -- common/autotest_common.sh@807 -- # id=0 00:15:26.281 15:16:24 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:26.281 15:16:24 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:26.281 15:16:24 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:26.281 15:16:24 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:26.281 15:16:24 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:26.281 15:16:24 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:26.281 nvmf_trace.0 00:15:26.281 15:16:24 -- common/autotest_common.sh@821 -- # return 0 00:15:26.281 15:16:24 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:26.281 15:16:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.281 15:16:24 -- nvmf/common.sh@116 -- # sync 00:15:26.281 15:16:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.281 15:16:24 -- nvmf/common.sh@119 -- # set +e 00:15:26.281 15:16:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.281 15:16:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.281 rmmod nvme_tcp 00:15:26.281 rmmod nvme_fabrics 00:15:26.281 rmmod nvme_keyring 00:15:26.281 15:16:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.281 15:16:24 -- nvmf/common.sh@123 -- # set -e 00:15:26.281 15:16:24 -- nvmf/common.sh@124 -- # return 0 00:15:26.281 15:16:24 -- nvmf/common.sh@477 -- # '[' -n 2752368 ']' 00:15:26.281 15:16:24 -- nvmf/common.sh@478 -- # killprocess 2752368 00:15:26.281 15:16:24 -- common/autotest_common.sh@936 -- # '[' -z 2752368 ']' 00:15:26.281 15:16:24 -- common/autotest_common.sh@940 -- # kill -0 2752368 00:15:26.281 15:16:24 -- common/autotest_common.sh@941 -- # uname 00:15:26.281 15:16:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:26.281 15:16:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2752368 00:15:26.281 15:16:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:26.281 15:16:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:26.281 15:16:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2752368' 00:15:26.281 killing process with pid 2752368 00:15:26.281 15:16:24 -- common/autotest_common.sh@955 -- # kill 2752368 00:15:26.281 15:16:24 -- common/autotest_common.sh@960 -- # wait 2752368 00:15:26.541 15:16:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.541 15:16:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.541 15:16:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.541 15:16:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.541 15:16:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.541 15:16:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.541 15:16:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.541 15:16:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.078 15:16:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:29.078 00:15:29.078 real 0m44.849s 00:15:29.078 user 1m15.493s 00:15:29.078 sys 0m8.899s 00:15:29.078 15:16:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:29.078 15:16:27 -- common/autotest_common.sh@10 -- # set +x 00:15:29.078 ************************************ 00:15:29.078 END TEST nvmf_lvs_grow 00:15:29.078 ************************************ 00:15:29.078 15:16:27 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:29.078 15:16:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:29.078 15:16:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:29.078 15:16:27 -- common/autotest_common.sh@10 -- # set +x 00:15:29.078 ************************************ 00:15:29.078 START TEST nvmf_bdev_io_wait 00:15:29.078 ************************************ 00:15:29.078 15:16:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:29.078 * Looking for test storage... 00:15:29.078 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:29.078 15:16:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:29.078 15:16:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:29.078 15:16:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:29.078 15:16:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:29.078 15:16:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:29.078 15:16:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:29.078 15:16:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:29.078 15:16:27 -- scripts/common.sh@335 -- # IFS=.-: 00:15:29.078 15:16:27 -- scripts/common.sh@335 -- # read -ra ver1 00:15:29.078 15:16:27 -- scripts/common.sh@336 -- # IFS=.-: 00:15:29.078 15:16:27 -- scripts/common.sh@336 -- # read -ra ver2 00:15:29.078 15:16:27 -- scripts/common.sh@337 -- # local 'op=<' 00:15:29.078 15:16:27 -- scripts/common.sh@339 -- # ver1_l=2 00:15:29.078 15:16:27 -- scripts/common.sh@340 -- # ver2_l=1 00:15:29.078 15:16:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:29.078 15:16:27 -- scripts/common.sh@343 -- # case "$op" in 00:15:29.078 15:16:27 -- scripts/common.sh@344 -- # : 1 00:15:29.078 15:16:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:29.078 15:16:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:29.078 15:16:27 -- scripts/common.sh@364 -- # decimal 1 00:15:29.078 15:16:27 -- scripts/common.sh@352 -- # local d=1 00:15:29.078 15:16:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:29.079 15:16:27 -- scripts/common.sh@354 -- # echo 1 00:15:29.079 15:16:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:29.079 15:16:27 -- scripts/common.sh@365 -- # decimal 2 00:15:29.079 15:16:27 -- scripts/common.sh@352 -- # local d=2 00:15:29.079 15:16:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:29.079 15:16:27 -- scripts/common.sh@354 -- # echo 2 00:15:29.079 15:16:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:29.079 15:16:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:29.079 15:16:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:29.079 15:16:27 -- scripts/common.sh@367 -- # return 0 00:15:29.079 15:16:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:29.079 15:16:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:29.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.079 --rc genhtml_branch_coverage=1 00:15:29.079 --rc genhtml_function_coverage=1 00:15:29.079 --rc genhtml_legend=1 00:15:29.079 --rc geninfo_all_blocks=1 00:15:29.079 --rc geninfo_unexecuted_blocks=1 00:15:29.079 00:15:29.079 ' 00:15:29.079 15:16:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:29.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.079 --rc genhtml_branch_coverage=1 00:15:29.079 --rc genhtml_function_coverage=1 00:15:29.079 --rc genhtml_legend=1 00:15:29.079 --rc geninfo_all_blocks=1 00:15:29.079 --rc geninfo_unexecuted_blocks=1 00:15:29.079 00:15:29.079 ' 00:15:29.079 15:16:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:29.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.079 --rc genhtml_branch_coverage=1 00:15:29.079 --rc genhtml_function_coverage=1 00:15:29.079 --rc genhtml_legend=1 00:15:29.079 --rc geninfo_all_blocks=1 00:15:29.079 --rc geninfo_unexecuted_blocks=1 00:15:29.079 00:15:29.079 ' 00:15:29.079 15:16:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:29.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.079 --rc genhtml_branch_coverage=1 00:15:29.079 --rc genhtml_function_coverage=1 00:15:29.079 --rc genhtml_legend=1 00:15:29.079 --rc geninfo_all_blocks=1 00:15:29.079 --rc geninfo_unexecuted_blocks=1 00:15:29.079 00:15:29.079 ' 00:15:29.079 15:16:27 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:29.079 15:16:27 -- nvmf/common.sh@7 -- # uname -s 00:15:29.079 15:16:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:29.079 15:16:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:29.079 15:16:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:29.079 15:16:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:29.079 15:16:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:29.079 15:16:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:29.079 15:16:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:29.079 15:16:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:29.079 15:16:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:29.079 15:16:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:29.079 15:16:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.079 15:16:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.079 15:16:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:29.079 15:16:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:29.079 15:16:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:29.079 15:16:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:29.079 15:16:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:29.079 15:16:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:29.079 15:16:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:29.079 15:16:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.079 15:16:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.079 15:16:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.079 15:16:27 -- paths/export.sh@5 -- # export PATH 00:15:29.079 15:16:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.079 15:16:27 -- nvmf/common.sh@46 -- # : 0 00:15:29.079 15:16:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:29.079 15:16:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:29.079 15:16:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:29.079 15:16:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:29.079 15:16:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:29.079 15:16:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:29.079 15:16:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:29.079 15:16:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:29.079 15:16:27 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:29.079 15:16:27 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:29.079 15:16:27 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:29.079 15:16:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:29.079 15:16:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:29.079 15:16:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:29.079 15:16:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:29.079 15:16:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:29.079 15:16:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:29.079 15:16:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:29.079 15:16:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.079 15:16:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:29.079 15:16:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:29.079 15:16:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:29.079 15:16:27 -- common/autotest_common.sh@10 -- # set +x 00:15:30.983 15:16:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:30.983 15:16:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:30.983 15:16:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:30.983 15:16:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:30.983 15:16:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:30.983 15:16:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:30.983 15:16:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:30.983 15:16:29 -- nvmf/common.sh@294 -- # net_devs=() 00:15:30.983 15:16:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:30.983 15:16:29 -- nvmf/common.sh@295 -- # e810=() 00:15:30.983 15:16:29 -- nvmf/common.sh@295 -- # local -ga e810 00:15:30.983 15:16:29 -- nvmf/common.sh@296 -- # x722=() 00:15:30.983 15:16:29 -- nvmf/common.sh@296 -- # local -ga x722 00:15:30.983 15:16:29 -- nvmf/common.sh@297 -- # mlx=() 00:15:30.983 15:16:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:30.983 15:16:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:30.983 15:16:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:30.983 15:16:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:30.983 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:30.983 15:16:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:30.983 15:16:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:30.983 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:30.983 15:16:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:30.983 15:16:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:30.983 15:16:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:30.983 15:16:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:30.983 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:30.983 15:16:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:30.983 15:16:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:30.983 15:16:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:30.983 15:16:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:30.983 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:30.983 15:16:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:30.983 15:16:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:30.983 15:16:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:30.983 15:16:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:30.983 15:16:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:30.983 15:16:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:30.983 15:16:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:30.983 15:16:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:30.983 15:16:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:30.983 15:16:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:30.983 15:16:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:30.983 15:16:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:30.983 15:16:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:30.983 15:16:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:30.983 15:16:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:30.983 15:16:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:30.983 15:16:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:30.983 15:16:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:30.983 15:16:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:30.983 15:16:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:30.983 15:16:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:30.983 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:30.983 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:15:30.983 00:15:30.983 --- 10.0.0.2 ping statistics --- 00:15:30.983 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:30.983 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:15:30.983 15:16:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:30.983 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:30.983 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:15:30.983 00:15:30.983 --- 10.0.0.1 ping statistics --- 00:15:30.983 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:30.983 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:15:30.983 15:16:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:30.983 15:16:29 -- nvmf/common.sh@410 -- # return 0 00:15:30.983 15:16:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:30.983 15:16:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:30.983 15:16:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:30.983 15:16:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:30.983 15:16:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:30.983 15:16:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:30.983 15:16:29 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:30.983 15:16:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:30.983 15:16:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:30.983 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:30.983 15:16:29 -- nvmf/common.sh@469 -- # nvmfpid=2755060 00:15:30.983 15:16:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:30.983 15:16:29 -- nvmf/common.sh@470 -- # waitforlisten 2755060 00:15:30.983 15:16:29 -- common/autotest_common.sh@829 -- # '[' -z 2755060 ']' 00:15:30.983 15:16:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:30.983 15:16:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:30.983 15:16:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:30.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:30.983 15:16:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:30.983 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.242 [2024-11-19 15:16:29.559850] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.242 [2024-11-19 15:16:29.559924] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:31.242 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.242 [2024-11-19 15:16:29.629867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:31.242 [2024-11-19 15:16:29.751347] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:31.242 [2024-11-19 15:16:29.751512] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:31.242 [2024-11-19 15:16:29.751532] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:31.242 [2024-11-19 15:16:29.751547] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:31.242 [2024-11-19 15:16:29.751641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:31.242 [2024-11-19 15:16:29.751716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:31.242 [2024-11-19 15:16:29.751753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:31.242 [2024-11-19 15:16:29.751756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:31.242 15:16:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:31.242 15:16:29 -- common/autotest_common.sh@862 -- # return 0 00:15:31.242 15:16:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:31.242 15:16:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:31.242 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 15:16:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 [2024-11-19 15:16:29.893207] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 Malloc0 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:31.501 15:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.501 15:16:29 -- common/autotest_common.sh@10 -- # set +x 00:15:31.501 [2024-11-19 15:16:29.955467] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:31.501 15:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2755095 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@30 -- # READ_PID=2755096 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2755098 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # config=() 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:31.501 15:16:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # config=() 00:15:31.501 15:16:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.501 { 00:15:31.501 "params": { 00:15:31.501 "name": "Nvme$subsystem", 00:15:31.501 "trtype": "$TEST_TRANSPORT", 00:15:31.501 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.501 "adrfam": "ipv4", 00:15:31.501 "trsvcid": "$NVMF_PORT", 00:15:31.501 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.501 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.501 "hdgst": ${hdgst:-false}, 00:15:31.501 "ddgst": ${ddgst:-false} 00:15:31.501 }, 00:15:31.501 "method": "bdev_nvme_attach_controller" 00:15:31.501 } 00:15:31.501 EOF 00:15:31.501 )") 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2755101 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:31.501 15:16:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@35 -- # sync 00:15:31.501 15:16:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.501 { 00:15:31.501 "params": { 00:15:31.501 "name": "Nvme$subsystem", 00:15:31.501 "trtype": "$TEST_TRANSPORT", 00:15:31.501 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.501 "adrfam": "ipv4", 00:15:31.501 "trsvcid": "$NVMF_PORT", 00:15:31.501 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.501 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.501 "hdgst": ${hdgst:-false}, 00:15:31.501 "ddgst": ${ddgst:-false} 00:15:31.501 }, 00:15:31.501 "method": "bdev_nvme_attach_controller" 00:15:31.501 } 00:15:31.501 EOF 00:15:31.501 )") 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # config=() 00:15:31.501 15:16:29 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:31.501 15:16:29 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:31.501 15:16:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.501 15:16:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.501 { 00:15:31.501 "params": { 00:15:31.501 "name": "Nvme$subsystem", 00:15:31.501 "trtype": "$TEST_TRANSPORT", 00:15:31.501 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.501 "adrfam": "ipv4", 00:15:31.501 "trsvcid": "$NVMF_PORT", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.502 "hdgst": ${hdgst:-false}, 00:15:31.502 "ddgst": ${ddgst:-false} 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 } 00:15:31.502 EOF 00:15:31.502 )") 00:15:31.502 15:16:29 -- nvmf/common.sh@520 -- # config=() 00:15:31.502 15:16:29 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.502 15:16:29 -- nvmf/common.sh@542 -- # cat 00:15:31.502 15:16:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.502 15:16:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.502 { 00:15:31.502 "params": { 00:15:31.502 "name": "Nvme$subsystem", 00:15:31.502 "trtype": "$TEST_TRANSPORT", 00:15:31.502 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.502 "adrfam": "ipv4", 00:15:31.502 "trsvcid": "$NVMF_PORT", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.502 "hdgst": ${hdgst:-false}, 00:15:31.502 "ddgst": ${ddgst:-false} 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 } 00:15:31.502 EOF 00:15:31.502 )") 00:15:31.502 15:16:29 -- nvmf/common.sh@542 -- # cat 00:15:31.502 15:16:29 -- nvmf/common.sh@542 -- # cat 00:15:31.502 15:16:29 -- target/bdev_io_wait.sh@37 -- # wait 2755095 00:15:31.502 15:16:29 -- nvmf/common.sh@542 -- # cat 00:15:31.502 15:16:29 -- nvmf/common.sh@544 -- # jq . 00:15:31.502 15:16:29 -- nvmf/common.sh@544 -- # jq . 00:15:31.502 15:16:29 -- nvmf/common.sh@544 -- # jq . 00:15:31.502 15:16:29 -- nvmf/common.sh@544 -- # jq . 00:15:31.502 15:16:29 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.502 15:16:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.502 "params": { 00:15:31.502 "name": "Nvme1", 00:15:31.502 "trtype": "tcp", 00:15:31.502 "traddr": "10.0.0.2", 00:15:31.502 "adrfam": "ipv4", 00:15:31.502 "trsvcid": "4420", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.502 "hdgst": false, 00:15:31.502 "ddgst": false 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 }' 00:15:31.502 15:16:29 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.502 15:16:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.502 "params": { 00:15:31.502 "name": "Nvme1", 00:15:31.502 "trtype": "tcp", 00:15:31.502 "traddr": "10.0.0.2", 00:15:31.502 "adrfam": "ipv4", 00:15:31.502 "trsvcid": "4420", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.502 "hdgst": false, 00:15:31.502 "ddgst": false 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 }' 00:15:31.502 15:16:29 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.502 15:16:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.502 "params": { 00:15:31.502 "name": "Nvme1", 00:15:31.502 "trtype": "tcp", 00:15:31.502 "traddr": "10.0.0.2", 00:15:31.502 "adrfam": "ipv4", 00:15:31.502 "trsvcid": "4420", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.502 "hdgst": false, 00:15:31.502 "ddgst": false 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 }' 00:15:31.502 15:16:29 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.502 15:16:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.502 "params": { 00:15:31.502 "name": "Nvme1", 00:15:31.502 "trtype": "tcp", 00:15:31.502 "traddr": "10.0.0.2", 00:15:31.502 "adrfam": "ipv4", 00:15:31.502 "trsvcid": "4420", 00:15:31.502 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.502 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.502 "hdgst": false, 00:15:31.502 "ddgst": false 00:15:31.502 }, 00:15:31.502 "method": "bdev_nvme_attach_controller" 00:15:31.502 }' 00:15:31.502 [2024-11-19 15:16:30.000316] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.502 [2024-11-19 15:16:30.000386] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:31.502 [2024-11-19 15:16:30.000997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.502 [2024-11-19 15:16:30.000999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.502 [2024-11-19 15:16:30.000997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.502 [2024-11-19 15:16:30.001085] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-19 15:16:30.001086] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-19 15:16:30.001086] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:31.502 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:31.502 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:31.502 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.760 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.760 [2024-11-19 15:16:30.180680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:31.760 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.760 [2024-11-19 15:16:30.279152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:31.760 [2024-11-19 15:16:30.285760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.019 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.019 [2024-11-19 15:16:30.384813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:32.019 [2024-11-19 15:16:30.409609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.019 [2024-11-19 15:16:30.466982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.019 [2024-11-19 15:16:30.508284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:32.019 [2024-11-19 15:16:30.555527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:32.277 Running I/O for 1 seconds... 00:15:32.277 Running I/O for 1 seconds... 00:15:32.277 Running I/O for 1 seconds... 00:15:32.536 Running I/O for 1 seconds... 00:15:33.103 00:15:33.103 Latency(us) 00:15:33.103 [2024-11-19T14:16:31.666Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.103 [2024-11-19T14:16:31.666Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:33.103 Nvme1n1 : 1.02 6942.12 27.12 0.00 0.00 18271.36 8883.77 28932.93 00:15:33.103 [2024-11-19T14:16:31.666Z] =================================================================================================================== 00:15:33.103 [2024-11-19T14:16:31.666Z] Total : 6942.12 27.12 0.00 0.00 18271.36 8883.77 28932.93 00:15:33.361 00:15:33.361 Latency(us) 00:15:33.361 [2024-11-19T14:16:31.924Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.361 [2024-11-19T14:16:31.924Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:33.361 Nvme1n1 : 1.01 10178.14 39.76 0.00 0.00 12525.08 6213.78 21651.15 00:15:33.361 [2024-11-19T14:16:31.924Z] =================================================================================================================== 00:15:33.361 [2024-11-19T14:16:31.924Z] Total : 10178.14 39.76 0.00 0.00 12525.08 6213.78 21651.15 00:15:33.361 00:15:33.361 Latency(us) 00:15:33.361 [2024-11-19T14:16:31.924Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.361 [2024-11-19T14:16:31.924Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:33.361 Nvme1n1 : 1.01 6822.86 26.65 0.00 0.00 18693.98 6553.60 43302.31 00:15:33.361 [2024-11-19T14:16:31.924Z] =================================================================================================================== 00:15:33.361 [2024-11-19T14:16:31.924Z] Total : 6822.86 26.65 0.00 0.00 18693.98 6553.60 43302.31 00:15:33.361 00:15:33.361 Latency(us) 00:15:33.361 [2024-11-19T14:16:31.924Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.361 [2024-11-19T14:16:31.924Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:33.361 Nvme1n1 : 1.00 195180.08 762.42 0.00 0.00 653.28 253.35 885.95 00:15:33.361 [2024-11-19T14:16:31.924Z] =================================================================================================================== 00:15:33.361 [2024-11-19T14:16:31.924Z] Total : 195180.08 762.42 0.00 0.00 653.28 253.35 885.95 00:15:33.620 15:16:31 -- target/bdev_io_wait.sh@38 -- # wait 2755096 00:15:33.620 15:16:32 -- target/bdev_io_wait.sh@39 -- # wait 2755098 00:15:33.620 15:16:32 -- target/bdev_io_wait.sh@40 -- # wait 2755101 00:15:33.620 15:16:32 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:33.620 15:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.620 15:16:32 -- common/autotest_common.sh@10 -- # set +x 00:15:33.620 15:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.620 15:16:32 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:33.620 15:16:32 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:33.620 15:16:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:33.620 15:16:32 -- nvmf/common.sh@116 -- # sync 00:15:33.620 15:16:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:33.620 15:16:32 -- nvmf/common.sh@119 -- # set +e 00:15:33.620 15:16:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:33.620 15:16:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:33.620 rmmod nvme_tcp 00:15:33.620 rmmod nvme_fabrics 00:15:33.878 rmmod nvme_keyring 00:15:33.878 15:16:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:33.878 15:16:32 -- nvmf/common.sh@123 -- # set -e 00:15:33.878 15:16:32 -- nvmf/common.sh@124 -- # return 0 00:15:33.878 15:16:32 -- nvmf/common.sh@477 -- # '[' -n 2755060 ']' 00:15:33.878 15:16:32 -- nvmf/common.sh@478 -- # killprocess 2755060 00:15:33.878 15:16:32 -- common/autotest_common.sh@936 -- # '[' -z 2755060 ']' 00:15:33.878 15:16:32 -- common/autotest_common.sh@940 -- # kill -0 2755060 00:15:33.878 15:16:32 -- common/autotest_common.sh@941 -- # uname 00:15:33.878 15:16:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:33.878 15:16:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2755060 00:15:33.878 15:16:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:33.878 15:16:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:33.878 15:16:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2755060' 00:15:33.878 killing process with pid 2755060 00:15:33.878 15:16:32 -- common/autotest_common.sh@955 -- # kill 2755060 00:15:33.878 15:16:32 -- common/autotest_common.sh@960 -- # wait 2755060 00:15:34.137 15:16:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:34.137 15:16:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:34.137 15:16:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:34.137 15:16:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:34.137 15:16:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:34.137 15:16:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:34.137 15:16:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:34.137 15:16:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.041 15:16:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:36.041 00:15:36.041 real 0m7.474s 00:15:36.041 user 0m17.081s 00:15:36.041 sys 0m3.638s 00:15:36.041 15:16:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:36.041 15:16:34 -- common/autotest_common.sh@10 -- # set +x 00:15:36.041 ************************************ 00:15:36.041 END TEST nvmf_bdev_io_wait 00:15:36.041 ************************************ 00:15:36.041 15:16:34 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:36.041 15:16:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:36.041 15:16:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:36.041 15:16:34 -- common/autotest_common.sh@10 -- # set +x 00:15:36.300 ************************************ 00:15:36.300 START TEST nvmf_queue_depth 00:15:36.300 ************************************ 00:15:36.300 15:16:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:36.300 * Looking for test storage... 00:15:36.300 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:36.300 15:16:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:36.300 15:16:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:36.300 15:16:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:36.300 15:16:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:36.300 15:16:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:36.300 15:16:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:36.300 15:16:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:36.300 15:16:34 -- scripts/common.sh@335 -- # IFS=.-: 00:15:36.300 15:16:34 -- scripts/common.sh@335 -- # read -ra ver1 00:15:36.300 15:16:34 -- scripts/common.sh@336 -- # IFS=.-: 00:15:36.300 15:16:34 -- scripts/common.sh@336 -- # read -ra ver2 00:15:36.300 15:16:34 -- scripts/common.sh@337 -- # local 'op=<' 00:15:36.300 15:16:34 -- scripts/common.sh@339 -- # ver1_l=2 00:15:36.300 15:16:34 -- scripts/common.sh@340 -- # ver2_l=1 00:15:36.300 15:16:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:36.300 15:16:34 -- scripts/common.sh@343 -- # case "$op" in 00:15:36.300 15:16:34 -- scripts/common.sh@344 -- # : 1 00:15:36.300 15:16:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:36.300 15:16:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:36.300 15:16:34 -- scripts/common.sh@364 -- # decimal 1 00:15:36.300 15:16:34 -- scripts/common.sh@352 -- # local d=1 00:15:36.300 15:16:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:36.300 15:16:34 -- scripts/common.sh@354 -- # echo 1 00:15:36.300 15:16:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:36.300 15:16:34 -- scripts/common.sh@365 -- # decimal 2 00:15:36.300 15:16:34 -- scripts/common.sh@352 -- # local d=2 00:15:36.300 15:16:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:36.300 15:16:34 -- scripts/common.sh@354 -- # echo 2 00:15:36.300 15:16:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:36.300 15:16:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:36.300 15:16:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:36.300 15:16:34 -- scripts/common.sh@367 -- # return 0 00:15:36.300 15:16:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:36.300 15:16:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:36.300 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.300 --rc genhtml_branch_coverage=1 00:15:36.300 --rc genhtml_function_coverage=1 00:15:36.300 --rc genhtml_legend=1 00:15:36.300 --rc geninfo_all_blocks=1 00:15:36.300 --rc geninfo_unexecuted_blocks=1 00:15:36.300 00:15:36.300 ' 00:15:36.300 15:16:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:36.300 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.300 --rc genhtml_branch_coverage=1 00:15:36.300 --rc genhtml_function_coverage=1 00:15:36.300 --rc genhtml_legend=1 00:15:36.300 --rc geninfo_all_blocks=1 00:15:36.300 --rc geninfo_unexecuted_blocks=1 00:15:36.300 00:15:36.300 ' 00:15:36.300 15:16:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:36.300 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.300 --rc genhtml_branch_coverage=1 00:15:36.300 --rc genhtml_function_coverage=1 00:15:36.300 --rc genhtml_legend=1 00:15:36.300 --rc geninfo_all_blocks=1 00:15:36.300 --rc geninfo_unexecuted_blocks=1 00:15:36.300 00:15:36.300 ' 00:15:36.300 15:16:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:36.300 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:36.300 --rc genhtml_branch_coverage=1 00:15:36.300 --rc genhtml_function_coverage=1 00:15:36.300 --rc genhtml_legend=1 00:15:36.300 --rc geninfo_all_blocks=1 00:15:36.300 --rc geninfo_unexecuted_blocks=1 00:15:36.300 00:15:36.300 ' 00:15:36.300 15:16:34 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:36.300 15:16:34 -- nvmf/common.sh@7 -- # uname -s 00:15:36.300 15:16:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:36.300 15:16:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:36.300 15:16:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:36.300 15:16:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:36.301 15:16:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:36.301 15:16:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:36.301 15:16:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:36.301 15:16:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:36.301 15:16:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:36.301 15:16:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:36.301 15:16:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:36.301 15:16:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:36.301 15:16:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:36.301 15:16:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:36.301 15:16:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:36.301 15:16:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:36.301 15:16:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:36.301 15:16:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:36.301 15:16:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:36.301 15:16:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.301 15:16:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.301 15:16:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.301 15:16:34 -- paths/export.sh@5 -- # export PATH 00:15:36.301 15:16:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.301 15:16:34 -- nvmf/common.sh@46 -- # : 0 00:15:36.301 15:16:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:36.301 15:16:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:36.301 15:16:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:36.301 15:16:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:36.301 15:16:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:36.301 15:16:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:36.301 15:16:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:36.301 15:16:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:36.301 15:16:34 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:36.301 15:16:34 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:36.301 15:16:34 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:36.301 15:16:34 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:36.301 15:16:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:36.301 15:16:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:36.301 15:16:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:36.301 15:16:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:36.301 15:16:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:36.301 15:16:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.301 15:16:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.301 15:16:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.301 15:16:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:36.301 15:16:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:36.301 15:16:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:36.301 15:16:34 -- common/autotest_common.sh@10 -- # set +x 00:15:38.831 15:16:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:38.831 15:16:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:38.831 15:16:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:38.831 15:16:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:38.831 15:16:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:38.831 15:16:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:38.831 15:16:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:38.831 15:16:36 -- nvmf/common.sh@294 -- # net_devs=() 00:15:38.831 15:16:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:38.831 15:16:36 -- nvmf/common.sh@295 -- # e810=() 00:15:38.831 15:16:36 -- nvmf/common.sh@295 -- # local -ga e810 00:15:38.831 15:16:36 -- nvmf/common.sh@296 -- # x722=() 00:15:38.831 15:16:36 -- nvmf/common.sh@296 -- # local -ga x722 00:15:38.831 15:16:36 -- nvmf/common.sh@297 -- # mlx=() 00:15:38.831 15:16:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:38.831 15:16:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:38.831 15:16:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:38.831 15:16:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:38.831 15:16:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.831 15:16:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:38.831 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:38.831 15:16:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.831 15:16:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:38.831 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:38.831 15:16:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.831 15:16:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.831 15:16:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.831 15:16:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:38.831 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:38.831 15:16:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.831 15:16:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.831 15:16:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.831 15:16:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.831 15:16:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:38.831 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:38.831 15:16:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.831 15:16:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:38.831 15:16:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:38.831 15:16:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:38.831 15:16:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:38.831 15:16:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:38.831 15:16:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:38.831 15:16:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:38.831 15:16:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:38.831 15:16:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:38.831 15:16:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:38.831 15:16:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:38.831 15:16:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:38.831 15:16:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:38.831 15:16:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:38.831 15:16:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:38.831 15:16:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:38.831 15:16:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:38.831 15:16:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:38.831 15:16:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:38.831 15:16:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:38.831 15:16:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:38.831 15:16:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:38.831 15:16:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:38.831 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:38.832 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:15:38.832 00:15:38.832 --- 10.0.0.2 ping statistics --- 00:15:38.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.832 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:15:38.832 15:16:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:38.832 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:38.832 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:15:38.832 00:15:38.832 --- 10.0.0.1 ping statistics --- 00:15:38.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.832 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:15:38.832 15:16:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:38.832 15:16:37 -- nvmf/common.sh@410 -- # return 0 00:15:38.832 15:16:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:38.832 15:16:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:38.832 15:16:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:38.832 15:16:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:38.832 15:16:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:38.832 15:16:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:38.832 15:16:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:38.832 15:16:37 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:38.832 15:16:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:38.832 15:16:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:38.832 15:16:37 -- common/autotest_common.sh@10 -- # set +x 00:15:38.832 15:16:37 -- nvmf/common.sh@469 -- # nvmfpid=2757432 00:15:38.832 15:16:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:38.832 15:16:37 -- nvmf/common.sh@470 -- # waitforlisten 2757432 00:15:38.832 15:16:37 -- common/autotest_common.sh@829 -- # '[' -z 2757432 ']' 00:15:38.832 15:16:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:38.832 15:16:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:38.832 15:16:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:38.832 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:38.832 15:16:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:38.832 15:16:37 -- common/autotest_common.sh@10 -- # set +x 00:15:38.832 [2024-11-19 15:16:37.156030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:38.832 [2024-11-19 15:16:37.156114] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:38.832 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.832 [2024-11-19 15:16:37.226625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.832 [2024-11-19 15:16:37.340291] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:38.832 [2024-11-19 15:16:37.340457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:38.832 [2024-11-19 15:16:37.340476] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:38.832 [2024-11-19 15:16:37.340491] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:38.832 [2024-11-19 15:16:37.340523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.766 15:16:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:39.766 15:16:38 -- common/autotest_common.sh@862 -- # return 0 00:15:39.766 15:16:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:39.766 15:16:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 15:16:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:39.766 15:16:38 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:39.766 15:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 [2024-11-19 15:16:38.135284] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:39.766 15:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.766 15:16:38 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:39.766 15:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 Malloc0 00:15:39.766 15:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.766 15:16:38 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:39.766 15:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 15:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.766 15:16:38 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:39.766 15:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 15:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.766 15:16:38 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:39.766 15:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.766 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.766 [2024-11-19 15:16:38.207452] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:39.766 15:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.767 15:16:38 -- target/queue_depth.sh@30 -- # bdevperf_pid=2757556 00:15:39.767 15:16:38 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:39.767 15:16:38 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:39.767 15:16:38 -- target/queue_depth.sh@33 -- # waitforlisten 2757556 /var/tmp/bdevperf.sock 00:15:39.767 15:16:38 -- common/autotest_common.sh@829 -- # '[' -z 2757556 ']' 00:15:39.767 15:16:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:39.767 15:16:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:39.767 15:16:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:39.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:39.767 15:16:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:39.767 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:15:39.767 [2024-11-19 15:16:38.249630] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:39.767 [2024-11-19 15:16:38.249726] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2757556 ] 00:15:39.767 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.767 [2024-11-19 15:16:38.311111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:40.025 [2024-11-19 15:16:38.425078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.959 15:16:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:40.960 15:16:39 -- common/autotest_common.sh@862 -- # return 0 00:15:40.960 15:16:39 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:40.960 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.960 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:15:40.960 NVMe0n1 00:15:40.960 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.960 15:16:39 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:41.217 Running I/O for 10 seconds... 00:15:51.223 00:15:51.223 Latency(us) 00:15:51.223 [2024-11-19T14:16:49.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:51.223 [2024-11-19T14:16:49.786Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:51.223 Verification LBA range: start 0x0 length 0x4000 00:15:51.223 NVMe0n1 : 10.07 12358.34 48.27 0.00 0.00 82534.01 13689.74 62526.20 00:15:51.223 [2024-11-19T14:16:49.786Z] =================================================================================================================== 00:15:51.223 [2024-11-19T14:16:49.786Z] Total : 12358.34 48.27 0.00 0.00 82534.01 13689.74 62526.20 00:15:51.223 0 00:15:51.223 15:16:49 -- target/queue_depth.sh@39 -- # killprocess 2757556 00:15:51.223 15:16:49 -- common/autotest_common.sh@936 -- # '[' -z 2757556 ']' 00:15:51.223 15:16:49 -- common/autotest_common.sh@940 -- # kill -0 2757556 00:15:51.223 15:16:49 -- common/autotest_common.sh@941 -- # uname 00:15:51.223 15:16:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:51.223 15:16:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2757556 00:15:51.223 15:16:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:51.223 15:16:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:51.223 15:16:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2757556' 00:15:51.223 killing process with pid 2757556 00:15:51.223 15:16:49 -- common/autotest_common.sh@955 -- # kill 2757556 00:15:51.223 Received shutdown signal, test time was about 10.000000 seconds 00:15:51.223 00:15:51.223 Latency(us) 00:15:51.223 [2024-11-19T14:16:49.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:51.223 [2024-11-19T14:16:49.786Z] =================================================================================================================== 00:15:51.223 [2024-11-19T14:16:49.786Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:51.223 15:16:49 -- common/autotest_common.sh@960 -- # wait 2757556 00:15:51.481 15:16:49 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:51.481 15:16:49 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:51.481 15:16:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:51.481 15:16:49 -- nvmf/common.sh@116 -- # sync 00:15:51.481 15:16:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:51.481 15:16:49 -- nvmf/common.sh@119 -- # set +e 00:15:51.481 15:16:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:51.481 15:16:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:51.481 rmmod nvme_tcp 00:15:51.481 rmmod nvme_fabrics 00:15:51.481 rmmod nvme_keyring 00:15:51.739 15:16:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:51.739 15:16:50 -- nvmf/common.sh@123 -- # set -e 00:15:51.739 15:16:50 -- nvmf/common.sh@124 -- # return 0 00:15:51.739 15:16:50 -- nvmf/common.sh@477 -- # '[' -n 2757432 ']' 00:15:51.739 15:16:50 -- nvmf/common.sh@478 -- # killprocess 2757432 00:15:51.739 15:16:50 -- common/autotest_common.sh@936 -- # '[' -z 2757432 ']' 00:15:51.739 15:16:50 -- common/autotest_common.sh@940 -- # kill -0 2757432 00:15:51.739 15:16:50 -- common/autotest_common.sh@941 -- # uname 00:15:51.739 15:16:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:51.739 15:16:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2757432 00:15:51.739 15:16:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:51.739 15:16:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:51.739 15:16:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2757432' 00:15:51.739 killing process with pid 2757432 00:15:51.739 15:16:50 -- common/autotest_common.sh@955 -- # kill 2757432 00:15:51.740 15:16:50 -- common/autotest_common.sh@960 -- # wait 2757432 00:15:51.998 15:16:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:51.998 15:16:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:51.998 15:16:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:51.998 15:16:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:51.998 15:16:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:51.998 15:16:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:51.998 15:16:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:51.998 15:16:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.899 15:16:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:53.899 00:15:53.899 real 0m17.837s 00:15:53.899 user 0m25.371s 00:15:53.899 sys 0m3.260s 00:15:53.899 15:16:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:53.899 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:53.899 ************************************ 00:15:53.899 END TEST nvmf_queue_depth 00:15:53.899 ************************************ 00:15:54.157 15:16:52 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:54.157 15:16:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:54.157 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:54.157 ************************************ 00:15:54.157 START TEST nvmf_multipath 00:15:54.157 ************************************ 00:15:54.157 15:16:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:54.157 * Looking for test storage... 00:15:54.157 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:54.157 15:16:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:54.157 15:16:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:54.157 15:16:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:54.157 15:16:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:54.157 15:16:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:54.157 15:16:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:54.157 15:16:52 -- scripts/common.sh@335 -- # IFS=.-: 00:15:54.157 15:16:52 -- scripts/common.sh@335 -- # read -ra ver1 00:15:54.157 15:16:52 -- scripts/common.sh@336 -- # IFS=.-: 00:15:54.157 15:16:52 -- scripts/common.sh@336 -- # read -ra ver2 00:15:54.157 15:16:52 -- scripts/common.sh@337 -- # local 'op=<' 00:15:54.157 15:16:52 -- scripts/common.sh@339 -- # ver1_l=2 00:15:54.157 15:16:52 -- scripts/common.sh@340 -- # ver2_l=1 00:15:54.157 15:16:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:54.157 15:16:52 -- scripts/common.sh@343 -- # case "$op" in 00:15:54.157 15:16:52 -- scripts/common.sh@344 -- # : 1 00:15:54.157 15:16:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:54.157 15:16:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:54.157 15:16:52 -- scripts/common.sh@364 -- # decimal 1 00:15:54.157 15:16:52 -- scripts/common.sh@352 -- # local d=1 00:15:54.157 15:16:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:54.157 15:16:52 -- scripts/common.sh@354 -- # echo 1 00:15:54.157 15:16:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:54.157 15:16:52 -- scripts/common.sh@365 -- # decimal 2 00:15:54.157 15:16:52 -- scripts/common.sh@352 -- # local d=2 00:15:54.157 15:16:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:54.157 15:16:52 -- scripts/common.sh@354 -- # echo 2 00:15:54.157 15:16:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:54.157 15:16:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:54.157 15:16:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:54.157 15:16:52 -- scripts/common.sh@367 -- # return 0 00:15:54.157 15:16:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:54.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.157 --rc genhtml_branch_coverage=1 00:15:54.157 --rc genhtml_function_coverage=1 00:15:54.157 --rc genhtml_legend=1 00:15:54.157 --rc geninfo_all_blocks=1 00:15:54.157 --rc geninfo_unexecuted_blocks=1 00:15:54.157 00:15:54.157 ' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:54.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.157 --rc genhtml_branch_coverage=1 00:15:54.157 --rc genhtml_function_coverage=1 00:15:54.157 --rc genhtml_legend=1 00:15:54.157 --rc geninfo_all_blocks=1 00:15:54.157 --rc geninfo_unexecuted_blocks=1 00:15:54.157 00:15:54.157 ' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:54.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.157 --rc genhtml_branch_coverage=1 00:15:54.157 --rc genhtml_function_coverage=1 00:15:54.157 --rc genhtml_legend=1 00:15:54.157 --rc geninfo_all_blocks=1 00:15:54.157 --rc geninfo_unexecuted_blocks=1 00:15:54.157 00:15:54.157 ' 00:15:54.157 15:16:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:54.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.157 --rc genhtml_branch_coverage=1 00:15:54.157 --rc genhtml_function_coverage=1 00:15:54.157 --rc genhtml_legend=1 00:15:54.157 --rc geninfo_all_blocks=1 00:15:54.157 --rc geninfo_unexecuted_blocks=1 00:15:54.157 00:15:54.157 ' 00:15:54.157 15:16:52 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:54.157 15:16:52 -- nvmf/common.sh@7 -- # uname -s 00:15:54.157 15:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:54.157 15:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:54.157 15:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:54.157 15:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:54.157 15:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:54.157 15:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:54.157 15:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:54.157 15:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:54.157 15:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:54.157 15:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:54.157 15:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.157 15:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.157 15:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:54.157 15:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:54.157 15:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:54.157 15:16:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:54.157 15:16:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:54.157 15:16:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:54.157 15:16:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:54.157 15:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.157 15:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.157 15:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.157 15:16:52 -- paths/export.sh@5 -- # export PATH 00:15:54.157 15:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.157 15:16:52 -- nvmf/common.sh@46 -- # : 0 00:15:54.157 15:16:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:54.157 15:16:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:54.157 15:16:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:54.157 15:16:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:54.157 15:16:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:54.157 15:16:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:54.157 15:16:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:54.157 15:16:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:54.157 15:16:52 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:54.157 15:16:52 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:54.157 15:16:52 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:54.157 15:16:52 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:54.157 15:16:52 -- target/multipath.sh@43 -- # nvmftestinit 00:15:54.157 15:16:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:54.157 15:16:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:54.157 15:16:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:54.158 15:16:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:54.158 15:16:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:54.158 15:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:54.158 15:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:54.158 15:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:54.158 15:16:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:54.158 15:16:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:54.158 15:16:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:54.158 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.138 15:16:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:56.138 15:16:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:56.138 15:16:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:56.138 15:16:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:56.138 15:16:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:56.138 15:16:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:56.138 15:16:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:56.138 15:16:54 -- nvmf/common.sh@294 -- # net_devs=() 00:15:56.139 15:16:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:56.139 15:16:54 -- nvmf/common.sh@295 -- # e810=() 00:15:56.139 15:16:54 -- nvmf/common.sh@295 -- # local -ga e810 00:15:56.139 15:16:54 -- nvmf/common.sh@296 -- # x722=() 00:15:56.139 15:16:54 -- nvmf/common.sh@296 -- # local -ga x722 00:15:56.139 15:16:54 -- nvmf/common.sh@297 -- # mlx=() 00:15:56.139 15:16:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:56.139 15:16:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:56.139 15:16:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:56.139 15:16:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:56.139 15:16:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:56.139 15:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:56.139 15:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:56.139 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:56.139 15:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:56.139 15:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:56.139 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:56.139 15:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:56.139 15:16:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:56.139 15:16:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:56.398 15:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:56.398 15:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:56.398 15:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:56.398 15:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:56.398 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:56.398 15:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:56.398 15:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:56.398 15:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:56.398 15:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:56.398 15:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:56.398 15:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:56.398 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:56.398 15:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:56.398 15:16:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:56.398 15:16:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:56.398 15:16:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:56.398 15:16:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:56.398 15:16:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:56.398 15:16:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:56.398 15:16:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:56.398 15:16:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:56.398 15:16:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:56.398 15:16:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:56.398 15:16:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:56.398 15:16:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:56.398 15:16:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:56.398 15:16:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:56.398 15:16:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:56.398 15:16:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:56.398 15:16:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:56.398 15:16:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:56.398 15:16:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:56.398 15:16:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:56.398 15:16:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:56.398 15:16:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:56.398 15:16:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:56.398 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:56.398 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:15:56.398 00:15:56.398 --- 10.0.0.2 ping statistics --- 00:15:56.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:56.398 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:15:56.398 15:16:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:56.398 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:56.398 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:15:56.398 00:15:56.398 --- 10.0.0.1 ping statistics --- 00:15:56.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:56.398 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:15:56.398 15:16:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:56.398 15:16:54 -- nvmf/common.sh@410 -- # return 0 00:15:56.398 15:16:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:56.398 15:16:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:56.398 15:16:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:56.398 15:16:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:56.398 15:16:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:56.398 15:16:54 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:56.398 15:16:54 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:56.398 only one NIC for nvmf test 00:15:56.398 15:16:54 -- target/multipath.sh@47 -- # nvmftestfini 00:15:56.398 15:16:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:56.398 15:16:54 -- nvmf/common.sh@116 -- # sync 00:15:56.398 15:16:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:56.398 15:16:54 -- nvmf/common.sh@119 -- # set +e 00:15:56.398 15:16:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:56.398 15:16:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:56.398 rmmod nvme_tcp 00:15:56.398 rmmod nvme_fabrics 00:15:56.398 rmmod nvme_keyring 00:15:56.398 15:16:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:56.398 15:16:54 -- nvmf/common.sh@123 -- # set -e 00:15:56.398 15:16:54 -- nvmf/common.sh@124 -- # return 0 00:15:56.398 15:16:54 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:56.398 15:16:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:56.398 15:16:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:56.398 15:16:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:56.398 15:16:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:56.398 15:16:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.398 15:16:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.398 15:16:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.934 15:16:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:58.934 15:16:56 -- target/multipath.sh@48 -- # exit 0 00:15:58.934 15:16:56 -- target/multipath.sh@1 -- # nvmftestfini 00:15:58.934 15:16:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.934 15:16:56 -- nvmf/common.sh@116 -- # sync 00:15:58.934 15:16:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.934 15:16:56 -- nvmf/common.sh@119 -- # set +e 00:15:58.934 15:16:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.934 15:16:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.934 15:16:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.934 15:16:56 -- nvmf/common.sh@123 -- # set -e 00:15:58.934 15:16:56 -- nvmf/common.sh@124 -- # return 0 00:15:58.934 15:16:56 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.934 15:16:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.934 15:16:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.934 15:16:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.934 15:16:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.934 15:16:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.934 15:16:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.934 15:16:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.934 15:16:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.934 15:16:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:58.934 00:15:58.934 real 0m4.500s 00:15:58.934 user 0m0.899s 00:15:58.934 sys 0m1.593s 00:15:58.934 15:16:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:58.934 15:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:58.934 ************************************ 00:15:58.934 END TEST nvmf_multipath 00:15:58.934 ************************************ 00:15:58.934 15:16:56 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:58.934 15:16:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:58.934 15:16:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:58.934 15:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:58.934 ************************************ 00:15:58.934 START TEST nvmf_zcopy 00:15:58.934 ************************************ 00:15:58.934 15:16:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:58.934 * Looking for test storage... 00:15:58.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:58.934 15:16:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:58.934 15:16:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:58.934 15:16:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:58.934 15:16:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:58.934 15:16:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:58.934 15:16:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:58.934 15:16:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:58.934 15:16:57 -- scripts/common.sh@335 -- # IFS=.-: 00:15:58.934 15:16:57 -- scripts/common.sh@335 -- # read -ra ver1 00:15:58.934 15:16:57 -- scripts/common.sh@336 -- # IFS=.-: 00:15:58.934 15:16:57 -- scripts/common.sh@336 -- # read -ra ver2 00:15:58.934 15:16:57 -- scripts/common.sh@337 -- # local 'op=<' 00:15:58.934 15:16:57 -- scripts/common.sh@339 -- # ver1_l=2 00:15:58.934 15:16:57 -- scripts/common.sh@340 -- # ver2_l=1 00:15:58.934 15:16:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:58.934 15:16:57 -- scripts/common.sh@343 -- # case "$op" in 00:15:58.934 15:16:57 -- scripts/common.sh@344 -- # : 1 00:15:58.934 15:16:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:58.934 15:16:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:58.934 15:16:57 -- scripts/common.sh@364 -- # decimal 1 00:15:58.934 15:16:57 -- scripts/common.sh@352 -- # local d=1 00:15:58.934 15:16:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:58.934 15:16:57 -- scripts/common.sh@354 -- # echo 1 00:15:58.934 15:16:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:58.934 15:16:57 -- scripts/common.sh@365 -- # decimal 2 00:15:58.934 15:16:57 -- scripts/common.sh@352 -- # local d=2 00:15:58.934 15:16:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:58.934 15:16:57 -- scripts/common.sh@354 -- # echo 2 00:15:58.934 15:16:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:58.934 15:16:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:58.934 15:16:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:58.934 15:16:57 -- scripts/common.sh@367 -- # return 0 00:15:58.934 15:16:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:58.934 15:16:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:58.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.934 --rc genhtml_branch_coverage=1 00:15:58.934 --rc genhtml_function_coverage=1 00:15:58.934 --rc genhtml_legend=1 00:15:58.934 --rc geninfo_all_blocks=1 00:15:58.934 --rc geninfo_unexecuted_blocks=1 00:15:58.934 00:15:58.934 ' 00:15:58.934 15:16:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:58.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.934 --rc genhtml_branch_coverage=1 00:15:58.934 --rc genhtml_function_coverage=1 00:15:58.934 --rc genhtml_legend=1 00:15:58.934 --rc geninfo_all_blocks=1 00:15:58.934 --rc geninfo_unexecuted_blocks=1 00:15:58.934 00:15:58.934 ' 00:15:58.934 15:16:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:58.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.934 --rc genhtml_branch_coverage=1 00:15:58.934 --rc genhtml_function_coverage=1 00:15:58.934 --rc genhtml_legend=1 00:15:58.934 --rc geninfo_all_blocks=1 00:15:58.934 --rc geninfo_unexecuted_blocks=1 00:15:58.934 00:15:58.934 ' 00:15:58.934 15:16:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:58.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.934 --rc genhtml_branch_coverage=1 00:15:58.934 --rc genhtml_function_coverage=1 00:15:58.934 --rc genhtml_legend=1 00:15:58.934 --rc geninfo_all_blocks=1 00:15:58.934 --rc geninfo_unexecuted_blocks=1 00:15:58.934 00:15:58.934 ' 00:15:58.934 15:16:57 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:58.934 15:16:57 -- nvmf/common.sh@7 -- # uname -s 00:15:58.934 15:16:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:58.934 15:16:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:58.934 15:16:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:58.934 15:16:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:58.934 15:16:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:58.934 15:16:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:58.934 15:16:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:58.934 15:16:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:58.934 15:16:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:58.934 15:16:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:58.934 15:16:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.934 15:16:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.934 15:16:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:58.934 15:16:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:58.934 15:16:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:58.934 15:16:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:58.934 15:16:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:58.934 15:16:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:58.934 15:16:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:58.934 15:16:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.934 15:16:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.934 15:16:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.934 15:16:57 -- paths/export.sh@5 -- # export PATH 00:15:58.934 15:16:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.934 15:16:57 -- nvmf/common.sh@46 -- # : 0 00:15:58.934 15:16:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:58.934 15:16:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:58.934 15:16:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:58.934 15:16:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:58.934 15:16:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:58.934 15:16:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:58.934 15:16:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:58.935 15:16:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:58.935 15:16:57 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:58.935 15:16:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:58.935 15:16:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:58.935 15:16:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:58.935 15:16:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:58.935 15:16:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:58.935 15:16:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.935 15:16:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.935 15:16:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.935 15:16:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:58.935 15:16:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:58.935 15:16:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:58.935 15:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:00.838 15:16:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:00.838 15:16:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:00.838 15:16:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:00.838 15:16:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:00.838 15:16:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:00.838 15:16:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:00.838 15:16:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:00.838 15:16:59 -- nvmf/common.sh@294 -- # net_devs=() 00:16:00.838 15:16:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:00.838 15:16:59 -- nvmf/common.sh@295 -- # e810=() 00:16:00.838 15:16:59 -- nvmf/common.sh@295 -- # local -ga e810 00:16:00.838 15:16:59 -- nvmf/common.sh@296 -- # x722=() 00:16:00.838 15:16:59 -- nvmf/common.sh@296 -- # local -ga x722 00:16:00.838 15:16:59 -- nvmf/common.sh@297 -- # mlx=() 00:16:00.838 15:16:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:00.838 15:16:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:00.838 15:16:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:00.838 15:16:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:00.838 15:16:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:00.838 15:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.838 15:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:00.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:00.838 15:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.838 15:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:00.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:00.838 15:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:00.838 15:16:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:00.838 15:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.839 15:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.839 15:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.839 15:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.839 15:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:00.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:00.839 15:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.839 15:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.839 15:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.839 15:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.839 15:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.839 15:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:00.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:00.839 15:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.839 15:16:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:00.839 15:16:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:00.839 15:16:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:00.839 15:16:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:00.839 15:16:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:00.839 15:16:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:00.839 15:16:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:00.839 15:16:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:00.839 15:16:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:00.839 15:16:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:00.839 15:16:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:00.839 15:16:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:00.839 15:16:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:00.839 15:16:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:00.839 15:16:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:00.839 15:16:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:00.839 15:16:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:00.839 15:16:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:00.839 15:16:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:00.839 15:16:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:00.839 15:16:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:00.839 15:16:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:00.839 15:16:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:00.839 15:16:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:00.839 15:16:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:00.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:00.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:16:00.839 00:16:00.839 --- 10.0.0.2 ping statistics --- 00:16:00.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.839 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:16:00.839 15:16:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:00.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:00.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:16:00.839 00:16:00.839 --- 10.0.0.1 ping statistics --- 00:16:00.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.839 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:16:00.839 15:16:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:00.839 15:16:59 -- nvmf/common.sh@410 -- # return 0 00:16:00.839 15:16:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:00.839 15:16:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:00.839 15:16:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:00.839 15:16:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:00.839 15:16:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:00.839 15:16:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:00.839 15:16:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:00.839 15:16:59 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:00.839 15:16:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:00.839 15:16:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:00.839 15:16:59 -- common/autotest_common.sh@10 -- # set +x 00:16:00.839 15:16:59 -- nvmf/common.sh@469 -- # nvmfpid=2762885 00:16:00.839 15:16:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:00.839 15:16:59 -- nvmf/common.sh@470 -- # waitforlisten 2762885 00:16:00.839 15:16:59 -- common/autotest_common.sh@829 -- # '[' -z 2762885 ']' 00:16:00.839 15:16:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:00.839 15:16:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:00.839 15:16:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:00.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:00.839 15:16:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:00.839 15:16:59 -- common/autotest_common.sh@10 -- # set +x 00:16:00.839 [2024-11-19 15:16:59.381065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:00.839 [2024-11-19 15:16:59.381147] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:01.098 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.098 [2024-11-19 15:16:59.450503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:01.098 [2024-11-19 15:16:59.568678] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:01.098 [2024-11-19 15:16:59.568856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:01.098 [2024-11-19 15:16:59.568877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:01.098 [2024-11-19 15:16:59.568891] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:01.098 [2024-11-19 15:16:59.568924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:02.034 15:17:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:02.034 15:17:00 -- common/autotest_common.sh@862 -- # return 0 00:16:02.034 15:17:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:02.034 15:17:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 15:17:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:02.034 15:17:00 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:02.034 15:17:00 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 [2024-11-19 15:17:00.365771] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 [2024-11-19 15:17:00.381931] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 malloc0 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:02.034 15:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.034 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:02.034 15:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.034 15:17:00 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:02.034 15:17:00 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:02.034 15:17:00 -- nvmf/common.sh@520 -- # config=() 00:16:02.034 15:17:00 -- nvmf/common.sh@520 -- # local subsystem config 00:16:02.034 15:17:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:02.034 15:17:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:02.034 { 00:16:02.034 "params": { 00:16:02.034 "name": "Nvme$subsystem", 00:16:02.034 "trtype": "$TEST_TRANSPORT", 00:16:02.034 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:02.034 "adrfam": "ipv4", 00:16:02.034 "trsvcid": "$NVMF_PORT", 00:16:02.034 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:02.034 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:02.034 "hdgst": ${hdgst:-false}, 00:16:02.034 "ddgst": ${ddgst:-false} 00:16:02.034 }, 00:16:02.034 "method": "bdev_nvme_attach_controller" 00:16:02.034 } 00:16:02.034 EOF 00:16:02.034 )") 00:16:02.034 15:17:00 -- nvmf/common.sh@542 -- # cat 00:16:02.034 15:17:00 -- nvmf/common.sh@544 -- # jq . 00:16:02.034 15:17:00 -- nvmf/common.sh@545 -- # IFS=, 00:16:02.034 15:17:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:02.034 "params": { 00:16:02.034 "name": "Nvme1", 00:16:02.034 "trtype": "tcp", 00:16:02.034 "traddr": "10.0.0.2", 00:16:02.034 "adrfam": "ipv4", 00:16:02.034 "trsvcid": "4420", 00:16:02.034 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:02.034 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:02.034 "hdgst": false, 00:16:02.034 "ddgst": false 00:16:02.034 }, 00:16:02.034 "method": "bdev_nvme_attach_controller" 00:16:02.034 }' 00:16:02.034 [2024-11-19 15:17:00.452817] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:02.034 [2024-11-19 15:17:00.452892] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2763043 ] 00:16:02.034 EAL: No free 2048 kB hugepages reported on node 1 00:16:02.034 [2024-11-19 15:17:00.515122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:02.293 [2024-11-19 15:17:00.636772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:02.551 Running I/O for 10 seconds... 00:16:12.531 00:16:12.531 Latency(us) 00:16:12.531 [2024-11-19T14:17:11.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:12.531 [2024-11-19T14:17:11.094Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:12.531 Verification LBA range: start 0x0 length 0x1000 00:16:12.531 Nvme1n1 : 10.01 8618.04 67.33 0.00 0.00 14816.49 2014.63 20680.25 00:16:12.531 [2024-11-19T14:17:11.094Z] =================================================================================================================== 00:16:12.531 [2024-11-19T14:17:11.094Z] Total : 8618.04 67.33 0.00 0.00 14816.49 2014.63 20680.25 00:16:12.790 15:17:11 -- target/zcopy.sh@39 -- # perfpid=2764399 00:16:12.790 15:17:11 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:12.790 15:17:11 -- common/autotest_common.sh@10 -- # set +x 00:16:12.790 15:17:11 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:12.790 15:17:11 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:12.790 15:17:11 -- nvmf/common.sh@520 -- # config=() 00:16:12.790 15:17:11 -- nvmf/common.sh@520 -- # local subsystem config 00:16:12.790 15:17:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:12.790 15:17:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:12.790 { 00:16:12.790 "params": { 00:16:12.790 "name": "Nvme$subsystem", 00:16:12.790 "trtype": "$TEST_TRANSPORT", 00:16:12.790 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:12.790 "adrfam": "ipv4", 00:16:12.790 "trsvcid": "$NVMF_PORT", 00:16:12.790 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:12.790 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:12.790 "hdgst": ${hdgst:-false}, 00:16:12.790 "ddgst": ${ddgst:-false} 00:16:12.790 }, 00:16:12.790 "method": "bdev_nvme_attach_controller" 00:16:12.790 } 00:16:12.790 EOF 00:16:12.790 )") 00:16:12.790 [2024-11-19 15:17:11.314071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.790 [2024-11-19 15:17:11.314134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.790 15:17:11 -- nvmf/common.sh@542 -- # cat 00:16:12.790 15:17:11 -- nvmf/common.sh@544 -- # jq . 00:16:12.790 15:17:11 -- nvmf/common.sh@545 -- # IFS=, 00:16:12.790 15:17:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:12.790 "params": { 00:16:12.790 "name": "Nvme1", 00:16:12.790 "trtype": "tcp", 00:16:12.790 "traddr": "10.0.0.2", 00:16:12.790 "adrfam": "ipv4", 00:16:12.790 "trsvcid": "4420", 00:16:12.790 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:12.790 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:12.790 "hdgst": false, 00:16:12.790 "ddgst": false 00:16:12.790 }, 00:16:12.790 "method": "bdev_nvme_attach_controller" 00:16:12.790 }' 00:16:12.790 [2024-11-19 15:17:11.321999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.790 [2024-11-19 15:17:11.322026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.790 [2024-11-19 15:17:11.330018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.790 [2024-11-19 15:17:11.330043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.790 [2024-11-19 15:17:11.338037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.790 [2024-11-19 15:17:11.338061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.790 [2024-11-19 15:17:11.346058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.790 [2024-11-19 15:17:11.346083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.791 [2024-11-19 15:17:11.351828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:12.791 [2024-11-19 15:17:11.351894] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2764399 ] 00:16:13.050 [2024-11-19 15:17:11.354089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.050 [2024-11-19 15:17:11.354120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.050 [2024-11-19 15:17:11.362106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.050 [2024-11-19 15:17:11.362135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.050 [2024-11-19 15:17:11.370125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.370151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.378147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.378171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.051 [2024-11-19 15:17:11.386172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.386196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.394195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.394219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.402217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.402241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.410240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.410264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.418265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.418288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.419428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:13.051 [2024-11-19 15:17:11.426316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.426359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.434350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.434391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.442335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.442359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.450356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.450381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.458382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.458408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.466398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.466422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.474423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.474447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.482445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.482469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.490499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.490538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.498499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.498527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.506512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.506537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.514534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.514557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.522559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.522582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.530578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.530601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.538600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.538624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.541762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:13.051 [2024-11-19 15:17:11.546624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.546647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.554648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.554672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.562713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.562750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.570734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.570775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.578761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.578803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.586782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.586825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.594798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.594839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.602821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.602860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.051 [2024-11-19 15:17:11.610831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.051 [2024-11-19 15:17:11.610865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.310 [2024-11-19 15:17:11.618869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.310 [2024-11-19 15:17:11.618910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.310 [2024-11-19 15:17:11.626882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.310 [2024-11-19 15:17:11.626923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.310 [2024-11-19 15:17:11.634907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.310 [2024-11-19 15:17:11.634949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.310 [2024-11-19 15:17:11.642895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.310 [2024-11-19 15:17:11.642920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.310 [2024-11-19 15:17:11.650926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.310 [2024-11-19 15:17:11.650952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.659001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.659031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.666975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.667002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.675030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.675057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.683023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.683051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.691046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.691073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.699069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.699097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.707088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.707115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.715194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.715224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.723137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.723165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 Running I/O for 5 seconds... 00:16:13.311 [2024-11-19 15:17:11.731156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.731181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.745747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.745780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.757129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.757161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.768168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.768199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.778870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.778900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.790329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.790360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.801285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.801315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.812220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.812250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.822952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.822982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.833630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.833662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.844786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.844815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.857553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.857582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.311 [2024-11-19 15:17:11.867636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.311 [2024-11-19 15:17:11.867674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.879814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.879844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.893224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.893254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.904386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.904416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.915284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.915314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.926431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.926461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.939265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.939303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.949327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.949357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.960759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.960788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.973601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.973631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.983523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.983553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:11.995358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:11.995387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.006582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.006611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.017296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.017326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.027856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.027887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.038518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.038547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.049247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.049277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.060247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.060278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.073019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.073058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.083305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.083336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.094640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.094670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.105805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.105835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.116954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.116985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.570 [2024-11-19 15:17:12.128237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.570 [2024-11-19 15:17:12.128269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.140089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.140119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.153093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.153133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.163446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.163476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.174570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.174600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.187940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.187970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.198216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.198246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.208939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.208969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.220108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.220139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.231048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.231078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.243787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.243816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.254445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.254476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.265615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.265645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.278493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.278522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.288168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.288199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.299876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.299908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.311296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.311328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.323005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.323035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.333836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.333867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.345122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.345153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.356484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.356514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.367880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.367919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.379320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.379351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.830 [2024-11-19 15:17:12.390722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.830 [2024-11-19 15:17:12.390762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.402460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.402501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.413610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.413651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.424370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.424401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.435115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.435147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.445922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.445952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.456824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.456854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.468074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.468104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.479006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.479035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.489905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.489936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.501129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.501159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.512415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.512445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.523781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.523811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.534849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.534878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.545404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.545433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.556697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.556727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.567576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.567606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.578813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.578843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.589624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.589653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.600786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.600816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.611450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.611480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.622369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.622399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.634071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.634102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.090 [2024-11-19 15:17:12.644750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.090 [2024-11-19 15:17:12.644780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.656157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.656189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.669064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.669094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.679703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.679732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.690686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.690724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.701579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.701608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.712099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.712128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.722948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.722978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.733827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.733856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.746628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.746658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.756237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.756268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.767596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.767626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.778400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.778430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.789927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.789958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.800856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.800885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.811386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.811416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.822258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.822288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.350 [2024-11-19 15:17:12.832785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.350 [2024-11-19 15:17:12.832815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.843423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.843453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.854348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.854377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.867336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.867365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.877505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.877534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.888110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.888139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.899239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.899269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.351 [2024-11-19 15:17:12.910455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.351 [2024-11-19 15:17:12.910485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.922073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.922103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.933382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.933411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.946190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.946219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.956301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.956331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.966915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.966945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.979743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.979773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:12.990626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:12.990656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.001711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.001741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.014573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.014603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.025157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.025186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.036162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.036192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.047326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.047357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.058104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.058133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.070893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.070923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.080735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.080765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.092093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.092123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.105032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.105061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.115247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.115277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.126494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.126524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.139152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.139182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.148607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.148638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.160180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.160209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.610 [2024-11-19 15:17:13.171387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.610 [2024-11-19 15:17:13.171418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.182771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.182802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.196616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.196646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.207447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.207477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.218602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.218633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.229557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.229588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.242573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.242602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.252350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.252380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.264054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.264084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.275187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.275217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.285900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.285930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.298563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.298592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.308774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.308813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.319303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.319332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.331663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.331702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.341074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.341104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.352447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.352477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.363488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.363517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.374453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.374482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.387329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.387359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.397400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.397429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.408285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.408315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.420935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.420973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.870 [2024-11-19 15:17:13.431461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.870 [2024-11-19 15:17:13.431491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.442371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.442402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.452802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.452832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.463806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.463836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.475277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.475308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.486082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.486112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.499560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.499591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.510274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.510304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.521325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.521355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.534371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.534401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.545170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.545200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.556264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.556293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.569103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.569134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.579765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.579795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.590476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.590507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.601467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.601497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.612605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.612635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.625469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.625498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.635784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.635822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.646962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.646993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.659425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.659455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.669801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.669831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.129 [2024-11-19 15:17:13.680347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.129 [2024-11-19 15:17:13.680377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.130 [2024-11-19 15:17:13.691409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.130 [2024-11-19 15:17:13.691440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.702605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.702636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.713599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.713629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.726534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.726564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.736634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.736663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.747754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.747783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.758639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.758668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.769327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.769357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.780592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.780622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.793520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.793550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.804223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.804253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.814890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.814919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.827971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.828000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.837831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.837861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.849067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.849104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.861626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.861656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.872254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.872284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.882523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.882553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.893208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.893237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.903876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.903906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.914800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.914829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.925935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.925964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.938913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.938942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.389 [2024-11-19 15:17:13.949165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.389 [2024-11-19 15:17:13.949196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:13.960204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:13.960235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:13.973030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:13.973061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:13.982992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:13.983022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:13.993857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:13.993887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.006442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.006472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.016343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.016374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.027322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.027353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.038485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.038515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.049205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.049235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.062096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.062135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.072924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.072954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.083857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.083887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.094748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.094778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.105285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.105315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.116297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.116327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.126997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.127026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.139132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.139162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.148614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.148643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.159842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.159872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.170630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.170660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.181401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.181430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.194219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.194248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-19 15:17:14.204749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-19 15:17:14.204779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.905 [2024-11-19 15:17:14.216524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.905 [2024-11-19 15:17:14.216556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.905 [2024-11-19 15:17:14.229777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.229808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.240237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.240270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.251512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.251543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.262516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.262545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.274152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.274182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.285478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.285508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.299003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.299032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.309738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.309768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.320657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.320698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.333629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.333660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.344064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.344095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.354702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.354732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.365533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.365563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.376603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.376632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.389482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.389511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.399327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.399358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.410008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.410038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.420984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.421014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.432433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.432464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.443496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.443526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.454825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.454868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.906 [2024-11-19 15:17:14.466087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.906 [2024-11-19 15:17:14.466120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.477301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.477332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.488681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.488720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.499771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.499801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.510933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.510971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.523062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.523092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.532370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.532399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.544293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.544322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.555251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.555281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.566414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.566444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.577539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.577568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.588462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.588491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.601197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.601227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.612991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.613021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.622862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.622892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.634299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.634329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.645002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.645032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.656069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.656099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.667253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.667283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.678718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.678748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.689370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.689400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.700442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.700473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.713259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.713289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.165 [2024-11-19 15:17:14.723456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.165 [2024-11-19 15:17:14.723488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.424 [2024-11-19 15:17:14.735052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.424 [2024-11-19 15:17:14.735083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.745842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.745872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.756994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.757023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.770241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.770271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.780535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.780565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.791390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.791421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.804455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.804485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.814867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.814897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.825873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.825903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.838513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.838542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.847999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.848029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.859451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.859481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.872643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.872673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.882374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.882403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.893655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.893684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.904343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.904372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.915369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.915399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.928060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.928089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.938642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.938672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.949708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.949737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.962648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.962678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.972941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.972971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.425 [2024-11-19 15:17:14.984222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.425 [2024-11-19 15:17:14.984252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:14.995491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:14.995521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.006062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.006092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.017234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.017264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.028723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.028752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.039167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.039197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.050388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.050417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.063111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.063141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.073251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.073281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.084484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.084515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.097408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.097438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.107651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.107681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.119183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.119221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.130087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.130117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.140857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.140887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.151468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.151499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.162301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.162330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.173156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.173186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.186058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.186090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.196501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.196532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.207417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.207447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.220081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.684 [2024-11-19 15:17:15.220111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.684 [2024-11-19 15:17:15.230033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.685 [2024-11-19 15:17:15.230063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.685 [2024-11-19 15:17:15.240610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.685 [2024-11-19 15:17:15.240639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.252119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.252151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.262919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.262949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.275190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.275220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.284745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.284775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.296381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.296410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.307350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.307379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.318554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.318584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.331984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.332022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.342612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.342642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.352797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.352826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.363227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.363257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.374045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.374075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.384875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.384905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.395626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.395656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.408179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.408209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.418375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.418404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.429501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.429531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.440524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.440553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.451661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.451700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.464672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.464711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.475356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.475385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.486479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.486510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.944 [2024-11-19 15:17:15.499671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.944 [2024-11-19 15:17:15.499714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.510308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.510339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.521227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.521257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.532551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.532582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.543462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.543499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.556201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.556232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.566349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.566378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.577247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.577277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.588759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.588789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.599966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.599995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.613070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.613100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.623296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.623327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.634704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.634734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.203 [2024-11-19 15:17:15.645876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.203 [2024-11-19 15:17:15.645906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.658718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.658747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.668832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.668863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.680080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.680110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.691140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.691171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.702057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.702086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.712925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.712954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.724067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.724097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.735554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.735584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.746602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.746633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.204 [2024-11-19 15:17:15.757457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.204 [2024-11-19 15:17:15.757496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.462 [2024-11-19 15:17:15.769115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.462 [2024-11-19 15:17:15.769146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.462 [2024-11-19 15:17:15.780777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.462 [2024-11-19 15:17:15.780807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.462 [2024-11-19 15:17:15.791985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.462 [2024-11-19 15:17:15.792016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.462 [2024-11-19 15:17:15.803008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.462 [2024-11-19 15:17:15.803038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.462 [2024-11-19 15:17:15.813961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.813992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.824884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.824914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.836594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.836624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.847598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.847640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.860539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.860569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.871034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.871064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.882124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.882154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.893325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.893356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.904194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.904224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.916801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.916839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.926468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.926498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.938244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.938274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.948770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.948800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.959701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.959731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.972554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.972584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.983138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.983168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:15.994373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:15.994403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:16.006909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:16.006939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.463 [2024-11-19 15:17:16.017114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.463 [2024-11-19 15:17:16.017143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.028600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.028630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.039595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.039625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.050635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.050665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.063608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.063638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.074490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.074520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.085957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.085987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.097227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.097256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.108563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.108592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.121397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.121427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.132002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.132031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.142987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.143016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.155790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.155820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.165684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.165723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.176498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.176527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.189193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.189223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.199668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.199707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.210562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.210592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.221450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.221480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.232343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.232373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.245280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.245310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.254708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.254737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.266083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.266115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.722 [2024-11-19 15:17:16.276808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.722 [2024-11-19 15:17:16.276847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.981 [2024-11-19 15:17:16.287998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.981 [2024-11-19 15:17:16.288028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.981 [2024-11-19 15:17:16.300802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.981 [2024-11-19 15:17:16.300832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.981 [2024-11-19 15:17:16.310900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.310931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.321640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.321670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.332569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.332598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.343112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.343141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.355982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.356011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.366169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.366199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.376894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.376923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.387470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.387499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.398513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.398543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.411209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.411238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.420611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.420641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.432069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.432098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.444312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.444342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.454242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.454271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.464996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.465026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.476323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.476353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.487109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.487139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.500220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.500250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.510658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.510699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.521426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.521456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.982 [2024-11-19 15:17:16.534125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.982 [2024-11-19 15:17:16.534156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.543961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.543996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.555471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.555502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.566499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.566530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.577470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.577501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.590279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.590308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.600994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.601024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.611288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.611318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.622515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.622544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.633588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.633618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.646247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.646277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.656274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.656304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.667313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.667343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.678497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.678527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.689519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.689550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.700455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.700487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.711647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.711677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.724104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.724133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.734328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.734359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.744952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.744981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 00:16:18.241 Latency(us) 00:16:18.241 [2024-11-19T14:17:16.804Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:18.241 [2024-11-19T14:17:16.804Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:18.241 Nvme1n1 : 5.01 11566.15 90.36 0.00 0.00 11050.78 4611.79 25049.32 00:16:18.241 [2024-11-19T14:17:16.804Z] =================================================================================================================== 00:16:18.241 [2024-11-19T14:17:16.804Z] Total : 11566.15 90.36 0.00 0.00 11050.78 4611.79 25049.32 00:16:18.241 [2024-11-19 15:17:16.756347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.756378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.764408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.764435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.772428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.772468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.780510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.780560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.788519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.788569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.241 [2024-11-19 15:17:16.796544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.241 [2024-11-19 15:17:16.796594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.804578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.804631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.812607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.812665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.820611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.820662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.828631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.828680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.836664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.836724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.844702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.844755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.852724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.852779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.860732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.860782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.868757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.868808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.876793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.876844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.884773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.884805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.892766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.892792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.900782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.900806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.908803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.908828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.916824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.500 [2024-11-19 15:17:16.916849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.500 [2024-11-19 15:17:16.924890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.924950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.932924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.932971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.940931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.940973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.948919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.948945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.956943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.956975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.964965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.965000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.972986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.973014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.981042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.981089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.989081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.989126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:16.997105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:16.997148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:17.005072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:17.005096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 [2024-11-19 15:17:17.013093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.501 [2024-11-19 15:17:17.013117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.501 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2764399) - No such process 00:16:18.501 15:17:17 -- target/zcopy.sh@49 -- # wait 2764399 00:16:18.501 15:17:17 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:18.501 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.501 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:16:18.501 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.501 15:17:17 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:18.501 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.501 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:16:18.501 delay0 00:16:18.501 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.501 15:17:17 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:18.501 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.501 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:16:18.501 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.501 15:17:17 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:18.759 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.760 [2024-11-19 15:17:17.132546] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:26.879 [2024-11-19 15:17:24.211609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2195b40 is same with the state(5) to be set 00:16:26.879 Initializing NVMe Controllers 00:16:26.879 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:26.879 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:26.879 Initialization complete. Launching workers. 00:16:26.879 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 265, failed: 12984 00:16:26.879 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 13172, failed to submit 77 00:16:26.879 success 13053, unsuccess 119, failed 0 00:16:26.879 15:17:24 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:26.879 15:17:24 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:26.879 15:17:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:26.879 15:17:24 -- nvmf/common.sh@116 -- # sync 00:16:26.879 15:17:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:26.879 15:17:24 -- nvmf/common.sh@119 -- # set +e 00:16:26.879 15:17:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:26.879 15:17:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:26.879 rmmod nvme_tcp 00:16:26.879 rmmod nvme_fabrics 00:16:26.879 rmmod nvme_keyring 00:16:26.879 15:17:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:26.879 15:17:24 -- nvmf/common.sh@123 -- # set -e 00:16:26.879 15:17:24 -- nvmf/common.sh@124 -- # return 0 00:16:26.879 15:17:24 -- nvmf/common.sh@477 -- # '[' -n 2762885 ']' 00:16:26.879 15:17:24 -- nvmf/common.sh@478 -- # killprocess 2762885 00:16:26.879 15:17:24 -- common/autotest_common.sh@936 -- # '[' -z 2762885 ']' 00:16:26.879 15:17:24 -- common/autotest_common.sh@940 -- # kill -0 2762885 00:16:26.879 15:17:24 -- common/autotest_common.sh@941 -- # uname 00:16:26.879 15:17:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:26.879 15:17:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2762885 00:16:26.879 15:17:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:26.879 15:17:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:26.879 15:17:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2762885' 00:16:26.879 killing process with pid 2762885 00:16:26.879 15:17:24 -- common/autotest_common.sh@955 -- # kill 2762885 00:16:26.879 15:17:24 -- common/autotest_common.sh@960 -- # wait 2762885 00:16:26.879 15:17:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:26.879 15:17:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:26.879 15:17:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:26.879 15:17:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:26.879 15:17:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:26.879 15:17:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.879 15:17:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.879 15:17:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.260 15:17:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:28.260 00:16:28.260 real 0m29.646s 00:16:28.260 user 0m42.266s 00:16:28.260 sys 0m9.394s 00:16:28.260 15:17:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.260 15:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:28.260 ************************************ 00:16:28.260 END TEST nvmf_zcopy 00:16:28.260 ************************************ 00:16:28.260 15:17:26 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:28.260 15:17:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.260 15:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:28.260 ************************************ 00:16:28.260 START TEST nvmf_nmic 00:16:28.260 ************************************ 00:16:28.260 15:17:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:28.260 * Looking for test storage... 00:16:28.260 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.260 15:17:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.260 15:17:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.260 15:17:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.260 15:17:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.260 15:17:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.260 15:17:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.260 15:17:26 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.260 15:17:26 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.260 15:17:26 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.260 15:17:26 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.260 15:17:26 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.260 15:17:26 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.260 15:17:26 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.260 15:17:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.260 15:17:26 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.260 15:17:26 -- scripts/common.sh@344 -- # : 1 00:16:28.260 15:17:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.260 15:17:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.260 15:17:26 -- scripts/common.sh@364 -- # decimal 1 00:16:28.260 15:17:26 -- scripts/common.sh@352 -- # local d=1 00:16:28.260 15:17:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.260 15:17:26 -- scripts/common.sh@354 -- # echo 1 00:16:28.260 15:17:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.260 15:17:26 -- scripts/common.sh@365 -- # decimal 2 00:16:28.260 15:17:26 -- scripts/common.sh@352 -- # local d=2 00:16:28.260 15:17:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.260 15:17:26 -- scripts/common.sh@354 -- # echo 2 00:16:28.260 15:17:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.260 15:17:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.260 15:17:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.260 15:17:26 -- scripts/common.sh@367 -- # return 0 00:16:28.260 15:17:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.260 --rc genhtml_branch_coverage=1 00:16:28.260 --rc genhtml_function_coverage=1 00:16:28.260 --rc genhtml_legend=1 00:16:28.260 --rc geninfo_all_blocks=1 00:16:28.260 --rc geninfo_unexecuted_blocks=1 00:16:28.260 00:16:28.260 ' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.260 --rc genhtml_branch_coverage=1 00:16:28.260 --rc genhtml_function_coverage=1 00:16:28.260 --rc genhtml_legend=1 00:16:28.260 --rc geninfo_all_blocks=1 00:16:28.260 --rc geninfo_unexecuted_blocks=1 00:16:28.260 00:16:28.260 ' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.260 --rc genhtml_branch_coverage=1 00:16:28.260 --rc genhtml_function_coverage=1 00:16:28.260 --rc genhtml_legend=1 00:16:28.260 --rc geninfo_all_blocks=1 00:16:28.260 --rc geninfo_unexecuted_blocks=1 00:16:28.260 00:16:28.260 ' 00:16:28.260 15:17:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.260 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.260 --rc genhtml_branch_coverage=1 00:16:28.260 --rc genhtml_function_coverage=1 00:16:28.260 --rc genhtml_legend=1 00:16:28.260 --rc geninfo_all_blocks=1 00:16:28.260 --rc geninfo_unexecuted_blocks=1 00:16:28.260 00:16:28.260 ' 00:16:28.260 15:17:26 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.260 15:17:26 -- nvmf/common.sh@7 -- # uname -s 00:16:28.260 15:17:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.260 15:17:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.260 15:17:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.260 15:17:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.260 15:17:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.260 15:17:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.260 15:17:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.260 15:17:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.260 15:17:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.260 15:17:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.520 15:17:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.520 15:17:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.520 15:17:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.520 15:17:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.520 15:17:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.520 15:17:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.520 15:17:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.520 15:17:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.520 15:17:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.520 15:17:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.520 15:17:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.520 15:17:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.520 15:17:26 -- paths/export.sh@5 -- # export PATH 00:16:28.520 15:17:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.520 15:17:26 -- nvmf/common.sh@46 -- # : 0 00:16:28.520 15:17:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.520 15:17:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.520 15:17:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.520 15:17:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.520 15:17:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.520 15:17:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.520 15:17:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.520 15:17:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.520 15:17:26 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:28.520 15:17:26 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:28.520 15:17:26 -- target/nmic.sh@14 -- # nvmftestinit 00:16:28.520 15:17:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:28.520 15:17:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:28.520 15:17:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:28.520 15:17:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:28.520 15:17:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:28.520 15:17:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:28.520 15:17:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:28.520 15:17:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.520 15:17:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:28.520 15:17:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:28.520 15:17:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:28.520 15:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:30.422 15:17:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:30.422 15:17:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:30.422 15:17:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:30.422 15:17:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:30.422 15:17:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:30.422 15:17:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:30.422 15:17:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:30.422 15:17:28 -- nvmf/common.sh@294 -- # net_devs=() 00:16:30.422 15:17:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:30.422 15:17:28 -- nvmf/common.sh@295 -- # e810=() 00:16:30.422 15:17:28 -- nvmf/common.sh@295 -- # local -ga e810 00:16:30.422 15:17:28 -- nvmf/common.sh@296 -- # x722=() 00:16:30.422 15:17:28 -- nvmf/common.sh@296 -- # local -ga x722 00:16:30.422 15:17:28 -- nvmf/common.sh@297 -- # mlx=() 00:16:30.422 15:17:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:30.422 15:17:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:30.422 15:17:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:30.422 15:17:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:30.422 15:17:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:30.422 15:17:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.422 15:17:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:30.422 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:30.422 15:17:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.422 15:17:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:30.422 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:30.422 15:17:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:30.422 15:17:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:30.422 15:17:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.422 15:17:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.422 15:17:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.422 15:17:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.422 15:17:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:30.422 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:30.423 15:17:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.423 15:17:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.423 15:17:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.423 15:17:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.423 15:17:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.423 15:17:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:30.423 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:30.423 15:17:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.423 15:17:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:30.423 15:17:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:30.423 15:17:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:30.423 15:17:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:30.423 15:17:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:30.423 15:17:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:30.423 15:17:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:30.423 15:17:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:30.423 15:17:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:30.423 15:17:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:30.423 15:17:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:30.423 15:17:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:30.423 15:17:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:30.423 15:17:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:30.423 15:17:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:30.423 15:17:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:30.423 15:17:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:30.423 15:17:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:30.423 15:17:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:30.423 15:17:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:30.423 15:17:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:30.423 15:17:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:30.681 15:17:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:30.681 15:17:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:30.681 15:17:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:30.681 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:30.681 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:16:30.681 00:16:30.681 --- 10.0.0.2 ping statistics --- 00:16:30.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.681 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:16:30.681 15:17:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:30.681 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:30.681 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:16:30.681 00:16:30.681 --- 10.0.0.1 ping statistics --- 00:16:30.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.681 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:16:30.681 15:17:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:30.681 15:17:29 -- nvmf/common.sh@410 -- # return 0 00:16:30.681 15:17:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:30.681 15:17:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:30.681 15:17:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:30.681 15:17:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:30.681 15:17:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:30.681 15:17:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:30.681 15:17:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:30.681 15:17:29 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:30.681 15:17:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:30.681 15:17:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:30.681 15:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:30.681 15:17:29 -- nvmf/common.sh@469 -- # nvmfpid=2767848 00:16:30.681 15:17:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:30.681 15:17:29 -- nvmf/common.sh@470 -- # waitforlisten 2767848 00:16:30.681 15:17:29 -- common/autotest_common.sh@829 -- # '[' -z 2767848 ']' 00:16:30.681 15:17:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:30.681 15:17:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:30.681 15:17:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:30.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:30.681 15:17:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:30.681 15:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:30.681 [2024-11-19 15:17:29.217678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:30.681 [2024-11-19 15:17:29.217768] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:30.940 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.940 [2024-11-19 15:17:29.291543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:30.940 [2024-11-19 15:17:29.413337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:30.940 [2024-11-19 15:17:29.413506] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:30.940 [2024-11-19 15:17:29.413524] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:30.940 [2024-11-19 15:17:29.413536] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:30.940 [2024-11-19 15:17:29.413608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:30.940 [2024-11-19 15:17:29.413822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:30.940 [2024-11-19 15:17:29.413848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:30.940 [2024-11-19 15:17:29.413851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:31.876 15:17:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:31.876 15:17:30 -- common/autotest_common.sh@862 -- # return 0 00:16:31.876 15:17:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:31.876 15:17:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 15:17:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:31.876 15:17:30 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 [2024-11-19 15:17:30.275497] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 Malloc0 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 [2024-11-19 15:17:30.329460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:31.876 test case1: single bdev can't be used in multiple subsystems 00:16:31.876 15:17:30 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@28 -- # nmic_status=0 00:16:31.876 15:17:30 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 [2024-11-19 15:17:30.353317] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:31.876 [2024-11-19 15:17:30.353346] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:31.876 [2024-11-19 15:17:30.353383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:31.876 request: 00:16:31.876 { 00:16:31.876 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:31.876 "namespace": { 00:16:31.876 "bdev_name": "Malloc0" 00:16:31.876 }, 00:16:31.876 "method": "nvmf_subsystem_add_ns", 00:16:31.876 "req_id": 1 00:16:31.876 } 00:16:31.876 Got JSON-RPC error response 00:16:31.876 response: 00:16:31.876 { 00:16:31.876 "code": -32602, 00:16:31.876 "message": "Invalid parameters" 00:16:31.876 } 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@29 -- # nmic_status=1 00:16:31.876 15:17:30 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:31.876 15:17:30 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:31.876 Adding namespace failed - expected result. 00:16:31.876 15:17:30 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:31.876 test case2: host connect to nvmf target in multiple paths 00:16:31.876 15:17:30 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:31.876 15:17:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.876 15:17:30 -- common/autotest_common.sh@10 -- # set +x 00:16:31.876 [2024-11-19 15:17:30.361471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:31.876 15:17:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.876 15:17:30 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:32.442 15:17:30 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:33.376 15:17:31 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:33.376 15:17:31 -- common/autotest_common.sh@1187 -- # local i=0 00:16:33.376 15:17:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:33.376 15:17:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:33.376 15:17:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:35.276 15:17:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:35.276 15:17:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:35.276 15:17:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:35.276 15:17:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:35.276 15:17:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:35.276 15:17:33 -- common/autotest_common.sh@1197 -- # return 0 00:16:35.276 15:17:33 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:35.276 [global] 00:16:35.276 thread=1 00:16:35.276 invalidate=1 00:16:35.276 rw=write 00:16:35.276 time_based=1 00:16:35.276 runtime=1 00:16:35.276 ioengine=libaio 00:16:35.276 direct=1 00:16:35.276 bs=4096 00:16:35.276 iodepth=1 00:16:35.276 norandommap=0 00:16:35.276 numjobs=1 00:16:35.276 00:16:35.276 verify_dump=1 00:16:35.276 verify_backlog=512 00:16:35.276 verify_state_save=0 00:16:35.276 do_verify=1 00:16:35.276 verify=crc32c-intel 00:16:35.276 [job0] 00:16:35.276 filename=/dev/nvme0n1 00:16:35.276 Could not set queue depth (nvme0n1) 00:16:35.539 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:35.539 fio-3.35 00:16:35.539 Starting 1 thread 00:16:36.915 00:16:36.915 job0: (groupid=0, jobs=1): err= 0: pid=2768529: Tue Nov 19 15:17:35 2024 00:16:36.915 read: IOPS=150, BW=604KiB/s (618kB/s)(620KiB/1027msec) 00:16:36.915 slat (nsec): min=10232, max=38895, avg=15216.87, stdev=7278.94 00:16:36.915 clat (usec): min=194, max=42000, avg=5859.62, stdev=14232.25 00:16:36.915 lat (usec): min=206, max=42034, avg=5874.84, stdev=14238.51 00:16:36.915 clat percentiles (usec): 00:16:36.915 | 1.00th=[ 196], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:16:36.915 | 30.00th=[ 215], 40.00th=[ 221], 50.00th=[ 265], 60.00th=[ 273], 00:16:36.915 | 70.00th=[ 281], 80.00th=[ 285], 90.00th=[41681], 95.00th=[42206], 00:16:36.915 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:36.915 | 99.99th=[42206] 00:16:36.915 write: IOPS=498, BW=1994KiB/s (2042kB/s)(2048KiB/1027msec); 0 zone resets 00:16:36.915 slat (usec): min=6, max=27637, avg=69.78, stdev=1220.75 00:16:36.915 clat (usec): min=128, max=547, avg=150.55, stdev=21.85 00:16:36.915 lat (usec): min=135, max=27867, avg=220.33, stdev=1224.45 00:16:36.915 clat percentiles (usec): 00:16:36.915 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 139], 20.00th=[ 141], 00:16:36.915 | 30.00th=[ 145], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 151], 00:16:36.915 | 70.00th=[ 153], 80.00th=[ 157], 90.00th=[ 161], 95.00th=[ 167], 00:16:36.915 | 99.00th=[ 208], 99.50th=[ 255], 99.90th=[ 545], 99.95th=[ 545], 00:16:36.915 | 99.99th=[ 545] 00:16:36.915 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:36.915 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:36.915 lat (usec) : 250=86.06%, 500=10.64%, 750=0.15% 00:16:36.915 lat (msec) : 50=3.15% 00:16:36.915 cpu : usr=0.88%, sys=0.68%, ctx=671, majf=0, minf=1 00:16:36.915 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:36.915 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.915 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:36.915 issued rwts: total=155,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:36.915 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:36.915 00:16:36.915 Run status group 0 (all jobs): 00:16:36.915 READ: bw=604KiB/s (618kB/s), 604KiB/s-604KiB/s (618kB/s-618kB/s), io=620KiB (635kB), run=1027-1027msec 00:16:36.915 WRITE: bw=1994KiB/s (2042kB/s), 1994KiB/s-1994KiB/s (2042kB/s-2042kB/s), io=2048KiB (2097kB), run=1027-1027msec 00:16:36.915 00:16:36.915 Disk stats (read/write): 00:16:36.915 nvme0n1: ios=203/512, merge=0/0, ticks=1832/72, in_queue=1904, util=98.60% 00:16:36.915 15:17:35 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:36.915 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:36.915 15:17:35 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:36.915 15:17:35 -- common/autotest_common.sh@1208 -- # local i=0 00:16:36.915 15:17:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:36.915 15:17:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:36.915 15:17:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:36.915 15:17:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:36.915 15:17:35 -- common/autotest_common.sh@1220 -- # return 0 00:16:36.915 15:17:35 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:36.915 15:17:35 -- target/nmic.sh@53 -- # nvmftestfini 00:16:36.915 15:17:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:36.915 15:17:35 -- nvmf/common.sh@116 -- # sync 00:16:36.915 15:17:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:36.915 15:17:35 -- nvmf/common.sh@119 -- # set +e 00:16:36.915 15:17:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:36.915 15:17:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:36.915 rmmod nvme_tcp 00:16:36.915 rmmod nvme_fabrics 00:16:36.915 rmmod nvme_keyring 00:16:36.915 15:17:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:36.915 15:17:35 -- nvmf/common.sh@123 -- # set -e 00:16:36.915 15:17:35 -- nvmf/common.sh@124 -- # return 0 00:16:36.915 15:17:35 -- nvmf/common.sh@477 -- # '[' -n 2767848 ']' 00:16:36.915 15:17:35 -- nvmf/common.sh@478 -- # killprocess 2767848 00:16:36.915 15:17:35 -- common/autotest_common.sh@936 -- # '[' -z 2767848 ']' 00:16:36.915 15:17:35 -- common/autotest_common.sh@940 -- # kill -0 2767848 00:16:36.915 15:17:35 -- common/autotest_common.sh@941 -- # uname 00:16:36.915 15:17:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:36.915 15:17:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2767848 00:16:36.915 15:17:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:36.915 15:17:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:36.915 15:17:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2767848' 00:16:36.915 killing process with pid 2767848 00:16:36.915 15:17:35 -- common/autotest_common.sh@955 -- # kill 2767848 00:16:36.915 15:17:35 -- common/autotest_common.sh@960 -- # wait 2767848 00:16:37.174 15:17:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:37.174 15:17:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:37.174 15:17:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:37.174 15:17:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:37.174 15:17:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:37.174 15:17:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:37.174 15:17:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:37.174 15:17:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:39.150 15:17:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:39.150 00:16:39.150 real 0m10.984s 00:16:39.150 user 0m25.831s 00:16:39.150 sys 0m2.410s 00:16:39.150 15:17:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:39.150 15:17:37 -- common/autotest_common.sh@10 -- # set +x 00:16:39.150 ************************************ 00:16:39.150 END TEST nvmf_nmic 00:16:39.150 ************************************ 00:16:39.150 15:17:37 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:39.150 15:17:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:39.150 15:17:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:39.150 15:17:37 -- common/autotest_common.sh@10 -- # set +x 00:16:39.150 ************************************ 00:16:39.150 START TEST nvmf_fio_target 00:16:39.150 ************************************ 00:16:39.150 15:17:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:39.409 * Looking for test storage... 00:16:39.409 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:39.409 15:17:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:39.409 15:17:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:39.409 15:17:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:39.409 15:17:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:39.409 15:17:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:39.409 15:17:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:39.409 15:17:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:39.409 15:17:37 -- scripts/common.sh@335 -- # IFS=.-: 00:16:39.409 15:17:37 -- scripts/common.sh@335 -- # read -ra ver1 00:16:39.409 15:17:37 -- scripts/common.sh@336 -- # IFS=.-: 00:16:39.409 15:17:37 -- scripts/common.sh@336 -- # read -ra ver2 00:16:39.409 15:17:37 -- scripts/common.sh@337 -- # local 'op=<' 00:16:39.409 15:17:37 -- scripts/common.sh@339 -- # ver1_l=2 00:16:39.409 15:17:37 -- scripts/common.sh@340 -- # ver2_l=1 00:16:39.409 15:17:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:39.409 15:17:37 -- scripts/common.sh@343 -- # case "$op" in 00:16:39.409 15:17:37 -- scripts/common.sh@344 -- # : 1 00:16:39.409 15:17:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:39.409 15:17:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:39.409 15:17:37 -- scripts/common.sh@364 -- # decimal 1 00:16:39.409 15:17:37 -- scripts/common.sh@352 -- # local d=1 00:16:39.409 15:17:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:39.409 15:17:37 -- scripts/common.sh@354 -- # echo 1 00:16:39.409 15:17:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:39.409 15:17:37 -- scripts/common.sh@365 -- # decimal 2 00:16:39.409 15:17:37 -- scripts/common.sh@352 -- # local d=2 00:16:39.409 15:17:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:39.409 15:17:37 -- scripts/common.sh@354 -- # echo 2 00:16:39.409 15:17:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:39.409 15:17:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:39.409 15:17:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:39.409 15:17:37 -- scripts/common.sh@367 -- # return 0 00:16:39.409 15:17:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:39.409 15:17:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:39.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.409 --rc genhtml_branch_coverage=1 00:16:39.409 --rc genhtml_function_coverage=1 00:16:39.409 --rc genhtml_legend=1 00:16:39.409 --rc geninfo_all_blocks=1 00:16:39.409 --rc geninfo_unexecuted_blocks=1 00:16:39.409 00:16:39.409 ' 00:16:39.409 15:17:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:39.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.409 --rc genhtml_branch_coverage=1 00:16:39.409 --rc genhtml_function_coverage=1 00:16:39.409 --rc genhtml_legend=1 00:16:39.409 --rc geninfo_all_blocks=1 00:16:39.409 --rc geninfo_unexecuted_blocks=1 00:16:39.409 00:16:39.409 ' 00:16:39.409 15:17:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:39.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.409 --rc genhtml_branch_coverage=1 00:16:39.409 --rc genhtml_function_coverage=1 00:16:39.409 --rc genhtml_legend=1 00:16:39.409 --rc geninfo_all_blocks=1 00:16:39.409 --rc geninfo_unexecuted_blocks=1 00:16:39.409 00:16:39.409 ' 00:16:39.409 15:17:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:39.409 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.409 --rc genhtml_branch_coverage=1 00:16:39.409 --rc genhtml_function_coverage=1 00:16:39.409 --rc genhtml_legend=1 00:16:39.409 --rc geninfo_all_blocks=1 00:16:39.409 --rc geninfo_unexecuted_blocks=1 00:16:39.409 00:16:39.409 ' 00:16:39.409 15:17:37 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:39.409 15:17:37 -- nvmf/common.sh@7 -- # uname -s 00:16:39.409 15:17:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:39.409 15:17:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:39.409 15:17:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:39.409 15:17:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:39.409 15:17:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:39.409 15:17:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:39.409 15:17:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:39.409 15:17:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:39.409 15:17:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:39.409 15:17:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:39.409 15:17:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.409 15:17:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.409 15:17:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:39.409 15:17:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:39.409 15:17:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:39.409 15:17:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:39.409 15:17:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:39.409 15:17:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:39.409 15:17:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:39.409 15:17:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.409 15:17:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.409 15:17:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.409 15:17:37 -- paths/export.sh@5 -- # export PATH 00:16:39.410 15:17:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.410 15:17:37 -- nvmf/common.sh@46 -- # : 0 00:16:39.410 15:17:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:39.410 15:17:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:39.410 15:17:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:39.410 15:17:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:39.410 15:17:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:39.410 15:17:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:39.410 15:17:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:39.410 15:17:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:39.410 15:17:37 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:39.410 15:17:37 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:39.410 15:17:37 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:39.410 15:17:37 -- target/fio.sh@16 -- # nvmftestinit 00:16:39.410 15:17:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:39.410 15:17:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:39.410 15:17:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:39.410 15:17:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:39.410 15:17:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:39.410 15:17:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:39.410 15:17:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:39.410 15:17:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:39.410 15:17:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:39.410 15:17:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:39.410 15:17:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:39.410 15:17:37 -- common/autotest_common.sh@10 -- # set +x 00:16:41.311 15:17:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:41.311 15:17:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:41.311 15:17:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:41.311 15:17:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:41.311 15:17:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:41.311 15:17:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:41.311 15:17:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:41.311 15:17:39 -- nvmf/common.sh@294 -- # net_devs=() 00:16:41.311 15:17:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:41.311 15:17:39 -- nvmf/common.sh@295 -- # e810=() 00:16:41.311 15:17:39 -- nvmf/common.sh@295 -- # local -ga e810 00:16:41.311 15:17:39 -- nvmf/common.sh@296 -- # x722=() 00:16:41.311 15:17:39 -- nvmf/common.sh@296 -- # local -ga x722 00:16:41.311 15:17:39 -- nvmf/common.sh@297 -- # mlx=() 00:16:41.311 15:17:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:41.311 15:17:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:41.311 15:17:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:41.311 15:17:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:41.311 15:17:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:41.312 15:17:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:41.312 15:17:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:41.312 15:17:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:41.312 15:17:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:41.312 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:41.312 15:17:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:41.312 15:17:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:41.312 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:41.312 15:17:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:41.312 15:17:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.312 15:17:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.312 15:17:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:41.312 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:41.312 15:17:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.312 15:17:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:41.312 15:17:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.312 15:17:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.312 15:17:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:41.312 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:41.312 15:17:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.312 15:17:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:41.312 15:17:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:41.312 15:17:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:41.312 15:17:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:41.312 15:17:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:41.312 15:17:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:41.312 15:17:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:41.312 15:17:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:41.312 15:17:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:41.312 15:17:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:41.312 15:17:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:41.312 15:17:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:41.312 15:17:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:41.312 15:17:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:41.312 15:17:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:41.312 15:17:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:41.571 15:17:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:41.571 15:17:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:41.571 15:17:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:41.571 15:17:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:41.571 15:17:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:41.571 15:17:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:41.571 15:17:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:41.571 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:41.571 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:16:41.571 00:16:41.571 --- 10.0.0.2 ping statistics --- 00:16:41.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:41.571 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:16:41.571 15:17:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:41.571 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:41.571 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:16:41.571 00:16:41.571 --- 10.0.0.1 ping statistics --- 00:16:41.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:41.571 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:16:41.571 15:17:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:41.571 15:17:39 -- nvmf/common.sh@410 -- # return 0 00:16:41.571 15:17:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:41.571 15:17:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:41.571 15:17:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:41.571 15:17:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:41.571 15:17:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:41.571 15:17:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:41.571 15:17:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:41.571 15:17:40 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:41.571 15:17:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:41.571 15:17:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:41.571 15:17:40 -- common/autotest_common.sh@10 -- # set +x 00:16:41.571 15:17:40 -- nvmf/common.sh@469 -- # nvmfpid=2770737 00:16:41.571 15:17:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:41.571 15:17:40 -- nvmf/common.sh@470 -- # waitforlisten 2770737 00:16:41.571 15:17:40 -- common/autotest_common.sh@829 -- # '[' -z 2770737 ']' 00:16:41.571 15:17:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:41.571 15:17:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:41.571 15:17:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:41.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:41.571 15:17:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:41.571 15:17:40 -- common/autotest_common.sh@10 -- # set +x 00:16:41.571 [2024-11-19 15:17:40.059163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:41.571 [2024-11-19 15:17:40.059248] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:41.571 EAL: No free 2048 kB hugepages reported on node 1 00:16:41.571 [2024-11-19 15:17:40.131831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:41.830 [2024-11-19 15:17:40.251404] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:41.830 [2024-11-19 15:17:40.251579] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:41.830 [2024-11-19 15:17:40.251598] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:41.830 [2024-11-19 15:17:40.251612] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:41.830 [2024-11-19 15:17:40.251699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:41.830 [2024-11-19 15:17:40.251742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:41.830 [2024-11-19 15:17:40.251798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:41.830 [2024-11-19 15:17:40.251801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:42.764 15:17:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:42.764 15:17:41 -- common/autotest_common.sh@862 -- # return 0 00:16:42.764 15:17:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:42.764 15:17:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:42.764 15:17:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.764 15:17:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:42.764 15:17:41 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:42.764 [2024-11-19 15:17:41.285113] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:42.764 15:17:41 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:43.023 15:17:41 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:43.023 15:17:41 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:43.282 15:17:41 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:43.282 15:17:41 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:43.849 15:17:42 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:43.849 15:17:42 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:43.849 15:17:42 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:43.849 15:17:42 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:44.107 15:17:42 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.366 15:17:42 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:44.366 15:17:42 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.625 15:17:43 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:44.625 15:17:43 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:44.883 15:17:43 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:44.883 15:17:43 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:45.141 15:17:43 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:45.400 15:17:43 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:45.400 15:17:43 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:45.658 15:17:44 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:45.658 15:17:44 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:45.916 15:17:44 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:46.173 [2024-11-19 15:17:44.660886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:46.173 15:17:44 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:46.431 15:17:44 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:46.690 15:17:45 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:47.256 15:17:45 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:47.256 15:17:45 -- common/autotest_common.sh@1187 -- # local i=0 00:16:47.256 15:17:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:47.256 15:17:45 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:47.256 15:17:45 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:47.256 15:17:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:49.783 15:17:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:49.783 15:17:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:49.783 15:17:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:49.783 15:17:47 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:49.783 15:17:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:49.783 15:17:47 -- common/autotest_common.sh@1197 -- # return 0 00:16:49.783 15:17:47 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:49.783 [global] 00:16:49.783 thread=1 00:16:49.783 invalidate=1 00:16:49.783 rw=write 00:16:49.783 time_based=1 00:16:49.783 runtime=1 00:16:49.783 ioengine=libaio 00:16:49.783 direct=1 00:16:49.783 bs=4096 00:16:49.783 iodepth=1 00:16:49.783 norandommap=0 00:16:49.783 numjobs=1 00:16:49.783 00:16:49.783 verify_dump=1 00:16:49.783 verify_backlog=512 00:16:49.783 verify_state_save=0 00:16:49.783 do_verify=1 00:16:49.783 verify=crc32c-intel 00:16:49.783 [job0] 00:16:49.783 filename=/dev/nvme0n1 00:16:49.783 [job1] 00:16:49.783 filename=/dev/nvme0n2 00:16:49.783 [job2] 00:16:49.783 filename=/dev/nvme0n3 00:16:49.783 [job3] 00:16:49.783 filename=/dev/nvme0n4 00:16:49.783 Could not set queue depth (nvme0n1) 00:16:49.783 Could not set queue depth (nvme0n2) 00:16:49.783 Could not set queue depth (nvme0n3) 00:16:49.784 Could not set queue depth (nvme0n4) 00:16:49.784 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.784 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.784 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.784 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.784 fio-3.35 00:16:49.784 Starting 4 threads 00:16:50.716 00:16:50.716 job0: (groupid=0, jobs=1): err= 0: pid=2771842: Tue Nov 19 15:17:49 2024 00:16:50.716 read: IOPS=898, BW=3595KiB/s (3681kB/s)(3620KiB/1007msec) 00:16:50.716 slat (nsec): min=5546, max=35303, avg=7841.06, stdev=3376.94 00:16:50.716 clat (usec): min=182, max=41590, avg=884.15, stdev=5031.56 00:16:50.716 lat (usec): min=188, max=41605, avg=892.00, stdev=5032.32 00:16:50.716 clat percentiles (usec): 00:16:50.716 | 1.00th=[ 194], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 217], 00:16:50.716 | 30.00th=[ 225], 40.00th=[ 233], 50.00th=[ 245], 60.00th=[ 262], 00:16:50.716 | 70.00th=[ 277], 80.00th=[ 297], 90.00th=[ 314], 95.00th=[ 330], 00:16:50.716 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:16:50.716 | 99.99th=[41681] 00:16:50.716 write: IOPS=1016, BW=4068KiB/s (4165kB/s)(4096KiB/1007msec); 0 zone resets 00:16:50.716 slat (nsec): min=5716, max=66900, avg=11423.02, stdev=7070.14 00:16:50.716 clat (usec): min=133, max=721, avg=178.24, stdev=46.52 00:16:50.716 lat (usec): min=141, max=730, avg=189.66, stdev=48.23 00:16:50.716 clat percentiles (usec): 00:16:50.716 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 151], 00:16:50.716 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 169], 00:16:50.716 | 70.00th=[ 180], 80.00th=[ 200], 90.00th=[ 237], 95.00th=[ 251], 00:16:50.716 | 99.00th=[ 269], 99.50th=[ 433], 99.90th=[ 676], 99.95th=[ 725], 00:16:50.716 | 99.99th=[ 725] 00:16:50.716 bw ( KiB/s): min= 3832, max= 4360, per=15.14%, avg=4096.00, stdev=373.35, samples=2 00:16:50.716 iops : min= 958, max= 1090, avg=1024.00, stdev=93.34, samples=2 00:16:50.716 lat (usec) : 250=75.58%, 500=23.48%, 750=0.21% 00:16:50.716 lat (msec) : 50=0.73% 00:16:50.716 cpu : usr=1.19%, sys=2.39%, ctx=1930, majf=0, minf=1 00:16:50.716 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.716 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.716 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.716 issued rwts: total=905,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.716 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.716 job1: (groupid=0, jobs=1): err= 0: pid=2771843: Tue Nov 19 15:17:49 2024 00:16:50.716 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:50.716 slat (nsec): min=4403, max=61956, avg=9846.01, stdev=6133.33 00:16:50.716 clat (usec): min=189, max=41094, avg=290.07, stdev=1556.17 00:16:50.716 lat (usec): min=195, max=41105, avg=299.91, stdev=1556.24 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 196], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 210], 00:16:50.717 | 30.00th=[ 215], 40.00th=[ 219], 50.00th=[ 223], 60.00th=[ 227], 00:16:50.717 | 70.00th=[ 231], 80.00th=[ 241], 90.00th=[ 269], 95.00th=[ 285], 00:16:50.717 | 99.00th=[ 408], 99.50th=[ 482], 99.90th=[40633], 99.95th=[41157], 00:16:50.717 | 99.99th=[41157] 00:16:50.717 write: IOPS=2198, BW=8795KiB/s (9006kB/s)(8804KiB/1001msec); 0 zone resets 00:16:50.717 slat (nsec): min=5942, max=42880, avg=10529.99, stdev=5020.03 00:16:50.717 clat (usec): min=127, max=672, avg=158.94, stdev=18.69 00:16:50.717 lat (usec): min=134, max=680, avg=169.47, stdev=19.37 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 143], 20.00th=[ 147], 00:16:50.717 | 30.00th=[ 149], 40.00th=[ 153], 50.00th=[ 157], 60.00th=[ 159], 00:16:50.717 | 70.00th=[ 163], 80.00th=[ 169], 90.00th=[ 180], 95.00th=[ 190], 00:16:50.717 | 99.00th=[ 206], 99.50th=[ 212], 99.90th=[ 225], 99.95th=[ 225], 00:16:50.717 | 99.99th=[ 676] 00:16:50.717 bw ( KiB/s): min=11768, max=11768, per=43.51%, avg=11768.00, stdev= 0.00, samples=1 00:16:50.717 iops : min= 2942, max= 2942, avg=2942.00, stdev= 0.00, samples=1 00:16:50.717 lat (usec) : 250=93.57%, 500=6.21%, 750=0.14% 00:16:50.717 lat (msec) : 50=0.07% 00:16:50.717 cpu : usr=2.50%, sys=4.40%, ctx=4250, majf=0, minf=1 00:16:50.717 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 issued rwts: total=2048,2201,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.717 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.717 job2: (groupid=0, jobs=1): err= 0: pid=2771844: Tue Nov 19 15:17:49 2024 00:16:50.717 read: IOPS=1671, BW=6685KiB/s (6846kB/s)(6692KiB/1001msec) 00:16:50.717 slat (nsec): min=5915, max=41974, avg=10675.00, stdev=5241.59 00:16:50.717 clat (usec): min=209, max=42264, avg=323.07, stdev=1446.53 00:16:50.717 lat (usec): min=216, max=42270, avg=333.75, stdev=1446.63 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 227], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 245], 00:16:50.717 | 30.00th=[ 249], 40.00th=[ 255], 50.00th=[ 262], 60.00th=[ 273], 00:16:50.717 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 306], 95.00th=[ 338], 00:16:50.717 | 99.00th=[ 490], 99.50th=[ 502], 99.90th=[41681], 99.95th=[42206], 00:16:50.717 | 99.99th=[42206] 00:16:50.717 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:50.717 slat (nsec): min=7565, max=58156, avg=14138.68, stdev=7508.87 00:16:50.717 clat (usec): min=137, max=433, avg=195.41, stdev=34.23 00:16:50.717 lat (usec): min=146, max=462, avg=209.55, stdev=37.86 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 159], 20.00th=[ 167], 00:16:50.717 | 30.00th=[ 176], 40.00th=[ 182], 50.00th=[ 190], 60.00th=[ 198], 00:16:50.717 | 70.00th=[ 206], 80.00th=[ 223], 90.00th=[ 243], 95.00th=[ 253], 00:16:50.717 | 99.00th=[ 285], 99.50th=[ 347], 99.90th=[ 429], 99.95th=[ 433], 00:16:50.717 | 99.99th=[ 433] 00:16:50.717 bw ( KiB/s): min= 8192, max= 8192, per=30.29%, avg=8192.00, stdev= 0.00, samples=1 00:16:50.717 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:50.717 lat (usec) : 250=66.22%, 500=33.49%, 750=0.21% 00:16:50.717 lat (msec) : 2=0.03%, 50=0.05% 00:16:50.717 cpu : usr=3.30%, sys=6.30%, ctx=3724, majf=0, minf=1 00:16:50.717 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 issued rwts: total=1673,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.717 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.717 job3: (groupid=0, jobs=1): err= 0: pid=2771845: Tue Nov 19 15:17:49 2024 00:16:50.717 read: IOPS=1361, BW=5446KiB/s (5577kB/s)(5484KiB/1007msec) 00:16:50.717 slat (nsec): min=4581, max=70426, avg=15101.33, stdev=9673.78 00:16:50.717 clat (usec): min=207, max=41081, avg=486.03, stdev=2668.86 00:16:50.717 lat (usec): min=215, max=41099, avg=501.13, stdev=2669.04 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 215], 5.00th=[ 225], 10.00th=[ 233], 20.00th=[ 243], 00:16:50.717 | 30.00th=[ 251], 40.00th=[ 265], 50.00th=[ 277], 60.00th=[ 293], 00:16:50.717 | 70.00th=[ 318], 80.00th=[ 371], 90.00th=[ 469], 95.00th=[ 494], 00:16:50.717 | 99.00th=[ 578], 99.50th=[ 611], 99.90th=[40633], 99.95th=[41157], 00:16:50.717 | 99.99th=[41157] 00:16:50.717 write: IOPS=1525, BW=6101KiB/s (6248kB/s)(6144KiB/1007msec); 0 zone resets 00:16:50.717 slat (nsec): min=5522, max=46977, avg=8959.06, stdev=4473.61 00:16:50.717 clat (usec): min=145, max=1943, avg=192.20, stdev=51.12 00:16:50.717 lat (usec): min=151, max=1950, avg=201.16, stdev=52.02 00:16:50.717 clat percentiles (usec): 00:16:50.717 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 163], 20.00th=[ 172], 00:16:50.717 | 30.00th=[ 178], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 194], 00:16:50.717 | 70.00th=[ 202], 80.00th=[ 208], 90.00th=[ 223], 95.00th=[ 233], 00:16:50.717 | 99.00th=[ 265], 99.50th=[ 277], 99.90th=[ 408], 99.95th=[ 1942], 00:16:50.717 | 99.99th=[ 1942] 00:16:50.717 bw ( KiB/s): min= 4096, max= 8192, per=22.72%, avg=6144.00, stdev=2896.31, samples=2 00:16:50.717 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:50.717 lat (usec) : 250=65.43%, 500=32.47%, 750=1.86% 00:16:50.717 lat (msec) : 2=0.03%, 50=0.21% 00:16:50.717 cpu : usr=1.59%, sys=3.78%, ctx=2907, majf=0, minf=1 00:16:50.717 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.717 issued rwts: total=1371,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.717 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.717 00:16:50.717 Run status group 0 (all jobs): 00:16:50.717 READ: bw=23.3MiB/s (24.4MB/s), 3595KiB/s-8184KiB/s (3681kB/s-8380kB/s), io=23.4MiB (24.6MB), run=1001-1007msec 00:16:50.717 WRITE: bw=26.4MiB/s (27.7MB/s), 4068KiB/s-8795KiB/s (4165kB/s-9006kB/s), io=26.6MiB (27.9MB), run=1001-1007msec 00:16:50.717 00:16:50.717 Disk stats (read/write): 00:16:50.717 nvme0n1: ios=951/1024, merge=0/0, ticks=633/186, in_queue=819, util=86.97% 00:16:50.717 nvme0n2: ios=1632/2048, merge=0/0, ticks=1381/314, in_queue=1695, util=89.84% 00:16:50.717 nvme0n3: ios=1585/1579, merge=0/0, ticks=566/297, in_queue=863, util=95.00% 00:16:50.717 nvme0n4: ios=1340/1536, merge=0/0, ticks=558/282, in_queue=840, util=95.59% 00:16:50.717 15:17:49 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:50.717 [global] 00:16:50.717 thread=1 00:16:50.717 invalidate=1 00:16:50.717 rw=randwrite 00:16:50.717 time_based=1 00:16:50.717 runtime=1 00:16:50.717 ioengine=libaio 00:16:50.717 direct=1 00:16:50.717 bs=4096 00:16:50.717 iodepth=1 00:16:50.717 norandommap=0 00:16:50.717 numjobs=1 00:16:50.717 00:16:50.717 verify_dump=1 00:16:50.717 verify_backlog=512 00:16:50.717 verify_state_save=0 00:16:50.717 do_verify=1 00:16:50.717 verify=crc32c-intel 00:16:50.717 [job0] 00:16:50.717 filename=/dev/nvme0n1 00:16:50.717 [job1] 00:16:50.717 filename=/dev/nvme0n2 00:16:50.717 [job2] 00:16:50.717 filename=/dev/nvme0n3 00:16:50.717 [job3] 00:16:50.717 filename=/dev/nvme0n4 00:16:50.974 Could not set queue depth (nvme0n1) 00:16:50.974 Could not set queue depth (nvme0n2) 00:16:50.974 Could not set queue depth (nvme0n3) 00:16:50.974 Could not set queue depth (nvme0n4) 00:16:50.974 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.974 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.974 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.974 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.974 fio-3.35 00:16:50.974 Starting 4 threads 00:16:52.346 00:16:52.346 job0: (groupid=0, jobs=1): err= 0: pid=2772073: Tue Nov 19 15:17:50 2024 00:16:52.346 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:52.346 slat (nsec): min=4735, max=33827, avg=8731.07, stdev=4235.58 00:16:52.346 clat (usec): min=181, max=42043, avg=410.81, stdev=2348.67 00:16:52.346 lat (usec): min=187, max=42051, avg=419.54, stdev=2348.82 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 186], 5.00th=[ 196], 10.00th=[ 210], 20.00th=[ 235], 00:16:52.346 | 30.00th=[ 245], 40.00th=[ 251], 50.00th=[ 258], 60.00th=[ 265], 00:16:52.346 | 70.00th=[ 277], 80.00th=[ 306], 90.00th=[ 359], 95.00th=[ 429], 00:16:52.346 | 99.00th=[ 594], 99.50th=[ 709], 99.90th=[42206], 99.95th=[42206], 00:16:52.346 | 99.99th=[42206] 00:16:52.346 write: IOPS=1572, BW=6290KiB/s (6441kB/s)(6296KiB/1001msec); 0 zone resets 00:16:52.346 slat (nsec): min=6289, max=72411, avg=11178.11, stdev=8049.52 00:16:52.346 clat (usec): min=132, max=1786, avg=209.16, stdev=92.93 00:16:52.346 lat (usec): min=140, max=1795, avg=220.34, stdev=97.52 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 137], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 153], 00:16:52.346 | 30.00th=[ 157], 40.00th=[ 161], 50.00th=[ 167], 60.00th=[ 176], 00:16:52.346 | 70.00th=[ 217], 80.00th=[ 243], 90.00th=[ 367], 95.00th=[ 400], 00:16:52.346 | 99.00th=[ 457], 99.50th=[ 474], 99.90th=[ 506], 99.95th=[ 1795], 00:16:52.346 | 99.99th=[ 1795] 00:16:52.346 bw ( KiB/s): min= 8192, max= 8192, per=58.58%, avg=8192.00, stdev= 0.00, samples=1 00:16:52.346 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:52.346 lat (usec) : 250=60.16%, 500=38.55%, 750=1.03%, 1000=0.03% 00:16:52.346 lat (msec) : 2=0.03%, 4=0.03%, 50=0.16% 00:16:52.346 cpu : usr=1.00%, sys=3.90%, ctx=3114, majf=0, minf=1 00:16:52.346 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.346 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 issued rwts: total=1536,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.346 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.346 job1: (groupid=0, jobs=1): err= 0: pid=2772074: Tue Nov 19 15:17:50 2024 00:16:52.346 read: IOPS=555, BW=2220KiB/s (2273kB/s)(2300KiB/1036msec) 00:16:52.346 slat (nsec): min=4501, max=34728, avg=9381.89, stdev=5111.31 00:16:52.346 clat (usec): min=179, max=42041, avg=1464.47, stdev=6921.64 00:16:52.346 lat (usec): min=184, max=42059, avg=1473.85, stdev=6923.68 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 186], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 206], 00:16:52.346 | 30.00th=[ 221], 40.00th=[ 239], 50.00th=[ 247], 60.00th=[ 253], 00:16:52.346 | 70.00th=[ 277], 80.00th=[ 293], 90.00th=[ 375], 95.00th=[ 424], 00:16:52.346 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:52.346 | 99.99th=[42206] 00:16:52.346 write: IOPS=988, BW=3954KiB/s (4049kB/s)(4096KiB/1036msec); 0 zone resets 00:16:52.346 slat (nsec): min=5976, max=54813, avg=11728.99, stdev=8334.54 00:16:52.346 clat (usec): min=124, max=2271, avg=167.45, stdev=71.15 00:16:52.346 lat (usec): min=132, max=2278, avg=179.18, stdev=72.11 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 131], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 149], 00:16:52.346 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 163], 60.00th=[ 167], 00:16:52.346 | 70.00th=[ 174], 80.00th=[ 180], 90.00th=[ 190], 95.00th=[ 198], 00:16:52.346 | 99.00th=[ 269], 99.50th=[ 306], 99.90th=[ 611], 99.95th=[ 2278], 00:16:52.346 | 99.99th=[ 2278] 00:16:52.346 bw ( KiB/s): min= 8192, max= 8192, per=58.58%, avg=8192.00, stdev= 0.00, samples=1 00:16:52.346 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:52.346 lat (usec) : 250=82.93%, 500=15.76%, 750=0.19% 00:16:52.346 lat (msec) : 4=0.06%, 50=1.06% 00:16:52.346 cpu : usr=0.87%, sys=1.64%, ctx=1600, majf=0, minf=1 00:16:52.346 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.346 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 issued rwts: total=575,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.346 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.346 job2: (groupid=0, jobs=1): err= 0: pid=2772075: Tue Nov 19 15:17:50 2024 00:16:52.346 read: IOPS=42, BW=168KiB/s (173kB/s)(172KiB/1021msec) 00:16:52.346 slat (nsec): min=7092, max=36656, avg=15999.72, stdev=7954.58 00:16:52.346 clat (usec): min=246, max=42024, avg=21018.73, stdev=20468.24 00:16:52.346 lat (usec): min=262, max=42060, avg=21034.73, stdev=20473.08 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 247], 5.00th=[ 281], 10.00th=[ 285], 20.00th=[ 297], 00:16:52.346 | 30.00th=[ 302], 40.00th=[ 343], 50.00th=[34866], 60.00th=[41157], 00:16:52.346 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:52.346 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:52.346 | 99.99th=[42206] 00:16:52.346 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:16:52.346 slat (nsec): min=7594, max=41424, avg=13266.48, stdev=6762.54 00:16:52.346 clat (usec): min=161, max=322, avg=209.27, stdev=23.97 00:16:52.346 lat (usec): min=169, max=354, avg=222.54, stdev=26.23 00:16:52.346 clat percentiles (usec): 00:16:52.346 | 1.00th=[ 172], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 190], 00:16:52.346 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 212], 00:16:52.346 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 239], 95.00th=[ 251], 00:16:52.346 | 99.00th=[ 285], 99.50th=[ 297], 99.90th=[ 322], 99.95th=[ 322], 00:16:52.346 | 99.99th=[ 322] 00:16:52.346 bw ( KiB/s): min= 4096, max= 4096, per=29.29%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.346 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.346 lat (usec) : 250=87.21%, 500=8.47%, 750=0.18%, 1000=0.18% 00:16:52.346 lat (msec) : 50=3.96% 00:16:52.346 cpu : usr=0.39%, sys=0.69%, ctx=556, majf=0, minf=1 00:16:52.346 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.346 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.346 issued rwts: total=43,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.346 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.346 job3: (groupid=0, jobs=1): err= 0: pid=2772076: Tue Nov 19 15:17:50 2024 00:16:52.346 read: IOPS=27, BW=109KiB/s (111kB/s)(112KiB/1032msec) 00:16:52.346 slat (nsec): min=7024, max=39229, avg=17185.96, stdev=10265.73 00:16:52.347 clat (usec): min=287, max=41074, avg=30778.54, stdev=17897.04 00:16:52.347 lat (usec): min=294, max=41089, avg=30795.73, stdev=17901.96 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 289], 5.00th=[ 326], 10.00th=[ 330], 20.00th=[ 351], 00:16:52.347 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.347 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:52.347 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:52.347 | 99.99th=[41157] 00:16:52.347 write: IOPS=496, BW=1984KiB/s (2032kB/s)(2048KiB/1032msec); 0 zone resets 00:16:52.347 slat (nsec): min=10041, max=66361, avg=18853.61, stdev=9883.25 00:16:52.347 clat (usec): min=182, max=519, avg=305.96, stdev=87.60 00:16:52.347 lat (usec): min=196, max=548, avg=324.82, stdev=90.69 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 198], 5.00th=[ 210], 10.00th=[ 215], 20.00th=[ 219], 00:16:52.347 | 30.00th=[ 225], 40.00th=[ 239], 50.00th=[ 297], 60.00th=[ 330], 00:16:52.347 | 70.00th=[ 359], 80.00th=[ 400], 90.00th=[ 437], 95.00th=[ 457], 00:16:52.347 | 99.00th=[ 478], 99.50th=[ 498], 99.90th=[ 519], 99.95th=[ 519], 00:16:52.347 | 99.99th=[ 519] 00:16:52.347 bw ( KiB/s): min= 4096, max= 4096, per=29.29%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.347 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.347 lat (usec) : 250=40.37%, 500=55.37%, 750=0.37% 00:16:52.347 lat (msec) : 50=3.89% 00:16:52.347 cpu : usr=0.48%, sys=1.36%, ctx=541, majf=0, minf=1 00:16:52.347 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 issued rwts: total=28,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.347 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.347 00:16:52.347 Run status group 0 (all jobs): 00:16:52.347 READ: bw=8425KiB/s (8627kB/s), 109KiB/s-6138KiB/s (111kB/s-6285kB/s), io=8728KiB (8937kB), run=1001-1036msec 00:16:52.347 WRITE: bw=13.7MiB/s (14.3MB/s), 1984KiB/s-6290KiB/s (2032kB/s-6441kB/s), io=14.1MiB (14.8MB), run=1001-1036msec 00:16:52.347 00:16:52.347 Disk stats (read/write): 00:16:52.347 nvme0n1: ios=1108/1536, merge=0/0, ticks=848/316, in_queue=1164, util=93.39% 00:16:52.347 nvme0n2: ios=620/1024, merge=0/0, ticks=695/170, in_queue=865, util=90.03% 00:16:52.347 nvme0n3: ios=84/512, merge=0/0, ticks=1263/103, in_queue=1366, util=99.06% 00:16:52.347 nvme0n4: ios=66/512, merge=0/0, ticks=1462/147, in_queue=1609, util=100.00% 00:16:52.347 15:17:50 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:52.347 [global] 00:16:52.347 thread=1 00:16:52.347 invalidate=1 00:16:52.347 rw=write 00:16:52.347 time_based=1 00:16:52.347 runtime=1 00:16:52.347 ioengine=libaio 00:16:52.347 direct=1 00:16:52.347 bs=4096 00:16:52.347 iodepth=128 00:16:52.347 norandommap=0 00:16:52.347 numjobs=1 00:16:52.347 00:16:52.347 verify_dump=1 00:16:52.347 verify_backlog=512 00:16:52.347 verify_state_save=0 00:16:52.347 do_verify=1 00:16:52.347 verify=crc32c-intel 00:16:52.347 [job0] 00:16:52.347 filename=/dev/nvme0n1 00:16:52.347 [job1] 00:16:52.347 filename=/dev/nvme0n2 00:16:52.347 [job2] 00:16:52.347 filename=/dev/nvme0n3 00:16:52.347 [job3] 00:16:52.347 filename=/dev/nvme0n4 00:16:52.347 Could not set queue depth (nvme0n1) 00:16:52.347 Could not set queue depth (nvme0n2) 00:16:52.347 Could not set queue depth (nvme0n3) 00:16:52.347 Could not set queue depth (nvme0n4) 00:16:52.605 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.605 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.605 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.605 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.605 fio-3.35 00:16:52.605 Starting 4 threads 00:16:53.981 00:16:53.981 job0: (groupid=0, jobs=1): err= 0: pid=2772392: Tue Nov 19 15:17:52 2024 00:16:53.981 read: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec) 00:16:53.981 slat (usec): min=2, max=14180, avg=147.11, stdev=883.55 00:16:53.981 clat (usec): min=8110, max=41307, avg=18259.97, stdev=5183.40 00:16:53.981 lat (usec): min=9294, max=41326, avg=18407.07, stdev=5256.61 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[10028], 5.00th=[10421], 10.00th=[10683], 20.00th=[15139], 00:16:53.981 | 30.00th=[15795], 40.00th=[16909], 50.00th=[17433], 60.00th=[18220], 00:16:53.981 | 70.00th=[19268], 80.00th=[22676], 90.00th=[25822], 95.00th=[27657], 00:16:53.981 | 99.00th=[32900], 99.50th=[33817], 99.90th=[34341], 99.95th=[36439], 00:16:53.981 | 99.99th=[41157] 00:16:53.981 write: IOPS=2944, BW=11.5MiB/s (12.1MB/s)(11.5MiB/1004msec); 0 zone resets 00:16:53.981 slat (usec): min=2, max=10699, avg=203.66, stdev=906.96 00:16:53.981 clat (usec): min=2708, max=64878, avg=27090.85, stdev=17161.91 00:16:53.981 lat (usec): min=3175, max=64891, avg=27294.52, stdev=17279.36 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[ 3490], 5.00th=[ 9241], 10.00th=[10945], 20.00th=[11863], 00:16:53.981 | 30.00th=[12518], 40.00th=[14484], 50.00th=[21365], 60.00th=[28443], 00:16:53.981 | 70.00th=[35390], 80.00th=[46400], 90.00th=[54789], 95.00th=[58983], 00:16:53.981 | 99.00th=[62653], 99.50th=[63177], 99.90th=[64750], 99.95th=[64750], 00:16:53.981 | 99.99th=[64750] 00:16:53.981 bw ( KiB/s): min=11128, max=11504, per=20.54%, avg=11316.00, stdev=265.87, samples=2 00:16:53.981 iops : min= 2782, max= 2876, avg=2829.00, stdev=66.47, samples=2 00:16:53.981 lat (msec) : 4=0.60%, 10=5.04%, 20=54.19%, 50=31.73%, 100=8.45% 00:16:53.981 cpu : usr=2.79%, sys=4.49%, ctx=324, majf=0, minf=1 00:16:53.981 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:16:53.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.981 issued rwts: total=2560,2956,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.981 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.981 job1: (groupid=0, jobs=1): err= 0: pid=2772411: Tue Nov 19 15:17:52 2024 00:16:53.981 read: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec) 00:16:53.981 slat (usec): min=3, max=14391, avg=191.76, stdev=1171.39 00:16:53.981 clat (usec): min=11887, max=58601, avg=23536.75, stdev=6793.68 00:16:53.981 lat (usec): min=11899, max=58621, avg=23728.51, stdev=6877.79 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[12649], 5.00th=[14615], 10.00th=[16319], 20.00th=[18482], 00:16:53.981 | 30.00th=[20055], 40.00th=[21365], 50.00th=[22152], 60.00th=[23462], 00:16:53.981 | 70.00th=[25297], 80.00th=[28443], 90.00th=[31327], 95.00th=[33162], 00:16:53.981 | 99.00th=[51643], 99.50th=[56886], 99.90th=[58459], 99.95th=[58459], 00:16:53.981 | 99.99th=[58459] 00:16:53.981 write: IOPS=2593, BW=10.1MiB/s (10.6MB/s)(10.2MiB/1004msec); 0 zone resets 00:16:53.981 slat (usec): min=4, max=34865, avg=187.22, stdev=1053.36 00:16:53.981 clat (usec): min=2614, max=69981, avg=25567.52, stdev=14257.84 00:16:53.981 lat (usec): min=4245, max=70014, avg=25754.74, stdev=14349.77 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[10159], 5.00th=[13042], 10.00th=[13173], 20.00th=[13566], 00:16:53.981 | 30.00th=[13829], 40.00th=[14746], 50.00th=[16909], 60.00th=[28705], 00:16:53.981 | 70.00th=[33817], 80.00th=[42206], 90.00th=[45351], 95.00th=[48497], 00:16:53.981 | 99.00th=[61604], 99.50th=[68682], 99.90th=[69731], 99.95th=[69731], 00:16:53.981 | 99.99th=[69731] 00:16:53.981 bw ( KiB/s): min= 7752, max=12728, per=18.58%, avg=10240.00, stdev=3518.56, samples=2 00:16:53.981 iops : min= 1938, max= 3182, avg=2560.00, stdev=879.64, samples=2 00:16:53.981 lat (msec) : 4=0.02%, 10=0.48%, 20=42.06%, 50=54.71%, 100=2.73% 00:16:53.981 cpu : usr=3.19%, sys=3.99%, ctx=243, majf=0, minf=1 00:16:53.981 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:16:53.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.981 issued rwts: total=2560,2604,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.981 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.981 job2: (groupid=0, jobs=1): err= 0: pid=2772436: Tue Nov 19 15:17:52 2024 00:16:53.981 read: IOPS=5911, BW=23.1MiB/s (24.2MB/s)(23.2MiB/1005msec) 00:16:53.981 slat (usec): min=3, max=10947, avg=82.85, stdev=605.20 00:16:53.981 clat (usec): min=2133, max=21993, avg=10776.61, stdev=2827.86 00:16:53.981 lat (usec): min=3678, max=22001, avg=10859.45, stdev=2864.72 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[ 5997], 5.00th=[ 7504], 10.00th=[ 8455], 20.00th=[ 9110], 00:16:53.981 | 30.00th=[ 9372], 40.00th=[ 9503], 50.00th=[ 9896], 60.00th=[10421], 00:16:53.981 | 70.00th=[11207], 80.00th=[12387], 90.00th=[14877], 95.00th=[16909], 00:16:53.981 | 99.00th=[19792], 99.50th=[21365], 99.90th=[21890], 99.95th=[21890], 00:16:53.981 | 99.99th=[21890] 00:16:53.981 write: IOPS=6113, BW=23.9MiB/s (25.0MB/s)(24.0MiB/1005msec); 0 zone resets 00:16:53.981 slat (usec): min=4, max=8627, avg=74.55, stdev=440.73 00:16:53.981 clat (usec): min=1109, max=21965, avg=10325.86, stdev=3293.66 00:16:53.981 lat (usec): min=1119, max=21971, avg=10400.41, stdev=3318.01 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[ 3294], 5.00th=[ 4883], 10.00th=[ 6456], 20.00th=[ 7898], 00:16:53.981 | 30.00th=[ 9110], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[10814], 00:16:53.981 | 70.00th=[10945], 80.00th=[12256], 90.00th=[14353], 95.00th=[17171], 00:16:53.981 | 99.00th=[19006], 99.50th=[19530], 99.90th=[21103], 99.95th=[21890], 00:16:53.981 | 99.99th=[21890] 00:16:53.981 bw ( KiB/s): min=24576, max=24576, per=44.60%, avg=24576.00, stdev= 0.00, samples=2 00:16:53.981 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:16:53.981 lat (msec) : 2=0.12%, 4=1.14%, 10=44.63%, 20=53.44%, 50=0.67% 00:16:53.981 cpu : usr=6.67%, sys=10.16%, ctx=568, majf=0, minf=2 00:16:53.981 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:53.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.981 issued rwts: total=5941,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.981 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.981 job3: (groupid=0, jobs=1): err= 0: pid=2772437: Tue Nov 19 15:17:52 2024 00:16:53.981 read: IOPS=2035, BW=8143KiB/s (8339kB/s)(8192KiB/1006msec) 00:16:53.981 slat (usec): min=2, max=19738, avg=217.88, stdev=1375.90 00:16:53.981 clat (usec): min=9943, max=57000, avg=24418.73, stdev=7713.58 00:16:53.981 lat (usec): min=9972, max=57008, avg=24636.61, stdev=7827.86 00:16:53.981 clat percentiles (usec): 00:16:53.981 | 1.00th=[10159], 5.00th=[14746], 10.00th=[16909], 20.00th=[20055], 00:16:53.982 | 30.00th=[21365], 40.00th=[21890], 50.00th=[22152], 60.00th=[23725], 00:16:53.982 | 70.00th=[26084], 80.00th=[28967], 90.00th=[32637], 95.00th=[39060], 00:16:53.982 | 99.00th=[56886], 99.50th=[56886], 99.90th=[56886], 99.95th=[56886], 00:16:53.982 | 99.99th=[56886] 00:16:53.982 write: IOPS=2141, BW=8565KiB/s (8770kB/s)(8616KiB/1006msec); 0 zone resets 00:16:53.982 slat (usec): min=3, max=18458, avg=251.42, stdev=978.49 00:16:53.982 clat (usec): min=4541, max=66092, avg=35817.34, stdev=15582.90 00:16:53.982 lat (usec): min=6128, max=66109, avg=36068.77, stdev=15679.13 00:16:53.982 clat percentiles (usec): 00:16:53.982 | 1.00th=[ 6194], 5.00th=[11994], 10.00th=[13960], 20.00th=[19792], 00:16:53.982 | 30.00th=[23987], 40.00th=[30278], 50.00th=[36963], 60.00th=[42730], 00:16:53.982 | 70.00th=[46400], 80.00th=[50594], 90.00th=[55313], 95.00th=[60556], 00:16:53.982 | 99.00th=[64750], 99.50th=[65799], 99.90th=[66323], 99.95th=[66323], 00:16:53.982 | 99.99th=[66323] 00:16:53.982 bw ( KiB/s): min= 7816, max= 8568, per=14.87%, avg=8192.00, stdev=531.74, samples=2 00:16:53.982 iops : min= 1954, max= 2142, avg=2048.00, stdev=132.94, samples=2 00:16:53.982 lat (msec) : 10=1.24%, 20=19.23%, 50=67.82%, 100=11.71% 00:16:53.982 cpu : usr=2.19%, sys=2.09%, ctx=268, majf=0, minf=1 00:16:53.982 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:16:53.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.982 issued rwts: total=2048,2154,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.982 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.982 00:16:53.982 Run status group 0 (all jobs): 00:16:53.982 READ: bw=50.9MiB/s (53.4MB/s), 8143KiB/s-23.1MiB/s (8339kB/s-24.2MB/s), io=51.2MiB (53.7MB), run=1004-1006msec 00:16:53.982 WRITE: bw=53.8MiB/s (56.4MB/s), 8565KiB/s-23.9MiB/s (8770kB/s-25.0MB/s), io=54.1MiB (56.8MB), run=1004-1006msec 00:16:53.982 00:16:53.982 Disk stats (read/write): 00:16:53.982 nvme0n1: ios=2098/2291, merge=0/0, ticks=16981/33263, in_queue=50244, util=86.47% 00:16:53.982 nvme0n2: ios=2091/2495, merge=0/0, ticks=22544/28949, in_queue=51493, util=98.88% 00:16:53.982 nvme0n3: ios=5035/5120, merge=0/0, ticks=50938/52155, in_queue=103093, util=98.02% 00:16:53.982 nvme0n4: ios=1587/1999, merge=0/0, ticks=17777/35992, in_queue=53769, util=97.37% 00:16:53.982 15:17:52 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:53.982 [global] 00:16:53.982 thread=1 00:16:53.982 invalidate=1 00:16:53.982 rw=randwrite 00:16:53.982 time_based=1 00:16:53.982 runtime=1 00:16:53.982 ioengine=libaio 00:16:53.982 direct=1 00:16:53.982 bs=4096 00:16:53.982 iodepth=128 00:16:53.982 norandommap=0 00:16:53.982 numjobs=1 00:16:53.982 00:16:53.982 verify_dump=1 00:16:53.982 verify_backlog=512 00:16:53.982 verify_state_save=0 00:16:53.982 do_verify=1 00:16:53.982 verify=crc32c-intel 00:16:53.982 [job0] 00:16:53.982 filename=/dev/nvme0n1 00:16:53.982 [job1] 00:16:53.982 filename=/dev/nvme0n2 00:16:53.982 [job2] 00:16:53.982 filename=/dev/nvme0n3 00:16:53.982 [job3] 00:16:53.982 filename=/dev/nvme0n4 00:16:53.982 Could not set queue depth (nvme0n1) 00:16:53.982 Could not set queue depth (nvme0n2) 00:16:53.982 Could not set queue depth (nvme0n3) 00:16:53.982 Could not set queue depth (nvme0n4) 00:16:53.982 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.982 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.982 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.982 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:53.982 fio-3.35 00:16:53.982 Starting 4 threads 00:16:55.359 00:16:55.359 job0: (groupid=0, jobs=1): err= 0: pid=2772670: Tue Nov 19 15:17:53 2024 00:16:55.359 read: IOPS=4916, BW=19.2MiB/s (20.1MB/s)(20.1MiB/1045msec) 00:16:55.359 slat (usec): min=2, max=10952, avg=93.22, stdev=652.25 00:16:55.359 clat (usec): min=3475, max=45840, avg=11986.69, stdev=3522.53 00:16:55.359 lat (usec): min=3480, max=45848, avg=12079.91, stdev=3568.91 00:16:55.359 clat percentiles (usec): 00:16:55.359 | 1.00th=[ 4752], 5.00th=[ 7767], 10.00th=[ 8455], 20.00th=[ 9634], 00:16:55.359 | 30.00th=[10421], 40.00th=[10945], 50.00th=[11731], 60.00th=[12125], 00:16:55.359 | 70.00th=[12911], 80.00th=[14222], 90.00th=[16450], 95.00th=[16712], 00:16:55.359 | 99.00th=[21890], 99.50th=[22152], 99.90th=[44827], 99.95th=[44827], 00:16:55.360 | 99.99th=[45876] 00:16:55.360 write: IOPS=5389, BW=21.1MiB/s (22.1MB/s)(22.0MiB/1045msec); 0 zone resets 00:16:55.360 slat (usec): min=3, max=13532, avg=83.93, stdev=556.73 00:16:55.360 clat (usec): min=1552, max=56414, avg=12576.96, stdev=6395.71 00:16:55.360 lat (usec): min=1563, max=56421, avg=12660.89, stdev=6417.30 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 4293], 5.00th=[ 6325], 10.00th=[ 8094], 20.00th=[ 9634], 00:16:55.360 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11469], 60.00th=[12256], 00:16:55.360 | 70.00th=[12911], 80.00th=[13304], 90.00th=[17433], 95.00th=[19530], 00:16:55.360 | 99.00th=[50594], 99.50th=[53740], 99.90th=[56361], 99.95th=[56361], 00:16:55.360 | 99.99th=[56361] 00:16:55.360 bw ( KiB/s): min=21656, max=22528, per=30.47%, avg=22092.00, stdev=616.60, samples=2 00:16:55.360 iops : min= 5414, max= 5632, avg=5523.00, stdev=154.15, samples=2 00:16:55.360 lat (msec) : 2=0.10%, 4=0.39%, 10=23.52%, 20=73.05%, 50=2.36% 00:16:55.360 lat (msec) : 100=0.58% 00:16:55.360 cpu : usr=5.75%, sys=7.47%, ctx=454, majf=0, minf=1 00:16:55.360 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:55.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.360 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.360 issued rwts: total=5138,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.360 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.360 job1: (groupid=0, jobs=1): err= 0: pid=2772671: Tue Nov 19 15:17:53 2024 00:16:55.360 read: IOPS=4647, BW=18.2MiB/s (19.0MB/s)(18.2MiB/1005msec) 00:16:55.360 slat (usec): min=2, max=14852, avg=92.38, stdev=588.54 00:16:55.360 clat (usec): min=632, max=36214, avg=11747.03, stdev=3781.16 00:16:55.360 lat (usec): min=911, max=36222, avg=11839.40, stdev=3823.10 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 5080], 5.00th=[ 8029], 10.00th=[ 8979], 20.00th=[ 9765], 00:16:55.360 | 30.00th=[10290], 40.00th=[10683], 50.00th=[10945], 60.00th=[11207], 00:16:55.360 | 70.00th=[11731], 80.00th=[12387], 90.00th=[15664], 95.00th=[21365], 00:16:55.360 | 99.00th=[26870], 99.50th=[29754], 99.90th=[33817], 99.95th=[33817], 00:16:55.360 | 99.99th=[36439] 00:16:55.360 write: IOPS=5094, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1005msec); 0 zone resets 00:16:55.360 slat (usec): min=3, max=22975, avg=102.64, stdev=689.14 00:16:55.360 clat (usec): min=5898, max=44426, avg=13903.23, stdev=6246.52 00:16:55.360 lat (usec): min=5904, max=44435, avg=14005.86, stdev=6288.03 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 6849], 5.00th=[ 9110], 10.00th=[10421], 20.00th=[10945], 00:16:55.360 | 30.00th=[11338], 40.00th=[11731], 50.00th=[11994], 60.00th=[12256], 00:16:55.360 | 70.00th=[12780], 80.00th=[14222], 90.00th=[23987], 95.00th=[24249], 00:16:55.360 | 99.00th=[44303], 99.50th=[44303], 99.90th=[44303], 99.95th=[44303], 00:16:55.360 | 99.99th=[44303] 00:16:55.360 bw ( KiB/s): min=16432, max=24008, per=27.88%, avg=20220.00, stdev=5357.04, samples=2 00:16:55.360 iops : min= 4108, max= 6002, avg=5055.00, stdev=1339.26, samples=2 00:16:55.360 lat (usec) : 750=0.01%, 1000=0.05% 00:16:55.360 lat (msec) : 2=0.36%, 10=14.84%, 20=74.82%, 50=9.92% 00:16:55.360 cpu : usr=5.08%, sys=8.57%, ctx=459, majf=0, minf=1 00:16:55.360 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:55.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.360 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.360 issued rwts: total=4671,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.360 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.360 job2: (groupid=0, jobs=1): err= 0: pid=2772672: Tue Nov 19 15:17:53 2024 00:16:55.360 read: IOPS=3411, BW=13.3MiB/s (14.0MB/s)(13.4MiB/1009msec) 00:16:55.360 slat (usec): min=2, max=20058, avg=150.02, stdev=1007.46 00:16:55.360 clat (usec): min=4464, max=91165, avg=18250.62, stdev=13307.89 00:16:55.360 lat (usec): min=5013, max=91180, avg=18400.63, stdev=13397.18 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 6128], 5.00th=[ 9503], 10.00th=[10421], 20.00th=[11469], 00:16:55.360 | 30.00th=[12125], 40.00th=[12780], 50.00th=[13435], 60.00th=[15926], 00:16:55.360 | 70.00th=[16909], 80.00th=[20579], 90.00th=[32900], 95.00th=[44827], 00:16:55.360 | 99.00th=[87557], 99.50th=[89654], 99.90th=[90702], 99.95th=[90702], 00:16:55.360 | 99.99th=[90702] 00:16:55.360 write: IOPS=3552, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1009msec); 0 zone resets 00:16:55.360 slat (usec): min=3, max=11018, avg=116.19, stdev=572.77 00:16:55.360 clat (usec): min=878, max=91141, avg=18183.42, stdev=10829.84 00:16:55.360 lat (usec): min=886, max=91147, avg=18299.61, stdev=10875.27 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 2343], 5.00th=[ 5932], 10.00th=[ 7635], 20.00th=[11076], 00:16:55.360 | 30.00th=[12649], 40.00th=[13042], 50.00th=[14091], 60.00th=[15270], 00:16:55.360 | 70.00th=[23725], 80.00th=[24511], 90.00th=[34866], 95.00th=[39060], 00:16:55.360 | 99.00th=[56361], 99.50th=[66847], 99.90th=[90702], 99.95th=[90702], 00:16:55.360 | 99.99th=[90702] 00:16:55.360 bw ( KiB/s): min=13520, max=15182, per=19.79%, avg=14351.00, stdev=1175.21, samples=2 00:16:55.360 iops : min= 3380, max= 3795, avg=3587.50, stdev=293.45, samples=2 00:16:55.360 lat (usec) : 1000=0.06% 00:16:55.360 lat (msec) : 2=0.38%, 4=0.65%, 10=11.73%, 20=57.94%, 50=26.66% 00:16:55.360 lat (msec) : 100=2.58% 00:16:55.360 cpu : usr=3.47%, sys=5.36%, ctx=433, majf=0, minf=2 00:16:55.360 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:55.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.360 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.360 issued rwts: total=3442,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.360 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.360 job3: (groupid=0, jobs=1): err= 0: pid=2772673: Tue Nov 19 15:17:53 2024 00:16:55.360 read: IOPS=4176, BW=16.3MiB/s (17.1MB/s)(16.5MiB/1011msec) 00:16:55.360 slat (usec): min=3, max=16447, avg=112.41, stdev=710.37 00:16:55.360 clat (usec): min=751, max=50835, avg=13592.10, stdev=4389.29 00:16:55.360 lat (usec): min=7004, max=50853, avg=13704.50, stdev=4445.53 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 8455], 5.00th=[ 9765], 10.00th=[10814], 20.00th=[11600], 00:16:55.360 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12649], 60.00th=[12911], 00:16:55.360 | 70.00th=[14353], 80.00th=[15270], 90.00th=[16188], 95.00th=[17957], 00:16:55.360 | 99.00th=[43254], 99.50th=[47973], 99.90th=[50594], 99.95th=[50594], 00:16:55.360 | 99.99th=[50594] 00:16:55.360 write: IOPS=4557, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1011msec); 0 zone resets 00:16:55.360 slat (usec): min=4, max=7524, avg=107.44, stdev=549.74 00:16:55.360 clat (usec): min=5840, max=50864, avg=15280.02, stdev=5829.93 00:16:55.360 lat (usec): min=5847, max=51448, avg=15387.46, stdev=5878.87 00:16:55.360 clat percentiles (usec): 00:16:55.360 | 1.00th=[ 7767], 5.00th=[11076], 10.00th=[11731], 20.00th=[12387], 00:16:55.360 | 30.00th=[12780], 40.00th=[13173], 50.00th=[13566], 60.00th=[13960], 00:16:55.360 | 70.00th=[14484], 80.00th=[16581], 90.00th=[22414], 95.00th=[27657], 00:16:55.360 | 99.00th=[41157], 99.50th=[45351], 99.90th=[47973], 99.95th=[47973], 00:16:55.360 | 99.99th=[51119] 00:16:55.360 bw ( KiB/s): min=16368, max=20480, per=25.41%, avg=18424.00, stdev=2907.62, samples=2 00:16:55.360 iops : min= 4092, max= 5120, avg=4606.00, stdev=726.91, samples=2 00:16:55.360 lat (usec) : 1000=0.01% 00:16:55.360 lat (msec) : 10=4.31%, 20=87.89%, 50=7.69%, 100=0.09% 00:16:55.360 cpu : usr=5.45%, sys=7.33%, ctx=436, majf=0, minf=1 00:16:55.360 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:55.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:55.360 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:55.360 issued rwts: total=4222,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:55.360 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:55.360 00:16:55.360 Run status group 0 (all jobs): 00:16:55.360 READ: bw=65.3MiB/s (68.5MB/s), 13.3MiB/s-19.2MiB/s (14.0MB/s-20.1MB/s), io=68.3MiB (71.6MB), run=1005-1045msec 00:16:55.360 WRITE: bw=70.8MiB/s (74.3MB/s), 13.9MiB/s-21.1MiB/s (14.5MB/s-22.1MB/s), io=74.0MiB (77.6MB), run=1005-1045msec 00:16:55.360 00:16:55.360 Disk stats (read/write): 00:16:55.360 nvme0n1: ios=4454/4608, merge=0/0, ticks=33721/35932, in_queue=69653, util=96.99% 00:16:55.360 nvme0n2: ios=4050/4096, merge=0/0, ticks=31424/36885, in_queue=68309, util=95.33% 00:16:55.360 nvme0n3: ios=3018/3072, merge=0/0, ticks=47797/44248, in_queue=92045, util=96.67% 00:16:55.360 nvme0n4: ios=4096/4096, merge=0/0, ticks=23092/23802, in_queue=46894, util=90.78% 00:16:55.360 15:17:53 -- target/fio.sh@55 -- # sync 00:16:55.360 15:17:53 -- target/fio.sh@59 -- # fio_pid=2772815 00:16:55.360 15:17:53 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:55.360 15:17:53 -- target/fio.sh@61 -- # sleep 3 00:16:55.360 [global] 00:16:55.360 thread=1 00:16:55.360 invalidate=1 00:16:55.360 rw=read 00:16:55.360 time_based=1 00:16:55.360 runtime=10 00:16:55.360 ioengine=libaio 00:16:55.360 direct=1 00:16:55.360 bs=4096 00:16:55.360 iodepth=1 00:16:55.360 norandommap=1 00:16:55.360 numjobs=1 00:16:55.360 00:16:55.360 [job0] 00:16:55.360 filename=/dev/nvme0n1 00:16:55.360 [job1] 00:16:55.360 filename=/dev/nvme0n2 00:16:55.360 [job2] 00:16:55.360 filename=/dev/nvme0n3 00:16:55.360 [job3] 00:16:55.360 filename=/dev/nvme0n4 00:16:55.361 Could not set queue depth (nvme0n1) 00:16:55.361 Could not set queue depth (nvme0n2) 00:16:55.361 Could not set queue depth (nvme0n3) 00:16:55.361 Could not set queue depth (nvme0n4) 00:16:55.619 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:55.619 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:55.619 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:55.619 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:55.619 fio-3.35 00:16:55.619 Starting 4 threads 00:16:58.147 15:17:56 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:58.713 15:17:56 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:58.713 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=41766912, buflen=4096 00:16:58.713 fio: pid=2772912, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:58.713 15:17:57 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:58.713 15:17:57 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:58.713 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=335872, buflen=4096 00:16:58.713 fio: pid=2772911, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:58.972 15:17:57 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:58.972 15:17:57 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:58.972 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=585728, buflen=4096 00:16:58.972 fio: pid=2772909, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:59.231 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=47878144, buflen=4096 00:16:59.231 fio: pid=2772910, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:59.231 15:17:57 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:59.231 15:17:57 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:59.490 00:16:59.490 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2772909: Tue Nov 19 15:17:57 2024 00:16:59.490 read: IOPS=41, BW=166KiB/s (170kB/s)(572KiB/3447msec) 00:16:59.490 slat (usec): min=6, max=11863, avg=99.33, stdev=987.26 00:16:59.490 clat (usec): min=209, max=43073, avg=23926.44, stdev=20083.92 00:16:59.490 lat (usec): min=217, max=52977, avg=24026.34, stdev=20180.30 00:16:59.490 clat percentiles (usec): 00:16:59.490 | 1.00th=[ 210], 5.00th=[ 219], 10.00th=[ 245], 20.00th=[ 355], 00:16:59.490 | 30.00th=[ 453], 40.00th=[ 947], 50.00th=[40633], 60.00th=[40633], 00:16:59.490 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:59.490 | 99.00th=[42206], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:16:59.490 | 99.99th=[43254] 00:16:59.490 bw ( KiB/s): min= 104, max= 312, per=0.73%, avg=174.67, stdev=71.99, samples=6 00:16:59.490 iops : min= 26, max= 78, avg=43.67, stdev=18.00, samples=6 00:16:59.490 lat (usec) : 250=10.42%, 500=25.69%, 750=2.78%, 1000=2.78% 00:16:59.490 lat (msec) : 50=57.64% 00:16:59.490 cpu : usr=0.15%, sys=0.00%, ctx=145, majf=0, minf=2 00:16:59.490 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 complete : 0=0.7%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 issued rwts: total=144,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.490 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.490 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2772910: Tue Nov 19 15:17:57 2024 00:16:59.490 read: IOPS=3162, BW=12.4MiB/s (12.9MB/s)(45.7MiB/3697msec) 00:16:59.490 slat (usec): min=4, max=15119, avg=13.87, stdev=217.65 00:16:59.490 clat (usec): min=193, max=41647, avg=297.81, stdev=1251.55 00:16:59.490 lat (usec): min=199, max=41656, avg=311.68, stdev=1270.44 00:16:59.490 clat percentiles (usec): 00:16:59.490 | 1.00th=[ 204], 5.00th=[ 212], 10.00th=[ 217], 20.00th=[ 223], 00:16:59.490 | 30.00th=[ 229], 40.00th=[ 235], 50.00th=[ 245], 60.00th=[ 260], 00:16:59.490 | 70.00th=[ 273], 80.00th=[ 289], 90.00th=[ 314], 95.00th=[ 334], 00:16:59.490 | 99.00th=[ 416], 99.50th=[ 586], 99.90th=[12518], 99.95th=[40633], 00:16:59.490 | 99.99th=[41157] 00:16:59.490 bw ( KiB/s): min= 1672, max=16584, per=53.08%, avg=12699.86, stdev=5024.73, samples=7 00:16:59.490 iops : min= 418, max= 4146, avg=3174.86, stdev=1256.12, samples=7 00:16:59.490 lat (usec) : 250=53.17%, 500=45.99%, 750=0.62%, 1000=0.09% 00:16:59.490 lat (msec) : 2=0.03%, 4=0.01%, 20=0.01%, 50=0.09% 00:16:59.490 cpu : usr=1.62%, sys=5.22%, ctx=11694, majf=0, minf=2 00:16:59.490 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 issued rwts: total=11690,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.490 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.490 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2772911: Tue Nov 19 15:17:57 2024 00:16:59.490 read: IOPS=26, BW=103KiB/s (106kB/s)(328KiB/3175msec) 00:16:59.490 slat (nsec): min=7040, max=44217, avg=19346.94, stdev=8252.59 00:16:59.490 clat (usec): min=352, max=42067, avg=38407.25, stdev=9823.50 00:16:59.490 lat (usec): min=363, max=42083, avg=38426.41, stdev=9823.38 00:16:59.490 clat percentiles (usec): 00:16:59.490 | 1.00th=[ 355], 5.00th=[ 494], 10.00th=[40633], 20.00th=[41157], 00:16:59.490 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:59.490 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:59.490 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:59.490 | 99.99th=[42206] 00:16:59.490 bw ( KiB/s): min= 96, max= 136, per=0.43%, avg=104.00, stdev=16.00, samples=6 00:16:59.490 iops : min= 24, max= 34, avg=26.00, stdev= 4.00, samples=6 00:16:59.490 lat (usec) : 500=6.02% 00:16:59.490 lat (msec) : 50=92.77% 00:16:59.490 cpu : usr=0.09%, sys=0.00%, ctx=86, majf=0, minf=1 00:16:59.490 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 issued rwts: total=83,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.490 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.490 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2772912: Tue Nov 19 15:17:57 2024 00:16:59.490 read: IOPS=3504, BW=13.7MiB/s (14.4MB/s)(39.8MiB/2910msec) 00:16:59.490 slat (nsec): min=4717, max=82604, avg=12428.08, stdev=8821.10 00:16:59.490 clat (usec): min=199, max=1533, avg=267.83, stdev=65.34 00:16:59.490 lat (usec): min=205, max=1540, avg=280.25, stdev=69.63 00:16:59.490 clat percentiles (usec): 00:16:59.490 | 1.00th=[ 208], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 223], 00:16:59.490 | 30.00th=[ 229], 40.00th=[ 235], 50.00th=[ 243], 60.00th=[ 253], 00:16:59.490 | 70.00th=[ 277], 80.00th=[ 302], 90.00th=[ 363], 95.00th=[ 408], 00:16:59.490 | 99.00th=[ 490], 99.50th=[ 515], 99.90th=[ 553], 99.95th=[ 570], 00:16:59.490 | 99.99th=[ 848] 00:16:59.490 bw ( KiB/s): min=11000, max=16720, per=58.73%, avg=14049.60, stdev=2100.98, samples=5 00:16:59.490 iops : min= 2750, max= 4180, avg=3512.40, stdev=525.25, samples=5 00:16:59.490 lat (usec) : 250=57.78%, 500=41.49%, 750=0.71%, 1000=0.01% 00:16:59.490 lat (msec) : 2=0.01% 00:16:59.490 cpu : usr=1.72%, sys=5.16%, ctx=10199, majf=0, minf=2 00:16:59.490 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.490 issued rwts: total=10198,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.490 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.490 00:16:59.490 Run status group 0 (all jobs): 00:16:59.490 READ: bw=23.4MiB/s (24.5MB/s), 103KiB/s-13.7MiB/s (106kB/s-14.4MB/s), io=86.4MiB (90.6MB), run=2910-3697msec 00:16:59.490 00:16:59.490 Disk stats (read/write): 00:16:59.490 nvme0n1: ios=141/0, merge=0/0, ticks=3342/0, in_queue=3342, util=95.74% 00:16:59.490 nvme0n2: ios=11500/0, merge=0/0, ticks=3292/0, in_queue=3292, util=95.71% 00:16:59.490 nvme0n3: ios=128/0, merge=0/0, ticks=4651/0, in_queue=4651, util=99.66% 00:16:59.490 nvme0n4: ios=10137/0, merge=0/0, ticks=3796/0, in_queue=3796, util=99.80% 00:16:59.750 15:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:59.750 15:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:00.008 15:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.008 15:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:00.008 15:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.008 15:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:00.267 15:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:00.267 15:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:00.833 15:17:59 -- target/fio.sh@69 -- # fio_status=0 00:17:00.833 15:17:59 -- target/fio.sh@70 -- # wait 2772815 00:17:00.833 15:17:59 -- target/fio.sh@70 -- # fio_status=4 00:17:00.834 15:17:59 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:00.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:00.834 15:17:59 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:00.834 15:17:59 -- common/autotest_common.sh@1208 -- # local i=0 00:17:00.834 15:17:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:00.834 15:17:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:00.834 15:17:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:00.834 15:17:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:00.834 15:17:59 -- common/autotest_common.sh@1220 -- # return 0 00:17:00.834 15:17:59 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:00.834 15:17:59 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:00.834 nvmf hotplug test: fio failed as expected 00:17:00.834 15:17:59 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:01.091 15:17:59 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:01.091 15:17:59 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:01.091 15:17:59 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:01.091 15:17:59 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:01.091 15:17:59 -- target/fio.sh@91 -- # nvmftestfini 00:17:01.091 15:17:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:01.091 15:17:59 -- nvmf/common.sh@116 -- # sync 00:17:01.091 15:17:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:01.091 15:17:59 -- nvmf/common.sh@119 -- # set +e 00:17:01.091 15:17:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:01.091 15:17:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:01.091 rmmod nvme_tcp 00:17:01.091 rmmod nvme_fabrics 00:17:01.091 rmmod nvme_keyring 00:17:01.091 15:17:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:01.091 15:17:59 -- nvmf/common.sh@123 -- # set -e 00:17:01.091 15:17:59 -- nvmf/common.sh@124 -- # return 0 00:17:01.091 15:17:59 -- nvmf/common.sh@477 -- # '[' -n 2770737 ']' 00:17:01.091 15:17:59 -- nvmf/common.sh@478 -- # killprocess 2770737 00:17:01.091 15:17:59 -- common/autotest_common.sh@936 -- # '[' -z 2770737 ']' 00:17:01.091 15:17:59 -- common/autotest_common.sh@940 -- # kill -0 2770737 00:17:01.091 15:17:59 -- common/autotest_common.sh@941 -- # uname 00:17:01.091 15:17:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.091 15:17:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2770737 00:17:01.091 15:17:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:01.091 15:17:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:01.091 15:17:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2770737' 00:17:01.091 killing process with pid 2770737 00:17:01.091 15:17:59 -- common/autotest_common.sh@955 -- # kill 2770737 00:17:01.091 15:17:59 -- common/autotest_common.sh@960 -- # wait 2770737 00:17:01.350 15:17:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:01.350 15:17:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:01.350 15:17:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:01.350 15:17:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:01.350 15:17:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:01.350 15:17:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:01.350 15:17:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:01.350 15:17:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:03.887 15:18:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:03.887 00:17:03.887 real 0m24.246s 00:17:03.887 user 1m24.221s 00:17:03.887 sys 0m7.069s 00:17:03.887 15:18:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:03.887 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:17:03.887 ************************************ 00:17:03.887 END TEST nvmf_fio_target 00:17:03.887 ************************************ 00:17:03.887 15:18:01 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:03.887 15:18:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:03.887 15:18:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:03.887 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:17:03.887 ************************************ 00:17:03.887 START TEST nvmf_bdevio 00:17:03.887 ************************************ 00:17:03.887 15:18:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:03.887 * Looking for test storage... 00:17:03.887 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:03.887 15:18:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:03.887 15:18:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:03.887 15:18:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:03.887 15:18:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:03.887 15:18:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:03.887 15:18:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:03.887 15:18:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:03.887 15:18:02 -- scripts/common.sh@335 -- # IFS=.-: 00:17:03.887 15:18:02 -- scripts/common.sh@335 -- # read -ra ver1 00:17:03.887 15:18:02 -- scripts/common.sh@336 -- # IFS=.-: 00:17:03.887 15:18:02 -- scripts/common.sh@336 -- # read -ra ver2 00:17:03.887 15:18:02 -- scripts/common.sh@337 -- # local 'op=<' 00:17:03.887 15:18:02 -- scripts/common.sh@339 -- # ver1_l=2 00:17:03.887 15:18:02 -- scripts/common.sh@340 -- # ver2_l=1 00:17:03.887 15:18:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:03.887 15:18:02 -- scripts/common.sh@343 -- # case "$op" in 00:17:03.887 15:18:02 -- scripts/common.sh@344 -- # : 1 00:17:03.887 15:18:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:03.887 15:18:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:03.887 15:18:02 -- scripts/common.sh@364 -- # decimal 1 00:17:03.887 15:18:02 -- scripts/common.sh@352 -- # local d=1 00:17:03.887 15:18:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:03.887 15:18:02 -- scripts/common.sh@354 -- # echo 1 00:17:03.887 15:18:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:03.887 15:18:02 -- scripts/common.sh@365 -- # decimal 2 00:17:03.887 15:18:02 -- scripts/common.sh@352 -- # local d=2 00:17:03.887 15:18:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:03.887 15:18:02 -- scripts/common.sh@354 -- # echo 2 00:17:03.887 15:18:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:03.887 15:18:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:03.887 15:18:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:03.887 15:18:02 -- scripts/common.sh@367 -- # return 0 00:17:03.887 15:18:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:03.887 15:18:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:03.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.887 --rc genhtml_branch_coverage=1 00:17:03.887 --rc genhtml_function_coverage=1 00:17:03.887 --rc genhtml_legend=1 00:17:03.887 --rc geninfo_all_blocks=1 00:17:03.887 --rc geninfo_unexecuted_blocks=1 00:17:03.887 00:17:03.887 ' 00:17:03.887 15:18:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:03.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.887 --rc genhtml_branch_coverage=1 00:17:03.887 --rc genhtml_function_coverage=1 00:17:03.887 --rc genhtml_legend=1 00:17:03.887 --rc geninfo_all_blocks=1 00:17:03.887 --rc geninfo_unexecuted_blocks=1 00:17:03.887 00:17:03.887 ' 00:17:03.887 15:18:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:03.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.887 --rc genhtml_branch_coverage=1 00:17:03.887 --rc genhtml_function_coverage=1 00:17:03.887 --rc genhtml_legend=1 00:17:03.887 --rc geninfo_all_blocks=1 00:17:03.887 --rc geninfo_unexecuted_blocks=1 00:17:03.887 00:17:03.887 ' 00:17:03.887 15:18:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:03.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.887 --rc genhtml_branch_coverage=1 00:17:03.887 --rc genhtml_function_coverage=1 00:17:03.887 --rc genhtml_legend=1 00:17:03.887 --rc geninfo_all_blocks=1 00:17:03.887 --rc geninfo_unexecuted_blocks=1 00:17:03.887 00:17:03.887 ' 00:17:03.887 15:18:02 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:03.887 15:18:02 -- nvmf/common.sh@7 -- # uname -s 00:17:03.887 15:18:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:03.887 15:18:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:03.887 15:18:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:03.887 15:18:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:03.887 15:18:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:03.887 15:18:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:03.887 15:18:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:03.887 15:18:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:03.887 15:18:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:03.887 15:18:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:03.887 15:18:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:03.887 15:18:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:03.887 15:18:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:03.887 15:18:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:03.887 15:18:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:03.887 15:18:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:03.887 15:18:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:03.887 15:18:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:03.887 15:18:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:03.888 15:18:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.888 15:18:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.888 15:18:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.888 15:18:02 -- paths/export.sh@5 -- # export PATH 00:17:03.888 15:18:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.888 15:18:02 -- nvmf/common.sh@46 -- # : 0 00:17:03.888 15:18:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:03.888 15:18:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:03.888 15:18:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:03.888 15:18:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:03.888 15:18:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:03.888 15:18:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:03.888 15:18:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:03.888 15:18:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:03.888 15:18:02 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:03.888 15:18:02 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:03.888 15:18:02 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:03.888 15:18:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:03.888 15:18:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:03.888 15:18:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:03.888 15:18:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:03.888 15:18:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:03.888 15:18:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:03.888 15:18:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:03.888 15:18:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:03.888 15:18:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:03.888 15:18:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:03.888 15:18:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:03.888 15:18:02 -- common/autotest_common.sh@10 -- # set +x 00:17:05.844 15:18:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:05.844 15:18:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:05.844 15:18:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:05.844 15:18:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:05.844 15:18:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:05.844 15:18:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:05.844 15:18:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:05.844 15:18:04 -- nvmf/common.sh@294 -- # net_devs=() 00:17:05.844 15:18:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:05.844 15:18:04 -- nvmf/common.sh@295 -- # e810=() 00:17:05.844 15:18:04 -- nvmf/common.sh@295 -- # local -ga e810 00:17:05.844 15:18:04 -- nvmf/common.sh@296 -- # x722=() 00:17:05.844 15:18:04 -- nvmf/common.sh@296 -- # local -ga x722 00:17:05.844 15:18:04 -- nvmf/common.sh@297 -- # mlx=() 00:17:05.844 15:18:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:05.844 15:18:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:05.844 15:18:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:05.844 15:18:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:05.844 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:05.844 15:18:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:05.844 15:18:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:05.844 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:05.844 15:18:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:05.844 15:18:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:05.844 15:18:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:05.844 15:18:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:05.844 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:05.844 15:18:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:05.844 15:18:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:05.844 15:18:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:05.844 15:18:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:05.844 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:05.844 15:18:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:05.844 15:18:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:05.844 15:18:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:05.844 15:18:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:05.844 15:18:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:05.844 15:18:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:05.844 15:18:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:05.844 15:18:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:05.844 15:18:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:05.844 15:18:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:05.844 15:18:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:05.844 15:18:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:05.844 15:18:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:05.844 15:18:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:05.844 15:18:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:05.844 15:18:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:05.844 15:18:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:05.844 15:18:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:05.844 15:18:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:05.844 15:18:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:05.844 15:18:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:05.844 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:05.844 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:17:05.844 00:17:05.844 --- 10.0.0.2 ping statistics --- 00:17:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:05.844 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:17:05.844 15:18:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:05.844 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:05.844 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:17:05.844 00:17:05.844 --- 10.0.0.1 ping statistics --- 00:17:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:05.844 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:17:05.844 15:18:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:05.844 15:18:04 -- nvmf/common.sh@410 -- # return 0 00:17:05.844 15:18:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:05.844 15:18:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:05.844 15:18:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:05.844 15:18:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:05.844 15:18:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:05.844 15:18:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:05.844 15:18:04 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:05.844 15:18:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:05.844 15:18:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:05.844 15:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:05.844 15:18:04 -- nvmf/common.sh@469 -- # nvmfpid=2775683 00:17:05.844 15:18:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:05.844 15:18:04 -- nvmf/common.sh@470 -- # waitforlisten 2775683 00:17:05.844 15:18:04 -- common/autotest_common.sh@829 -- # '[' -z 2775683 ']' 00:17:05.844 15:18:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:05.844 15:18:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:05.844 15:18:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:05.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:05.844 15:18:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:05.844 15:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:05.844 [2024-11-19 15:18:04.285665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:05.844 [2024-11-19 15:18:04.285763] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:05.844 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.844 [2024-11-19 15:18:04.357373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:06.103 [2024-11-19 15:18:04.469600] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:06.103 [2024-11-19 15:18:04.469781] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:06.103 [2024-11-19 15:18:04.469800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:06.103 [2024-11-19 15:18:04.469813] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:06.103 [2024-11-19 15:18:04.469915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:06.103 [2024-11-19 15:18:04.469983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:06.103 [2024-11-19 15:18:04.470109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:06.103 [2024-11-19 15:18:04.470112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:07.037 15:18:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:07.037 15:18:05 -- common/autotest_common.sh@862 -- # return 0 00:17:07.037 15:18:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:07.037 15:18:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 15:18:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:07.037 15:18:05 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:07.037 15:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 [2024-11-19 15:18:05.293323] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:07.037 15:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.037 15:18:05 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:07.037 15:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 Malloc0 00:17:07.037 15:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.037 15:18:05 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:07.037 15:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 15:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.037 15:18:05 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:07.037 15:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 15:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.037 15:18:05 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:07.037 15:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.037 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.037 [2024-11-19 15:18:05.344466] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:07.037 15:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.037 15:18:05 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:07.037 15:18:05 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:07.037 15:18:05 -- nvmf/common.sh@520 -- # config=() 00:17:07.037 15:18:05 -- nvmf/common.sh@520 -- # local subsystem config 00:17:07.037 15:18:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:07.037 15:18:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:07.037 { 00:17:07.037 "params": { 00:17:07.037 "name": "Nvme$subsystem", 00:17:07.037 "trtype": "$TEST_TRANSPORT", 00:17:07.037 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:07.037 "adrfam": "ipv4", 00:17:07.037 "trsvcid": "$NVMF_PORT", 00:17:07.037 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:07.037 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:07.037 "hdgst": ${hdgst:-false}, 00:17:07.037 "ddgst": ${ddgst:-false} 00:17:07.037 }, 00:17:07.037 "method": "bdev_nvme_attach_controller" 00:17:07.037 } 00:17:07.037 EOF 00:17:07.037 )") 00:17:07.037 15:18:05 -- nvmf/common.sh@542 -- # cat 00:17:07.037 15:18:05 -- nvmf/common.sh@544 -- # jq . 00:17:07.037 15:18:05 -- nvmf/common.sh@545 -- # IFS=, 00:17:07.037 15:18:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:07.037 "params": { 00:17:07.037 "name": "Nvme1", 00:17:07.037 "trtype": "tcp", 00:17:07.037 "traddr": "10.0.0.2", 00:17:07.037 "adrfam": "ipv4", 00:17:07.037 "trsvcid": "4420", 00:17:07.037 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:07.037 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:07.037 "hdgst": false, 00:17:07.037 "ddgst": false 00:17:07.037 }, 00:17:07.037 "method": "bdev_nvme_attach_controller" 00:17:07.037 }' 00:17:07.037 [2024-11-19 15:18:05.384896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.037 [2024-11-19 15:18:05.384973] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2775845 ] 00:17:07.037 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.037 [2024-11-19 15:18:05.446870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:07.037 [2024-11-19 15:18:05.556631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:07.037 [2024-11-19 15:18:05.556682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:07.037 [2024-11-19 15:18:05.556685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.295 [2024-11-19 15:18:05.768098] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:07.296 [2024-11-19 15:18:05.768154] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:07.296 I/O targets: 00:17:07.296 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:07.296 00:17:07.296 00:17:07.296 CUnit - A unit testing framework for C - Version 2.1-3 00:17:07.296 http://cunit.sourceforge.net/ 00:17:07.296 00:17:07.296 00:17:07.296 Suite: bdevio tests on: Nvme1n1 00:17:07.296 Test: blockdev write read block ...passed 00:17:07.296 Test: blockdev write zeroes read block ...passed 00:17:07.554 Test: blockdev write zeroes read no split ...passed 00:17:07.554 Test: blockdev write zeroes read split ...passed 00:17:07.554 Test: blockdev write zeroes read split partial ...passed 00:17:07.554 Test: blockdev reset ...[2024-11-19 15:18:05.881627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:07.554 [2024-11-19 15:18:05.881744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2367f20 (9): Bad file descriptor 00:17:07.554 [2024-11-19 15:18:05.936276] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:07.554 passed 00:17:07.554 Test: blockdev write read 8 blocks ...passed 00:17:07.554 Test: blockdev write read size > 128k ...passed 00:17:07.554 Test: blockdev write read invalid size ...passed 00:17:07.554 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:07.554 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:07.554 Test: blockdev write read max offset ...passed 00:17:07.554 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:07.554 Test: blockdev writev readv 8 blocks ...passed 00:17:07.554 Test: blockdev writev readv 30 x 1block ...passed 00:17:07.813 Test: blockdev writev readv block ...passed 00:17:07.813 Test: blockdev writev readv size > 128k ...passed 00:17:07.813 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:07.813 Test: blockdev comparev and writev ...[2024-11-19 15:18:06.151763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.151799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.151823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.151840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.152938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:07.813 [2024-11-19 15:18:06.152955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:07.813 passed 00:17:07.813 Test: blockdev nvme passthru rw ...passed 00:17:07.813 Test: blockdev nvme passthru vendor specific ...[2024-11-19 15:18:06.236954] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:07.813 [2024-11-19 15:18:06.236981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.237129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:07.813 [2024-11-19 15:18:06.237153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.237288] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:07.813 [2024-11-19 15:18:06.237311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:07.813 [2024-11-19 15:18:06.237453] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:07.813 [2024-11-19 15:18:06.237476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:07.813 passed 00:17:07.813 Test: blockdev nvme admin passthru ...passed 00:17:07.813 Test: blockdev copy ...passed 00:17:07.813 00:17:07.813 Run Summary: Type Total Ran Passed Failed Inactive 00:17:07.813 suites 1 1 n/a 0 0 00:17:07.813 tests 23 23 23 0 0 00:17:07.813 asserts 152 152 152 0 n/a 00:17:07.813 00:17:07.813 Elapsed time = 1.051 seconds 00:17:08.072 15:18:06 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:08.072 15:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.072 15:18:06 -- common/autotest_common.sh@10 -- # set +x 00:17:08.072 15:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.072 15:18:06 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:08.072 15:18:06 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:08.072 15:18:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.072 15:18:06 -- nvmf/common.sh@116 -- # sync 00:17:08.072 15:18:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.072 15:18:06 -- nvmf/common.sh@119 -- # set +e 00:17:08.072 15:18:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.072 15:18:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.072 rmmod nvme_tcp 00:17:08.072 rmmod nvme_fabrics 00:17:08.072 rmmod nvme_keyring 00:17:08.072 15:18:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.072 15:18:06 -- nvmf/common.sh@123 -- # set -e 00:17:08.072 15:18:06 -- nvmf/common.sh@124 -- # return 0 00:17:08.072 15:18:06 -- nvmf/common.sh@477 -- # '[' -n 2775683 ']' 00:17:08.072 15:18:06 -- nvmf/common.sh@478 -- # killprocess 2775683 00:17:08.072 15:18:06 -- common/autotest_common.sh@936 -- # '[' -z 2775683 ']' 00:17:08.072 15:18:06 -- common/autotest_common.sh@940 -- # kill -0 2775683 00:17:08.072 15:18:06 -- common/autotest_common.sh@941 -- # uname 00:17:08.072 15:18:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.072 15:18:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2775683 00:17:08.329 15:18:06 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:08.329 15:18:06 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:08.329 15:18:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2775683' 00:17:08.329 killing process with pid 2775683 00:17:08.329 15:18:06 -- common/autotest_common.sh@955 -- # kill 2775683 00:17:08.329 15:18:06 -- common/autotest_common.sh@960 -- # wait 2775683 00:17:08.588 15:18:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:08.588 15:18:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:08.588 15:18:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:08.588 15:18:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:08.588 15:18:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:08.588 15:18:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.588 15:18:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.588 15:18:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.489 15:18:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:10.489 00:17:10.489 real 0m6.997s 00:17:10.489 user 0m12.777s 00:17:10.489 sys 0m2.061s 00:17:10.489 15:18:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:10.489 15:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:10.489 ************************************ 00:17:10.489 END TEST nvmf_bdevio 00:17:10.489 ************************************ 00:17:10.489 15:18:08 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:10.489 15:18:08 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:10.489 15:18:08 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:10.489 15:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:10.489 15:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:10.489 ************************************ 00:17:10.489 START TEST nvmf_bdevio_no_huge 00:17:10.489 ************************************ 00:17:10.489 15:18:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:10.489 * Looking for test storage... 00:17:10.489 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:10.489 15:18:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:10.489 15:18:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:10.489 15:18:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:10.749 15:18:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:10.749 15:18:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:10.749 15:18:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:10.749 15:18:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:10.749 15:18:09 -- scripts/common.sh@335 -- # IFS=.-: 00:17:10.749 15:18:09 -- scripts/common.sh@335 -- # read -ra ver1 00:17:10.749 15:18:09 -- scripts/common.sh@336 -- # IFS=.-: 00:17:10.749 15:18:09 -- scripts/common.sh@336 -- # read -ra ver2 00:17:10.749 15:18:09 -- scripts/common.sh@337 -- # local 'op=<' 00:17:10.749 15:18:09 -- scripts/common.sh@339 -- # ver1_l=2 00:17:10.749 15:18:09 -- scripts/common.sh@340 -- # ver2_l=1 00:17:10.749 15:18:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:10.749 15:18:09 -- scripts/common.sh@343 -- # case "$op" in 00:17:10.749 15:18:09 -- scripts/common.sh@344 -- # : 1 00:17:10.749 15:18:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:10.749 15:18:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:10.749 15:18:09 -- scripts/common.sh@364 -- # decimal 1 00:17:10.749 15:18:09 -- scripts/common.sh@352 -- # local d=1 00:17:10.749 15:18:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:10.749 15:18:09 -- scripts/common.sh@354 -- # echo 1 00:17:10.749 15:18:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:10.749 15:18:09 -- scripts/common.sh@365 -- # decimal 2 00:17:10.749 15:18:09 -- scripts/common.sh@352 -- # local d=2 00:17:10.749 15:18:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:10.749 15:18:09 -- scripts/common.sh@354 -- # echo 2 00:17:10.749 15:18:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:10.749 15:18:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:10.749 15:18:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:10.749 15:18:09 -- scripts/common.sh@367 -- # return 0 00:17:10.749 15:18:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:10.749 15:18:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:10.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.749 --rc genhtml_branch_coverage=1 00:17:10.749 --rc genhtml_function_coverage=1 00:17:10.749 --rc genhtml_legend=1 00:17:10.749 --rc geninfo_all_blocks=1 00:17:10.749 --rc geninfo_unexecuted_blocks=1 00:17:10.749 00:17:10.749 ' 00:17:10.749 15:18:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:10.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.749 --rc genhtml_branch_coverage=1 00:17:10.749 --rc genhtml_function_coverage=1 00:17:10.749 --rc genhtml_legend=1 00:17:10.749 --rc geninfo_all_blocks=1 00:17:10.749 --rc geninfo_unexecuted_blocks=1 00:17:10.749 00:17:10.749 ' 00:17:10.749 15:18:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:10.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.749 --rc genhtml_branch_coverage=1 00:17:10.749 --rc genhtml_function_coverage=1 00:17:10.749 --rc genhtml_legend=1 00:17:10.749 --rc geninfo_all_blocks=1 00:17:10.749 --rc geninfo_unexecuted_blocks=1 00:17:10.749 00:17:10.749 ' 00:17:10.749 15:18:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:10.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.749 --rc genhtml_branch_coverage=1 00:17:10.749 --rc genhtml_function_coverage=1 00:17:10.749 --rc genhtml_legend=1 00:17:10.749 --rc geninfo_all_blocks=1 00:17:10.749 --rc geninfo_unexecuted_blocks=1 00:17:10.749 00:17:10.749 ' 00:17:10.749 15:18:09 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:10.749 15:18:09 -- nvmf/common.sh@7 -- # uname -s 00:17:10.749 15:18:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:10.749 15:18:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:10.749 15:18:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:10.749 15:18:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:10.749 15:18:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:10.749 15:18:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:10.749 15:18:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:10.749 15:18:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:10.749 15:18:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:10.749 15:18:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:10.749 15:18:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.749 15:18:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.749 15:18:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:10.749 15:18:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:10.749 15:18:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:10.749 15:18:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:10.749 15:18:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:10.749 15:18:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:10.749 15:18:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:10.749 15:18:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.749 15:18:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.749 15:18:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.749 15:18:09 -- paths/export.sh@5 -- # export PATH 00:17:10.749 15:18:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.749 15:18:09 -- nvmf/common.sh@46 -- # : 0 00:17:10.749 15:18:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:10.749 15:18:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:10.749 15:18:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:10.749 15:18:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:10.749 15:18:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:10.749 15:18:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:10.749 15:18:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:10.749 15:18:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:10.749 15:18:09 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:10.749 15:18:09 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:10.749 15:18:09 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:10.749 15:18:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:10.749 15:18:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:10.749 15:18:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:10.749 15:18:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:10.749 15:18:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:10.749 15:18:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.749 15:18:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.750 15:18:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.750 15:18:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:10.750 15:18:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:10.750 15:18:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:10.750 15:18:09 -- common/autotest_common.sh@10 -- # set +x 00:17:12.651 15:18:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:12.651 15:18:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:12.651 15:18:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:12.651 15:18:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:12.651 15:18:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:12.651 15:18:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:12.651 15:18:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:12.651 15:18:11 -- nvmf/common.sh@294 -- # net_devs=() 00:17:12.651 15:18:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:12.651 15:18:11 -- nvmf/common.sh@295 -- # e810=() 00:17:12.651 15:18:11 -- nvmf/common.sh@295 -- # local -ga e810 00:17:12.651 15:18:11 -- nvmf/common.sh@296 -- # x722=() 00:17:12.651 15:18:11 -- nvmf/common.sh@296 -- # local -ga x722 00:17:12.651 15:18:11 -- nvmf/common.sh@297 -- # mlx=() 00:17:12.651 15:18:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:12.651 15:18:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:12.651 15:18:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:12.651 15:18:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:12.651 15:18:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.651 15:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:12.651 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:12.651 15:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.651 15:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:12.651 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:12.651 15:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.651 15:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.651 15:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.651 15:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:12.651 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:12.651 15:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.651 15:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.651 15:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.651 15:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.651 15:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:12.651 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:12.651 15:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.651 15:18:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:12.651 15:18:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:12.651 15:18:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:12.651 15:18:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:12.651 15:18:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:12.651 15:18:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:12.651 15:18:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:12.651 15:18:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:12.651 15:18:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:12.651 15:18:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:12.651 15:18:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:12.651 15:18:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:12.652 15:18:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:12.652 15:18:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:12.652 15:18:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:12.652 15:18:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:12.652 15:18:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:12.652 15:18:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:12.652 15:18:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:12.652 15:18:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:12.652 15:18:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:12.652 15:18:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:12.652 15:18:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:12.652 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:12.652 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:17:12.652 00:17:12.652 --- 10.0.0.2 ping statistics --- 00:17:12.652 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.652 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:17:12.652 15:18:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:12.652 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:12.652 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:17:12.652 00:17:12.652 --- 10.0.0.1 ping statistics --- 00:17:12.652 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.652 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:17:12.652 15:18:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:12.652 15:18:11 -- nvmf/common.sh@410 -- # return 0 00:17:12.652 15:18:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:12.652 15:18:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:12.652 15:18:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:12.652 15:18:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:12.652 15:18:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:12.652 15:18:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:12.652 15:18:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:12.910 15:18:11 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:12.910 15:18:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:12.910 15:18:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:12.910 15:18:11 -- common/autotest_common.sh@10 -- # set +x 00:17:12.910 15:18:11 -- nvmf/common.sh@469 -- # nvmfpid=2778441 00:17:12.910 15:18:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:12.910 15:18:11 -- nvmf/common.sh@470 -- # waitforlisten 2778441 00:17:12.910 15:18:11 -- common/autotest_common.sh@829 -- # '[' -z 2778441 ']' 00:17:12.910 15:18:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:12.910 15:18:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:12.910 15:18:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:12.910 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:12.910 15:18:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:12.910 15:18:11 -- common/autotest_common.sh@10 -- # set +x 00:17:12.910 [2024-11-19 15:18:11.261434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:12.910 [2024-11-19 15:18:11.261512] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:12.910 [2024-11-19 15:18:11.333377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:12.910 [2024-11-19 15:18:11.437111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:12.910 [2024-11-19 15:18:11.437269] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:12.910 [2024-11-19 15:18:11.437297] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:12.910 [2024-11-19 15:18:11.437310] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:12.910 [2024-11-19 15:18:11.437414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:12.910 [2024-11-19 15:18:11.437466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:12.910 [2024-11-19 15:18:11.437720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:12.910 [2024-11-19 15:18:11.437725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:13.845 15:18:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.845 15:18:12 -- common/autotest_common.sh@862 -- # return 0 00:17:13.845 15:18:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:13.845 15:18:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 15:18:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.845 15:18:12 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:13.845 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 [2024-11-19 15:18:12.278441] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:13.845 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.845 15:18:12 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:13.845 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 Malloc0 00:17:13.845 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.845 15:18:12 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:13.845 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.845 15:18:12 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:13.845 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.845 15:18:12 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:13.845 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.845 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:13.845 [2024-11-19 15:18:12.316957] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:13.845 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.845 15:18:12 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:13.845 15:18:12 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:13.845 15:18:12 -- nvmf/common.sh@520 -- # config=() 00:17:13.845 15:18:12 -- nvmf/common.sh@520 -- # local subsystem config 00:17:13.845 15:18:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:13.845 15:18:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:13.845 { 00:17:13.845 "params": { 00:17:13.845 "name": "Nvme$subsystem", 00:17:13.845 "trtype": "$TEST_TRANSPORT", 00:17:13.845 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:13.845 "adrfam": "ipv4", 00:17:13.845 "trsvcid": "$NVMF_PORT", 00:17:13.845 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:13.845 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:13.845 "hdgst": ${hdgst:-false}, 00:17:13.845 "ddgst": ${ddgst:-false} 00:17:13.845 }, 00:17:13.845 "method": "bdev_nvme_attach_controller" 00:17:13.845 } 00:17:13.845 EOF 00:17:13.845 )") 00:17:13.845 15:18:12 -- nvmf/common.sh@542 -- # cat 00:17:13.845 15:18:12 -- nvmf/common.sh@544 -- # jq . 00:17:13.845 15:18:12 -- nvmf/common.sh@545 -- # IFS=, 00:17:13.845 15:18:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:13.845 "params": { 00:17:13.845 "name": "Nvme1", 00:17:13.845 "trtype": "tcp", 00:17:13.845 "traddr": "10.0.0.2", 00:17:13.845 "adrfam": "ipv4", 00:17:13.845 "trsvcid": "4420", 00:17:13.845 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:13.845 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:13.845 "hdgst": false, 00:17:13.845 "ddgst": false 00:17:13.845 }, 00:17:13.845 "method": "bdev_nvme_attach_controller" 00:17:13.845 }' 00:17:13.845 [2024-11-19 15:18:12.361262] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.845 [2024-11-19 15:18:12.361339] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2778601 ] 00:17:14.104 [2024-11-19 15:18:12.424075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:14.104 [2024-11-19 15:18:12.538757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:14.104 [2024-11-19 15:18:12.538810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.104 [2024-11-19 15:18:12.538814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:14.362 [2024-11-19 15:18:12.732409] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:14.362 [2024-11-19 15:18:12.732470] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:14.362 I/O targets: 00:17:14.362 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:14.362 00:17:14.362 00:17:14.362 CUnit - A unit testing framework for C - Version 2.1-3 00:17:14.362 http://cunit.sourceforge.net/ 00:17:14.362 00:17:14.362 00:17:14.362 Suite: bdevio tests on: Nvme1n1 00:17:14.362 Test: blockdev write read block ...passed 00:17:14.362 Test: blockdev write zeroes read block ...passed 00:17:14.362 Test: blockdev write zeroes read no split ...passed 00:17:14.362 Test: blockdev write zeroes read split ...passed 00:17:14.619 Test: blockdev write zeroes read split partial ...passed 00:17:14.619 Test: blockdev reset ...[2024-11-19 15:18:12.934071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:14.619 [2024-11-19 15:18:12.934174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f57d0 (9): Bad file descriptor 00:17:14.619 [2024-11-19 15:18:13.071238] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:14.619 passed 00:17:14.619 Test: blockdev write read 8 blocks ...passed 00:17:14.619 Test: blockdev write read size > 128k ...passed 00:17:14.619 Test: blockdev write read invalid size ...passed 00:17:14.619 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:14.619 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:14.619 Test: blockdev write read max offset ...passed 00:17:14.877 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:14.877 Test: blockdev writev readv 8 blocks ...passed 00:17:14.878 Test: blockdev writev readv 30 x 1block ...passed 00:17:14.878 Test: blockdev writev readv block ...passed 00:17:14.878 Test: blockdev writev readv size > 128k ...passed 00:17:14.878 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:14.878 Test: blockdev comparev and writev ...[2024-11-19 15:18:13.285697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.285733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.285758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.285775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.286883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:14.878 [2024-11-19 15:18:13.286898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:14.878 passed 00:17:14.878 Test: blockdev nvme passthru rw ...passed 00:17:14.878 Test: blockdev nvme passthru vendor specific ...[2024-11-19 15:18:13.370964] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:14.878 [2024-11-19 15:18:13.370992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.371131] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:14.878 [2024-11-19 15:18:13.371153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.371293] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:14.878 [2024-11-19 15:18:13.371314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:14.878 [2024-11-19 15:18:13.371453] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:14.878 [2024-11-19 15:18:13.371475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:14.878 passed 00:17:14.878 Test: blockdev nvme admin passthru ...passed 00:17:14.878 Test: blockdev copy ...passed 00:17:14.878 00:17:14.878 Run Summary: Type Total Ran Passed Failed Inactive 00:17:14.878 suites 1 1 n/a 0 0 00:17:14.878 tests 23 23 23 0 0 00:17:14.878 asserts 152 152 152 0 n/a 00:17:14.878 00:17:14.878 Elapsed time = 1.388 seconds 00:17:15.444 15:18:13 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:15.444 15:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.444 15:18:13 -- common/autotest_common.sh@10 -- # set +x 00:17:15.444 15:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.444 15:18:13 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:15.444 15:18:13 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:15.444 15:18:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:15.444 15:18:13 -- nvmf/common.sh@116 -- # sync 00:17:15.444 15:18:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:15.445 15:18:13 -- nvmf/common.sh@119 -- # set +e 00:17:15.445 15:18:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:15.445 15:18:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:15.445 rmmod nvme_tcp 00:17:15.445 rmmod nvme_fabrics 00:17:15.445 rmmod nvme_keyring 00:17:15.445 15:18:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:15.445 15:18:13 -- nvmf/common.sh@123 -- # set -e 00:17:15.445 15:18:13 -- nvmf/common.sh@124 -- # return 0 00:17:15.445 15:18:13 -- nvmf/common.sh@477 -- # '[' -n 2778441 ']' 00:17:15.445 15:18:13 -- nvmf/common.sh@478 -- # killprocess 2778441 00:17:15.445 15:18:13 -- common/autotest_common.sh@936 -- # '[' -z 2778441 ']' 00:17:15.445 15:18:13 -- common/autotest_common.sh@940 -- # kill -0 2778441 00:17:15.445 15:18:13 -- common/autotest_common.sh@941 -- # uname 00:17:15.445 15:18:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:15.445 15:18:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2778441 00:17:15.445 15:18:13 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:15.445 15:18:13 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:15.445 15:18:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2778441' 00:17:15.445 killing process with pid 2778441 00:17:15.445 15:18:13 -- common/autotest_common.sh@955 -- # kill 2778441 00:17:15.445 15:18:13 -- common/autotest_common.sh@960 -- # wait 2778441 00:17:16.012 15:18:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:16.012 15:18:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:16.012 15:18:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:16.012 15:18:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:16.012 15:18:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:16.012 15:18:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.012 15:18:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:16.012 15:18:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:17.920 15:18:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:17.920 00:17:17.920 real 0m7.417s 00:17:17.920 user 0m14.638s 00:17:17.920 sys 0m2.530s 00:17:17.920 15:18:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:17.920 15:18:16 -- common/autotest_common.sh@10 -- # set +x 00:17:17.920 ************************************ 00:17:17.920 END TEST nvmf_bdevio_no_huge 00:17:17.920 ************************************ 00:17:17.920 15:18:16 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:17.920 15:18:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:17.920 15:18:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:17.920 15:18:16 -- common/autotest_common.sh@10 -- # set +x 00:17:17.920 ************************************ 00:17:17.920 START TEST nvmf_tls 00:17:17.920 ************************************ 00:17:17.920 15:18:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:18.179 * Looking for test storage... 00:17:18.179 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:18.179 15:18:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:18.179 15:18:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:18.179 15:18:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:18.179 15:18:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:18.179 15:18:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:18.179 15:18:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:18.179 15:18:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:18.179 15:18:16 -- scripts/common.sh@335 -- # IFS=.-: 00:17:18.179 15:18:16 -- scripts/common.sh@335 -- # read -ra ver1 00:17:18.179 15:18:16 -- scripts/common.sh@336 -- # IFS=.-: 00:17:18.179 15:18:16 -- scripts/common.sh@336 -- # read -ra ver2 00:17:18.179 15:18:16 -- scripts/common.sh@337 -- # local 'op=<' 00:17:18.179 15:18:16 -- scripts/common.sh@339 -- # ver1_l=2 00:17:18.179 15:18:16 -- scripts/common.sh@340 -- # ver2_l=1 00:17:18.179 15:18:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:18.179 15:18:16 -- scripts/common.sh@343 -- # case "$op" in 00:17:18.179 15:18:16 -- scripts/common.sh@344 -- # : 1 00:17:18.179 15:18:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:18.179 15:18:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:18.179 15:18:16 -- scripts/common.sh@364 -- # decimal 1 00:17:18.179 15:18:16 -- scripts/common.sh@352 -- # local d=1 00:17:18.179 15:18:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:18.179 15:18:16 -- scripts/common.sh@354 -- # echo 1 00:17:18.179 15:18:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:18.179 15:18:16 -- scripts/common.sh@365 -- # decimal 2 00:17:18.179 15:18:16 -- scripts/common.sh@352 -- # local d=2 00:17:18.179 15:18:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:18.179 15:18:16 -- scripts/common.sh@354 -- # echo 2 00:17:18.179 15:18:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:18.179 15:18:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:18.179 15:18:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:18.179 15:18:16 -- scripts/common.sh@367 -- # return 0 00:17:18.179 15:18:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:18.179 15:18:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:18.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:18.179 --rc genhtml_branch_coverage=1 00:17:18.179 --rc genhtml_function_coverage=1 00:17:18.179 --rc genhtml_legend=1 00:17:18.179 --rc geninfo_all_blocks=1 00:17:18.179 --rc geninfo_unexecuted_blocks=1 00:17:18.179 00:17:18.179 ' 00:17:18.179 15:18:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:18.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:18.179 --rc genhtml_branch_coverage=1 00:17:18.179 --rc genhtml_function_coverage=1 00:17:18.179 --rc genhtml_legend=1 00:17:18.179 --rc geninfo_all_blocks=1 00:17:18.179 --rc geninfo_unexecuted_blocks=1 00:17:18.179 00:17:18.179 ' 00:17:18.179 15:18:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:18.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:18.179 --rc genhtml_branch_coverage=1 00:17:18.180 --rc genhtml_function_coverage=1 00:17:18.180 --rc genhtml_legend=1 00:17:18.180 --rc geninfo_all_blocks=1 00:17:18.180 --rc geninfo_unexecuted_blocks=1 00:17:18.180 00:17:18.180 ' 00:17:18.180 15:18:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:18.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:18.180 --rc genhtml_branch_coverage=1 00:17:18.180 --rc genhtml_function_coverage=1 00:17:18.180 --rc genhtml_legend=1 00:17:18.180 --rc geninfo_all_blocks=1 00:17:18.180 --rc geninfo_unexecuted_blocks=1 00:17:18.180 00:17:18.180 ' 00:17:18.180 15:18:16 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:18.180 15:18:16 -- nvmf/common.sh@7 -- # uname -s 00:17:18.180 15:18:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:18.180 15:18:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:18.180 15:18:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:18.180 15:18:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:18.180 15:18:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:18.180 15:18:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:18.180 15:18:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:18.180 15:18:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:18.180 15:18:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:18.180 15:18:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:18.180 15:18:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:18.180 15:18:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:18.180 15:18:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:18.180 15:18:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:18.180 15:18:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:18.180 15:18:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:18.180 15:18:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:18.180 15:18:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:18.180 15:18:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:18.180 15:18:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:18.180 15:18:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:18.180 15:18:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:18.180 15:18:16 -- paths/export.sh@5 -- # export PATH 00:17:18.180 15:18:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:18.180 15:18:16 -- nvmf/common.sh@46 -- # : 0 00:17:18.180 15:18:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:18.180 15:18:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:18.180 15:18:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:18.180 15:18:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:18.180 15:18:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:18.180 15:18:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:18.180 15:18:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:18.180 15:18:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:18.180 15:18:16 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:18.180 15:18:16 -- target/tls.sh@71 -- # nvmftestinit 00:17:18.180 15:18:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:18.180 15:18:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:18.180 15:18:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:18.180 15:18:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:18.180 15:18:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:18.180 15:18:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:18.180 15:18:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:18.180 15:18:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:18.180 15:18:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:18.180 15:18:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:18.180 15:18:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:18.180 15:18:16 -- common/autotest_common.sh@10 -- # set +x 00:17:20.716 15:18:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:20.716 15:18:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:20.716 15:18:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:20.716 15:18:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:20.716 15:18:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:20.716 15:18:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:20.716 15:18:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:20.716 15:18:18 -- nvmf/common.sh@294 -- # net_devs=() 00:17:20.716 15:18:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:20.716 15:18:18 -- nvmf/common.sh@295 -- # e810=() 00:17:20.716 15:18:18 -- nvmf/common.sh@295 -- # local -ga e810 00:17:20.716 15:18:18 -- nvmf/common.sh@296 -- # x722=() 00:17:20.716 15:18:18 -- nvmf/common.sh@296 -- # local -ga x722 00:17:20.716 15:18:18 -- nvmf/common.sh@297 -- # mlx=() 00:17:20.716 15:18:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:20.716 15:18:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:20.716 15:18:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:20.716 15:18:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:20.716 15:18:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:20.716 15:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:20.716 15:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:20.716 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:20.716 15:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:20.716 15:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:20.716 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:20.716 15:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:20.716 15:18:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:20.716 15:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:20.716 15:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:20.716 15:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:20.716 15:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:20.717 15:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:20.717 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:20.717 15:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:20.717 15:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:20.717 15:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:20.717 15:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:20.717 15:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:20.717 15:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:20.717 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:20.717 15:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:20.717 15:18:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:20.717 15:18:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:20.717 15:18:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:20.717 15:18:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:20.717 15:18:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:20.717 15:18:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:20.717 15:18:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:20.717 15:18:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:20.717 15:18:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:20.717 15:18:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:20.717 15:18:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:20.717 15:18:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:20.717 15:18:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:20.717 15:18:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:20.717 15:18:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:20.717 15:18:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:20.717 15:18:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:20.717 15:18:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:20.717 15:18:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:20.717 15:18:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:20.717 15:18:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:20.717 15:18:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:20.717 15:18:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:20.717 15:18:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:20.717 15:18:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:20.717 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:20.717 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:17:20.717 00:17:20.717 --- 10.0.0.2 ping statistics --- 00:17:20.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:20.717 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:17:20.717 15:18:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:20.717 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:20.717 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:17:20.717 00:17:20.717 --- 10.0.0.1 ping statistics --- 00:17:20.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:20.717 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:17:20.717 15:18:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:20.717 15:18:18 -- nvmf/common.sh@410 -- # return 0 00:17:20.717 15:18:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:20.717 15:18:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:20.717 15:18:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:20.717 15:18:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:20.717 15:18:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:20.717 15:18:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:20.717 15:18:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:20.717 15:18:18 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:20.717 15:18:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:20.717 15:18:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:20.717 15:18:18 -- common/autotest_common.sh@10 -- # set +x 00:17:20.717 15:18:18 -- nvmf/common.sh@469 -- # nvmfpid=2780809 00:17:20.717 15:18:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:20.717 15:18:18 -- nvmf/common.sh@470 -- # waitforlisten 2780809 00:17:20.717 15:18:18 -- common/autotest_common.sh@829 -- # '[' -z 2780809 ']' 00:17:20.717 15:18:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:20.717 15:18:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:20.717 15:18:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:20.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:20.717 15:18:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:20.717 15:18:18 -- common/autotest_common.sh@10 -- # set +x 00:17:20.717 [2024-11-19 15:18:18.903475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:20.717 [2024-11-19 15:18:18.903555] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:20.717 EAL: No free 2048 kB hugepages reported on node 1 00:17:20.717 [2024-11-19 15:18:18.970087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:20.717 [2024-11-19 15:18:19.075378] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:20.717 [2024-11-19 15:18:19.075524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:20.717 [2024-11-19 15:18:19.075546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:20.717 [2024-11-19 15:18:19.075559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:20.717 [2024-11-19 15:18:19.075585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:20.717 15:18:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:20.717 15:18:19 -- common/autotest_common.sh@862 -- # return 0 00:17:20.717 15:18:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:20.717 15:18:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:20.717 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:17:20.717 15:18:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:20.717 15:18:19 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:20.717 15:18:19 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:20.975 true 00:17:20.975 15:18:19 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:20.975 15:18:19 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:21.233 15:18:19 -- target/tls.sh@82 -- # version=0 00:17:21.233 15:18:19 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:21.233 15:18:19 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:21.492 15:18:19 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:21.492 15:18:19 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:21.750 15:18:20 -- target/tls.sh@90 -- # version=13 00:17:21.750 15:18:20 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:21.750 15:18:20 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:22.009 15:18:20 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.009 15:18:20 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:22.268 15:18:20 -- target/tls.sh@98 -- # version=7 00:17:22.268 15:18:20 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:22.268 15:18:20 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.268 15:18:20 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:22.526 15:18:20 -- target/tls.sh@105 -- # ktls=false 00:17:22.526 15:18:20 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:22.526 15:18:20 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:22.785 15:18:21 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.785 15:18:21 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:23.043 15:18:21 -- target/tls.sh@113 -- # ktls=true 00:17:23.043 15:18:21 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:23.043 15:18:21 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:23.302 15:18:21 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.302 15:18:21 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:23.560 15:18:22 -- target/tls.sh@121 -- # ktls=false 00:17:23.560 15:18:22 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:23.560 15:18:22 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:23.560 15:18:22 -- target/tls.sh@49 -- # local key hash crc 00:17:23.560 15:18:22 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:23.560 15:18:22 -- target/tls.sh@51 -- # hash=01 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # gzip -1 -c 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # tail -c8 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # head -c 4 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # crc='p$H�' 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:23.560 15:18:22 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:23.560 15:18:22 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:23.560 15:18:22 -- target/tls.sh@49 -- # local key hash crc 00:17:23.560 15:18:22 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:23.560 15:18:22 -- target/tls.sh@51 -- # hash=01 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # gzip -1 -c 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # tail -c8 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # head -c 4 00:17:23.560 15:18:22 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:23.560 15:18:22 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:23.560 15:18:22 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:23.560 15:18:22 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.560 15:18:22 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:23.560 15:18:22 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:23.560 15:18:22 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:23.560 15:18:22 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.560 15:18:22 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:23.560 15:18:22 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:23.818 15:18:22 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:24.385 15:18:22 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:24.385 15:18:22 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:24.385 15:18:22 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:24.385 [2024-11-19 15:18:22.915707] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:24.385 15:18:22 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:24.952 15:18:23 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:24.952 [2024-11-19 15:18:23.469207] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:24.952 [2024-11-19 15:18:23.469432] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:24.952 15:18:23 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:25.210 malloc0 00:17:25.210 15:18:23 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:25.468 15:18:24 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.727 15:18:24 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.986 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.959 Initializing NVMe Controllers 00:17:35.960 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:35.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:35.960 Initialization complete. Launching workers. 00:17:35.960 ======================================================== 00:17:35.960 Latency(us) 00:17:35.960 Device Information : IOPS MiB/s Average min max 00:17:35.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7795.85 30.45 8212.10 1218.37 9280.65 00:17:35.960 ======================================================== 00:17:35.960 Total : 7795.85 30.45 8212.10 1218.37 9280.65 00:17:35.960 00:17:35.960 15:18:34 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:35.960 15:18:34 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:35.960 15:18:34 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:35.960 15:18:34 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:35.960 15:18:34 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:35.960 15:18:34 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:35.960 15:18:34 -- target/tls.sh@28 -- # bdevperf_pid=2782778 00:17:35.960 15:18:34 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:35.960 15:18:34 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:35.960 15:18:34 -- target/tls.sh@31 -- # waitforlisten 2782778 /var/tmp/bdevperf.sock 00:17:35.960 15:18:34 -- common/autotest_common.sh@829 -- # '[' -z 2782778 ']' 00:17:35.960 15:18:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:35.960 15:18:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:35.960 15:18:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:35.960 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:35.960 15:18:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:35.960 15:18:34 -- common/autotest_common.sh@10 -- # set +x 00:17:35.960 [2024-11-19 15:18:34.401419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:35.960 [2024-11-19 15:18:34.401488] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2782778 ] 00:17:35.960 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.960 [2024-11-19 15:18:34.457443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.218 [2024-11-19 15:18:34.561474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:37.152 15:18:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:37.152 15:18:35 -- common/autotest_common.sh@862 -- # return 0 00:17:37.152 15:18:35 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.152 [2024-11-19 15:18:35.626524] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:37.152 TLSTESTn1 00:17:37.410 15:18:35 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:37.410 Running I/O for 10 seconds... 00:17:47.427 00:17:47.427 Latency(us) 00:17:47.427 [2024-11-19T14:18:45.990Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.427 [2024-11-19T14:18:45.990Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:47.427 Verification LBA range: start 0x0 length 0x2000 00:17:47.427 TLSTESTn1 : 10.02 4589.94 17.93 0.00 0.00 27850.64 4927.34 43496.49 00:17:47.427 [2024-11-19T14:18:45.990Z] =================================================================================================================== 00:17:47.427 [2024-11-19T14:18:45.990Z] Total : 4589.94 17.93 0.00 0.00 27850.64 4927.34 43496.49 00:17:47.427 0 00:17:47.427 15:18:45 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:47.427 15:18:45 -- target/tls.sh@45 -- # killprocess 2782778 00:17:47.427 15:18:45 -- common/autotest_common.sh@936 -- # '[' -z 2782778 ']' 00:17:47.427 15:18:45 -- common/autotest_common.sh@940 -- # kill -0 2782778 00:17:47.427 15:18:45 -- common/autotest_common.sh@941 -- # uname 00:17:47.427 15:18:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.427 15:18:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2782778 00:17:47.427 15:18:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:47.427 15:18:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:47.427 15:18:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2782778' 00:17:47.427 killing process with pid 2782778 00:17:47.427 15:18:45 -- common/autotest_common.sh@955 -- # kill 2782778 00:17:47.427 Received shutdown signal, test time was about 10.000000 seconds 00:17:47.427 00:17:47.427 Latency(us) 00:17:47.427 [2024-11-19T14:18:45.990Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.427 [2024-11-19T14:18:45.990Z] =================================================================================================================== 00:17:47.427 [2024-11-19T14:18:45.990Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:47.427 15:18:45 -- common/autotest_common.sh@960 -- # wait 2782778 00:17:47.685 15:18:46 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.685 15:18:46 -- common/autotest_common.sh@650 -- # local es=0 00:17:47.685 15:18:46 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.685 15:18:46 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:47.685 15:18:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.685 15:18:46 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:47.685 15:18:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.685 15:18:46 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.685 15:18:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:47.685 15:18:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:47.685 15:18:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:47.685 15:18:46 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:47.685 15:18:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:47.685 15:18:46 -- target/tls.sh@28 -- # bdevperf_pid=2784144 00:17:47.685 15:18:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:47.685 15:18:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:47.685 15:18:46 -- target/tls.sh@31 -- # waitforlisten 2784144 /var/tmp/bdevperf.sock 00:17:47.685 15:18:46 -- common/autotest_common.sh@829 -- # '[' -z 2784144 ']' 00:17:47.685 15:18:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:47.685 15:18:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.685 15:18:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:47.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:47.685 15:18:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.685 15:18:46 -- common/autotest_common.sh@10 -- # set +x 00:17:47.685 [2024-11-19 15:18:46.230326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:47.685 [2024-11-19 15:18:46.230427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2784144 ] 00:17:47.943 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.943 [2024-11-19 15:18:46.286955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:47.943 [2024-11-19 15:18:46.387160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:48.876 15:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:48.876 15:18:47 -- common/autotest_common.sh@862 -- # return 0 00:17:48.876 15:18:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.135 [2024-11-19 15:18:47.511853] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:49.135 [2024-11-19 15:18:47.519734] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:49.135 [2024-11-19 15:18:47.519785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x161d1f0 (107): Transport endpoint is not connected 00:17:49.135 [2024-11-19 15:18:47.520740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x161d1f0 (9): Bad file descriptor 00:17:49.135 [2024-11-19 15:18:47.521738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:49.135 [2024-11-19 15:18:47.521758] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:49.135 [2024-11-19 15:18:47.521771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:49.135 request: 00:17:49.135 { 00:17:49.135 "name": "TLSTEST", 00:17:49.135 "trtype": "tcp", 00:17:49.135 "traddr": "10.0.0.2", 00:17:49.135 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:49.135 "adrfam": "ipv4", 00:17:49.135 "trsvcid": "4420", 00:17:49.135 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:49.135 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:49.135 "method": "bdev_nvme_attach_controller", 00:17:49.135 "req_id": 1 00:17:49.135 } 00:17:49.135 Got JSON-RPC error response 00:17:49.135 response: 00:17:49.135 { 00:17:49.135 "code": -32602, 00:17:49.135 "message": "Invalid parameters" 00:17:49.135 } 00:17:49.135 15:18:47 -- target/tls.sh@36 -- # killprocess 2784144 00:17:49.135 15:18:47 -- common/autotest_common.sh@936 -- # '[' -z 2784144 ']' 00:17:49.135 15:18:47 -- common/autotest_common.sh@940 -- # kill -0 2784144 00:17:49.135 15:18:47 -- common/autotest_common.sh@941 -- # uname 00:17:49.135 15:18:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.135 15:18:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2784144 00:17:49.135 15:18:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.135 15:18:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.135 15:18:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2784144' 00:17:49.135 killing process with pid 2784144 00:17:49.135 15:18:47 -- common/autotest_common.sh@955 -- # kill 2784144 00:17:49.135 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.135 00:17:49.135 Latency(us) 00:17:49.135 [2024-11-19T14:18:47.698Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.135 [2024-11-19T14:18:47.698Z] =================================================================================================================== 00:17:49.135 [2024-11-19T14:18:47.698Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:49.135 15:18:47 -- common/autotest_common.sh@960 -- # wait 2784144 00:17:49.393 15:18:47 -- target/tls.sh@37 -- # return 1 00:17:49.393 15:18:47 -- common/autotest_common.sh@653 -- # es=1 00:17:49.394 15:18:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:49.394 15:18:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:49.394 15:18:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:49.394 15:18:47 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.394 15:18:47 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.394 15:18:47 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.394 15:18:47 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:49.394 15:18:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.394 15:18:47 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:49.394 15:18:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.394 15:18:47 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.394 15:18:47 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:49.394 15:18:47 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:49.394 15:18:47 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:49.394 15:18:47 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:49.394 15:18:47 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:49.394 15:18:47 -- target/tls.sh@28 -- # bdevperf_pid=2784399 00:17:49.394 15:18:47 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:49.394 15:18:47 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:49.394 15:18:47 -- target/tls.sh@31 -- # waitforlisten 2784399 /var/tmp/bdevperf.sock 00:17:49.394 15:18:47 -- common/autotest_common.sh@829 -- # '[' -z 2784399 ']' 00:17:49.394 15:18:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.394 15:18:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.394 15:18:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.394 15:18:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.394 15:18:47 -- common/autotest_common.sh@10 -- # set +x 00:17:49.394 [2024-11-19 15:18:47.872945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:49.394 [2024-11-19 15:18:47.873055] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2784399 ] 00:17:49.394 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.394 [2024-11-19 15:18:47.930634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.653 [2024-11-19 15:18:48.035891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.587 15:18:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:50.587 15:18:48 -- common/autotest_common.sh@862 -- # return 0 00:17:50.587 15:18:48 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:50.587 [2024-11-19 15:18:49.104630] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:50.587 [2024-11-19 15:18:49.113764] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:50.587 [2024-11-19 15:18:49.113796] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:50.587 [2024-11-19 15:18:49.113848] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:50.587 [2024-11-19 15:18:49.114421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfb1f0 (107): Transport endpoint is not connected 00:17:50.587 [2024-11-19 15:18:49.115411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfb1f0 (9): Bad file descriptor 00:17:50.587 [2024-11-19 15:18:49.116410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:50.587 [2024-11-19 15:18:49.116430] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:50.587 [2024-11-19 15:18:49.116443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:50.587 request: 00:17:50.587 { 00:17:50.587 "name": "TLSTEST", 00:17:50.587 "trtype": "tcp", 00:17:50.587 "traddr": "10.0.0.2", 00:17:50.587 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:50.587 "adrfam": "ipv4", 00:17:50.587 "trsvcid": "4420", 00:17:50.587 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:50.587 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:50.587 "method": "bdev_nvme_attach_controller", 00:17:50.587 "req_id": 1 00:17:50.587 } 00:17:50.587 Got JSON-RPC error response 00:17:50.587 response: 00:17:50.587 { 00:17:50.587 "code": -32602, 00:17:50.587 "message": "Invalid parameters" 00:17:50.587 } 00:17:50.587 15:18:49 -- target/tls.sh@36 -- # killprocess 2784399 00:17:50.587 15:18:49 -- common/autotest_common.sh@936 -- # '[' -z 2784399 ']' 00:17:50.587 15:18:49 -- common/autotest_common.sh@940 -- # kill -0 2784399 00:17:50.587 15:18:49 -- common/autotest_common.sh@941 -- # uname 00:17:50.587 15:18:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.587 15:18:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2784399 00:17:50.845 15:18:49 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:50.845 15:18:49 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:50.845 15:18:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2784399' 00:17:50.845 killing process with pid 2784399 00:17:50.845 15:18:49 -- common/autotest_common.sh@955 -- # kill 2784399 00:17:50.845 Received shutdown signal, test time was about 10.000000 seconds 00:17:50.845 00:17:50.845 Latency(us) 00:17:50.845 [2024-11-19T14:18:49.408Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:50.845 [2024-11-19T14:18:49.408Z] =================================================================================================================== 00:17:50.845 [2024-11-19T14:18:49.408Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:50.845 15:18:49 -- common/autotest_common.sh@960 -- # wait 2784399 00:17:51.103 15:18:49 -- target/tls.sh@37 -- # return 1 00:17:51.103 15:18:49 -- common/autotest_common.sh@653 -- # es=1 00:17:51.103 15:18:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.103 15:18:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.103 15:18:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.103 15:18:49 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.103 15:18:49 -- common/autotest_common.sh@650 -- # local es=0 00:17:51.103 15:18:49 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.103 15:18:49 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:51.103 15:18:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.103 15:18:49 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:51.103 15:18:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.103 15:18:49 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.103 15:18:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:51.103 15:18:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:51.103 15:18:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:51.103 15:18:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:51.103 15:18:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.103 15:18:49 -- target/tls.sh@28 -- # bdevperf_pid=2784569 00:17:51.103 15:18:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:51.103 15:18:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:51.103 15:18:49 -- target/tls.sh@31 -- # waitforlisten 2784569 /var/tmp/bdevperf.sock 00:17:51.103 15:18:49 -- common/autotest_common.sh@829 -- # '[' -z 2784569 ']' 00:17:51.103 15:18:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.103 15:18:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.103 15:18:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.103 15:18:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.103 15:18:49 -- common/autotest_common.sh@10 -- # set +x 00:17:51.103 [2024-11-19 15:18:49.475738] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:51.103 [2024-11-19 15:18:49.475827] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2784569 ] 00:17:51.103 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.103 [2024-11-19 15:18:49.534365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.103 [2024-11-19 15:18:49.638262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.037 15:18:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.037 15:18:50 -- common/autotest_common.sh@862 -- # return 0 00:17:52.037 15:18:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.295 [2024-11-19 15:18:50.756943] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:52.295 [2024-11-19 15:18:50.768055] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:52.295 [2024-11-19 15:18:50.768100] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:52.295 [2024-11-19 15:18:50.768152] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:52.295 [2024-11-19 15:18:50.768722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22021f0 (107): Transport endpoint is not connected 00:17:52.295 [2024-11-19 15:18:50.769712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22021f0 (9): Bad file descriptor 00:17:52.295 [2024-11-19 15:18:50.770711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:52.295 [2024-11-19 15:18:50.770733] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:52.295 [2024-11-19 15:18:50.770745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:52.295 request: 00:17:52.295 { 00:17:52.295 "name": "TLSTEST", 00:17:52.295 "trtype": "tcp", 00:17:52.295 "traddr": "10.0.0.2", 00:17:52.295 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:52.295 "adrfam": "ipv4", 00:17:52.295 "trsvcid": "4420", 00:17:52.295 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:52.295 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:52.295 "method": "bdev_nvme_attach_controller", 00:17:52.295 "req_id": 1 00:17:52.295 } 00:17:52.295 Got JSON-RPC error response 00:17:52.295 response: 00:17:52.295 { 00:17:52.295 "code": -32602, 00:17:52.295 "message": "Invalid parameters" 00:17:52.295 } 00:17:52.295 15:18:50 -- target/tls.sh@36 -- # killprocess 2784569 00:17:52.295 15:18:50 -- common/autotest_common.sh@936 -- # '[' -z 2784569 ']' 00:17:52.295 15:18:50 -- common/autotest_common.sh@940 -- # kill -0 2784569 00:17:52.295 15:18:50 -- common/autotest_common.sh@941 -- # uname 00:17:52.295 15:18:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:52.295 15:18:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2784569 00:17:52.295 15:18:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:52.295 15:18:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:52.295 15:18:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2784569' 00:17:52.296 killing process with pid 2784569 00:17:52.296 15:18:50 -- common/autotest_common.sh@955 -- # kill 2784569 00:17:52.296 Received shutdown signal, test time was about 10.000000 seconds 00:17:52.296 00:17:52.296 Latency(us) 00:17:52.296 [2024-11-19T14:18:50.859Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.296 [2024-11-19T14:18:50.859Z] =================================================================================================================== 00:17:52.296 [2024-11-19T14:18:50.859Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:52.296 15:18:50 -- common/autotest_common.sh@960 -- # wait 2784569 00:17:52.554 15:18:51 -- target/tls.sh@37 -- # return 1 00:17:52.554 15:18:51 -- common/autotest_common.sh@653 -- # es=1 00:17:52.554 15:18:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:52.554 15:18:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:52.554 15:18:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:52.554 15:18:51 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:52.554 15:18:51 -- common/autotest_common.sh@650 -- # local es=0 00:17:52.554 15:18:51 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:52.554 15:18:51 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:52.554 15:18:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.554 15:18:51 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:52.554 15:18:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:52.554 15:18:51 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:52.554 15:18:51 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:52.554 15:18:51 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:52.554 15:18:51 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:52.554 15:18:51 -- target/tls.sh@23 -- # psk= 00:17:52.554 15:18:51 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:52.554 15:18:51 -- target/tls.sh@28 -- # bdevperf_pid=2784726 00:17:52.554 15:18:51 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:52.554 15:18:51 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:52.554 15:18:51 -- target/tls.sh@31 -- # waitforlisten 2784726 /var/tmp/bdevperf.sock 00:17:52.554 15:18:51 -- common/autotest_common.sh@829 -- # '[' -z 2784726 ']' 00:17:52.554 15:18:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:52.554 15:18:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.554 15:18:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:52.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:52.554 15:18:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.554 15:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:52.812 [2024-11-19 15:18:51.128980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.812 [2024-11-19 15:18:51.129094] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2784726 ] 00:17:52.812 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.812 [2024-11-19 15:18:51.193311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.812 [2024-11-19 15:18:51.302574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.745 15:18:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.745 15:18:52 -- common/autotest_common.sh@862 -- # return 0 00:17:53.745 15:18:52 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:54.003 [2024-11-19 15:18:52.423732] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:54.003 [2024-11-19 15:18:52.425602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f7050 (9): Bad file descriptor 00:17:54.003 [2024-11-19 15:18:52.426598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:54.003 [2024-11-19 15:18:52.426618] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:54.003 [2024-11-19 15:18:52.426631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:54.003 request: 00:17:54.003 { 00:17:54.003 "name": "TLSTEST", 00:17:54.003 "trtype": "tcp", 00:17:54.003 "traddr": "10.0.0.2", 00:17:54.003 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:54.003 "adrfam": "ipv4", 00:17:54.003 "trsvcid": "4420", 00:17:54.003 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:54.003 "method": "bdev_nvme_attach_controller", 00:17:54.003 "req_id": 1 00:17:54.003 } 00:17:54.003 Got JSON-RPC error response 00:17:54.003 response: 00:17:54.003 { 00:17:54.003 "code": -32602, 00:17:54.003 "message": "Invalid parameters" 00:17:54.003 } 00:17:54.003 15:18:52 -- target/tls.sh@36 -- # killprocess 2784726 00:17:54.003 15:18:52 -- common/autotest_common.sh@936 -- # '[' -z 2784726 ']' 00:17:54.003 15:18:52 -- common/autotest_common.sh@940 -- # kill -0 2784726 00:17:54.003 15:18:52 -- common/autotest_common.sh@941 -- # uname 00:17:54.003 15:18:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.003 15:18:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2784726 00:17:54.003 15:18:52 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.003 15:18:52 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.003 15:18:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2784726' 00:17:54.003 killing process with pid 2784726 00:17:54.003 15:18:52 -- common/autotest_common.sh@955 -- # kill 2784726 00:17:54.004 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.004 00:17:54.004 Latency(us) 00:17:54.004 [2024-11-19T14:18:52.567Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.004 [2024-11-19T14:18:52.567Z] =================================================================================================================== 00:17:54.004 [2024-11-19T14:18:52.567Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:54.004 15:18:52 -- common/autotest_common.sh@960 -- # wait 2784726 00:17:54.262 15:18:52 -- target/tls.sh@37 -- # return 1 00:17:54.262 15:18:52 -- common/autotest_common.sh@653 -- # es=1 00:17:54.262 15:18:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:54.262 15:18:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:54.262 15:18:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:54.262 15:18:52 -- target/tls.sh@167 -- # killprocess 2780809 00:17:54.262 15:18:52 -- common/autotest_common.sh@936 -- # '[' -z 2780809 ']' 00:17:54.262 15:18:52 -- common/autotest_common.sh@940 -- # kill -0 2780809 00:17:54.262 15:18:52 -- common/autotest_common.sh@941 -- # uname 00:17:54.262 15:18:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.262 15:18:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2780809 00:17:54.262 15:18:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:54.262 15:18:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:54.262 15:18:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2780809' 00:17:54.262 killing process with pid 2780809 00:17:54.262 15:18:52 -- common/autotest_common.sh@955 -- # kill 2780809 00:17:54.262 15:18:52 -- common/autotest_common.sh@960 -- # wait 2780809 00:17:54.520 15:18:53 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:54.520 15:18:53 -- target/tls.sh@49 -- # local key hash crc 00:17:54.520 15:18:53 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:54.520 15:18:53 -- target/tls.sh@51 -- # hash=02 00:17:54.520 15:18:53 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:54.520 15:18:53 -- target/tls.sh@52 -- # gzip -1 -c 00:17:54.520 15:18:53 -- target/tls.sh@52 -- # tail -c8 00:17:54.520 15:18:53 -- target/tls.sh@52 -- # head -c 4 00:17:54.520 15:18:53 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:54.520 15:18:53 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:54.520 15:18:53 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:54.520 15:18:53 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:54.520 15:18:53 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:54.520 15:18:53 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.520 15:18:53 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:54.520 15:18:53 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.520 15:18:53 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:54.520 15:18:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:54.520 15:18:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:54.520 15:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:54.520 15:18:53 -- nvmf/common.sh@469 -- # nvmfpid=2785019 00:17:54.520 15:18:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:54.520 15:18:53 -- nvmf/common.sh@470 -- # waitforlisten 2785019 00:17:54.520 15:18:53 -- common/autotest_common.sh@829 -- # '[' -z 2785019 ']' 00:17:54.520 15:18:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:54.520 15:18:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.520 15:18:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:54.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:54.520 15:18:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.521 15:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:54.779 [2024-11-19 15:18:53.114757] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:54.779 [2024-11-19 15:18:53.114834] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:54.779 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.779 [2024-11-19 15:18:53.176328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:54.779 [2024-11-19 15:18:53.283171] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:54.779 [2024-11-19 15:18:53.283328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:54.779 [2024-11-19 15:18:53.283346] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:54.779 [2024-11-19 15:18:53.283358] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:54.779 [2024-11-19 15:18:53.283389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:55.714 15:18:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:55.714 15:18:54 -- common/autotest_common.sh@862 -- # return 0 00:17:55.714 15:18:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:55.714 15:18:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:55.714 15:18:54 -- common/autotest_common.sh@10 -- # set +x 00:17:55.714 15:18:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:55.714 15:18:54 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.714 15:18:54 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.714 15:18:54 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:55.972 [2024-11-19 15:18:54.385523] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:55.972 15:18:54 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:56.231 15:18:54 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:56.489 [2024-11-19 15:18:54.971130] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:56.489 [2024-11-19 15:18:54.971382] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:56.489 15:18:54 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:56.747 malloc0 00:17:56.747 15:18:55 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:57.313 15:18:55 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.313 15:18:55 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.313 15:18:55 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:57.313 15:18:55 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:57.313 15:18:55 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:57.313 15:18:55 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:57.313 15:18:55 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:57.313 15:18:55 -- target/tls.sh@28 -- # bdevperf_pid=2785448 00:17:57.313 15:18:55 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:57.313 15:18:55 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:57.313 15:18:55 -- target/tls.sh@31 -- # waitforlisten 2785448 /var/tmp/bdevperf.sock 00:17:57.313 15:18:55 -- common/autotest_common.sh@829 -- # '[' -z 2785448 ']' 00:17:57.313 15:18:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:57.313 15:18:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:57.313 15:18:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:57.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:57.313 15:18:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:57.313 15:18:55 -- common/autotest_common.sh@10 -- # set +x 00:17:57.572 [2024-11-19 15:18:55.891895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.572 [2024-11-19 15:18:55.891979] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2785448 ] 00:17:57.572 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.572 [2024-11-19 15:18:55.949149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.572 [2024-11-19 15:18:56.054916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:58.506 15:18:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:58.506 15:18:56 -- common/autotest_common.sh@862 -- # return 0 00:17:58.506 15:18:56 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.764 [2024-11-19 15:18:57.134094] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:58.764 TLSTESTn1 00:17:58.764 15:18:57 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:59.022 Running I/O for 10 seconds... 00:18:08.992 00:18:08.992 Latency(us) 00:18:08.992 [2024-11-19T14:19:07.555Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.992 [2024-11-19T14:19:07.555Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:08.992 Verification LBA range: start 0x0 length 0x2000 00:18:08.992 TLSTESTn1 : 10.03 4567.99 17.84 0.00 0.00 27967.19 7864.32 45244.11 00:18:08.992 [2024-11-19T14:19:07.555Z] =================================================================================================================== 00:18:08.992 [2024-11-19T14:19:07.555Z] Total : 4567.99 17.84 0.00 0.00 27967.19 7864.32 45244.11 00:18:08.992 0 00:18:08.992 15:19:07 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:08.992 15:19:07 -- target/tls.sh@45 -- # killprocess 2785448 00:18:08.992 15:19:07 -- common/autotest_common.sh@936 -- # '[' -z 2785448 ']' 00:18:08.992 15:19:07 -- common/autotest_common.sh@940 -- # kill -0 2785448 00:18:08.992 15:19:07 -- common/autotest_common.sh@941 -- # uname 00:18:08.992 15:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.992 15:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2785448 00:18:08.992 15:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:08.992 15:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:08.992 15:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2785448' 00:18:08.992 killing process with pid 2785448 00:18:08.992 15:19:07 -- common/autotest_common.sh@955 -- # kill 2785448 00:18:08.992 Received shutdown signal, test time was about 10.000000 seconds 00:18:08.992 00:18:08.992 Latency(us) 00:18:08.992 [2024-11-19T14:19:07.555Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.992 [2024-11-19T14:19:07.555Z] =================================================================================================================== 00:18:08.992 [2024-11-19T14:19:07.555Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:08.992 15:19:07 -- common/autotest_common.sh@960 -- # wait 2785448 00:18:09.250 15:19:07 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.250 15:19:07 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.250 15:19:07 -- common/autotest_common.sh@650 -- # local es=0 00:18:09.250 15:19:07 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.250 15:19:07 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:09.250 15:19:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.250 15:19:07 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:09.250 15:19:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.250 15:19:07 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.250 15:19:07 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:09.250 15:19:07 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:09.250 15:19:07 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:09.250 15:19:07 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:09.250 15:19:07 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:09.250 15:19:07 -- target/tls.sh@28 -- # bdevperf_pid=2786825 00:18:09.250 15:19:07 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:09.250 15:19:07 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:09.250 15:19:07 -- target/tls.sh@31 -- # waitforlisten 2786825 /var/tmp/bdevperf.sock 00:18:09.250 15:19:07 -- common/autotest_common.sh@829 -- # '[' -z 2786825 ']' 00:18:09.250 15:19:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.250 15:19:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.250 15:19:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.250 15:19:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.250 15:19:07 -- common/autotest_common.sh@10 -- # set +x 00:18:09.250 [2024-11-19 15:19:07.751708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.250 [2024-11-19 15:19:07.751801] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2786825 ] 00:18:09.250 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.250 [2024-11-19 15:19:07.810243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.509 [2024-11-19 15:19:07.911656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:10.444 15:19:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.444 15:19:08 -- common/autotest_common.sh@862 -- # return 0 00:18:10.444 15:19:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.703 [2024-11-19 15:19:09.028246] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:10.703 [2024-11-19 15:19:09.028307] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:10.703 request: 00:18:10.703 { 00:18:10.703 "name": "TLSTEST", 00:18:10.703 "trtype": "tcp", 00:18:10.703 "traddr": "10.0.0.2", 00:18:10.703 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:10.703 "adrfam": "ipv4", 00:18:10.703 "trsvcid": "4420", 00:18:10.703 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.703 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:10.703 "method": "bdev_nvme_attach_controller", 00:18:10.703 "req_id": 1 00:18:10.703 } 00:18:10.703 Got JSON-RPC error response 00:18:10.703 response: 00:18:10.703 { 00:18:10.703 "code": -22, 00:18:10.703 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:10.703 } 00:18:10.703 15:19:09 -- target/tls.sh@36 -- # killprocess 2786825 00:18:10.703 15:19:09 -- common/autotest_common.sh@936 -- # '[' -z 2786825 ']' 00:18:10.703 15:19:09 -- common/autotest_common.sh@940 -- # kill -0 2786825 00:18:10.703 15:19:09 -- common/autotest_common.sh@941 -- # uname 00:18:10.703 15:19:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.703 15:19:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2786825 00:18:10.703 15:19:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:10.703 15:19:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:10.703 15:19:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2786825' 00:18:10.703 killing process with pid 2786825 00:18:10.703 15:19:09 -- common/autotest_common.sh@955 -- # kill 2786825 00:18:10.703 Received shutdown signal, test time was about 10.000000 seconds 00:18:10.703 00:18:10.703 Latency(us) 00:18:10.703 [2024-11-19T14:19:09.266Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.703 [2024-11-19T14:19:09.266Z] =================================================================================================================== 00:18:10.703 [2024-11-19T14:19:09.266Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:10.703 15:19:09 -- common/autotest_common.sh@960 -- # wait 2786825 00:18:10.961 15:19:09 -- target/tls.sh@37 -- # return 1 00:18:10.961 15:19:09 -- common/autotest_common.sh@653 -- # es=1 00:18:10.961 15:19:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:10.961 15:19:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:10.961 15:19:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:10.961 15:19:09 -- target/tls.sh@183 -- # killprocess 2785019 00:18:10.961 15:19:09 -- common/autotest_common.sh@936 -- # '[' -z 2785019 ']' 00:18:10.961 15:19:09 -- common/autotest_common.sh@940 -- # kill -0 2785019 00:18:10.961 15:19:09 -- common/autotest_common.sh@941 -- # uname 00:18:10.961 15:19:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.961 15:19:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2785019 00:18:10.961 15:19:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:10.961 15:19:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:10.961 15:19:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2785019' 00:18:10.961 killing process with pid 2785019 00:18:10.961 15:19:09 -- common/autotest_common.sh@955 -- # kill 2785019 00:18:10.961 15:19:09 -- common/autotest_common.sh@960 -- # wait 2785019 00:18:11.220 15:19:09 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:11.220 15:19:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:11.220 15:19:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:11.220 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:11.220 15:19:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:11.220 15:19:09 -- nvmf/common.sh@469 -- # nvmfpid=2787108 00:18:11.220 15:19:09 -- nvmf/common.sh@470 -- # waitforlisten 2787108 00:18:11.220 15:19:09 -- common/autotest_common.sh@829 -- # '[' -z 2787108 ']' 00:18:11.220 15:19:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:11.220 15:19:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.220 15:19:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:11.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:11.220 15:19:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.220 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:11.220 [2024-11-19 15:19:09.728240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.220 [2024-11-19 15:19:09.728339] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:11.220 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.479 [2024-11-19 15:19:09.796531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.479 [2024-11-19 15:19:09.909027] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:11.479 [2024-11-19 15:19:09.909181] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:11.479 [2024-11-19 15:19:09.909199] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:11.479 [2024-11-19 15:19:09.909212] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:11.479 [2024-11-19 15:19:09.909251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:12.413 15:19:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.413 15:19:10 -- common/autotest_common.sh@862 -- # return 0 00:18:12.413 15:19:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:12.413 15:19:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:12.413 15:19:10 -- common/autotest_common.sh@10 -- # set +x 00:18:12.413 15:19:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:12.413 15:19:10 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.413 15:19:10 -- common/autotest_common.sh@650 -- # local es=0 00:18:12.413 15:19:10 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.413 15:19:10 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:12.413 15:19:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:12.413 15:19:10 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:12.413 15:19:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:12.413 15:19:10 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.413 15:19:10 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.413 15:19:10 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:12.671 [2024-11-19 15:19:10.992373] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:12.671 15:19:11 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:12.932 15:19:11 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:13.192 [2024-11-19 15:19:11.561929] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:13.192 [2024-11-19 15:19:11.562183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:13.192 15:19:11 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:13.451 malloc0 00:18:13.451 15:19:11 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:13.709 15:19:12 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.967 [2024-11-19 15:19:12.319832] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:13.967 [2024-11-19 15:19:12.319883] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:13.967 [2024-11-19 15:19:12.319908] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:13.967 request: 00:18:13.967 { 00:18:13.967 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.967 "host": "nqn.2016-06.io.spdk:host1", 00:18:13.967 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:13.967 "method": "nvmf_subsystem_add_host", 00:18:13.967 "req_id": 1 00:18:13.967 } 00:18:13.967 Got JSON-RPC error response 00:18:13.967 response: 00:18:13.967 { 00:18:13.967 "code": -32603, 00:18:13.967 "message": "Internal error" 00:18:13.967 } 00:18:13.967 15:19:12 -- common/autotest_common.sh@653 -- # es=1 00:18:13.967 15:19:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:13.967 15:19:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:13.967 15:19:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:13.967 15:19:12 -- target/tls.sh@189 -- # killprocess 2787108 00:18:13.967 15:19:12 -- common/autotest_common.sh@936 -- # '[' -z 2787108 ']' 00:18:13.967 15:19:12 -- common/autotest_common.sh@940 -- # kill -0 2787108 00:18:13.967 15:19:12 -- common/autotest_common.sh@941 -- # uname 00:18:13.967 15:19:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.967 15:19:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2787108 00:18:13.967 15:19:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:13.967 15:19:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:13.967 15:19:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2787108' 00:18:13.967 killing process with pid 2787108 00:18:13.967 15:19:12 -- common/autotest_common.sh@955 -- # kill 2787108 00:18:13.968 15:19:12 -- common/autotest_common.sh@960 -- # wait 2787108 00:18:14.226 15:19:12 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.226 15:19:12 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:14.226 15:19:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:14.226 15:19:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:14.226 15:19:12 -- common/autotest_common.sh@10 -- # set +x 00:18:14.226 15:19:12 -- nvmf/common.sh@469 -- # nvmfpid=2787478 00:18:14.226 15:19:12 -- nvmf/common.sh@470 -- # waitforlisten 2787478 00:18:14.226 15:19:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:14.226 15:19:12 -- common/autotest_common.sh@829 -- # '[' -z 2787478 ']' 00:18:14.226 15:19:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:14.226 15:19:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.226 15:19:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:14.226 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:14.226 15:19:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.226 15:19:12 -- common/autotest_common.sh@10 -- # set +x 00:18:14.226 [2024-11-19 15:19:12.726713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:14.226 [2024-11-19 15:19:12.726808] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:14.226 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.485 [2024-11-19 15:19:12.791274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.485 [2024-11-19 15:19:12.899455] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:14.485 [2024-11-19 15:19:12.899604] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:14.485 [2024-11-19 15:19:12.899621] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:14.485 [2024-11-19 15:19:12.899632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:14.485 [2024-11-19 15:19:12.899660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.420 15:19:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:15.420 15:19:13 -- common/autotest_common.sh@862 -- # return 0 00:18:15.420 15:19:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:15.420 15:19:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:15.420 15:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:15.420 15:19:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:15.420 15:19:13 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.420 15:19:13 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.420 15:19:13 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:15.678 [2024-11-19 15:19:14.010656] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:15.678 15:19:14 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:15.936 15:19:14 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:16.194 [2024-11-19 15:19:14.608280] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:16.194 [2024-11-19 15:19:14.608530] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:16.194 15:19:14 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:16.452 malloc0 00:18:16.452 15:19:14 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:16.709 15:19:15 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.973 15:19:15 -- target/tls.sh@197 -- # bdevperf_pid=2787852 00:18:16.973 15:19:15 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:16.973 15:19:15 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:16.973 15:19:15 -- target/tls.sh@200 -- # waitforlisten 2787852 /var/tmp/bdevperf.sock 00:18:16.973 15:19:15 -- common/autotest_common.sh@829 -- # '[' -z 2787852 ']' 00:18:16.973 15:19:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:16.973 15:19:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:16.973 15:19:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:16.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:16.973 15:19:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:16.973 15:19:15 -- common/autotest_common.sh@10 -- # set +x 00:18:16.973 [2024-11-19 15:19:15.414315] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:16.973 [2024-11-19 15:19:15.414400] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2787852 ] 00:18:16.973 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.973 [2024-11-19 15:19:15.473380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.286 [2024-11-19 15:19:15.577280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:17.875 15:19:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.875 15:19:16 -- common/autotest_common.sh@862 -- # return 0 00:18:17.875 15:19:16 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.133 [2024-11-19 15:19:16.617881] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:18.133 TLSTESTn1 00:18:18.390 15:19:16 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:18.649 15:19:17 -- target/tls.sh@205 -- # tgtconf='{ 00:18:18.649 "subsystems": [ 00:18:18.649 { 00:18:18.649 "subsystem": "iobuf", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "iobuf_set_options", 00:18:18.649 "params": { 00:18:18.649 "small_pool_count": 8192, 00:18:18.649 "large_pool_count": 1024, 00:18:18.649 "small_bufsize": 8192, 00:18:18.649 "large_bufsize": 135168 00:18:18.649 } 00:18:18.649 } 00:18:18.649 ] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "sock", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "sock_impl_set_options", 00:18:18.649 "params": { 00:18:18.649 "impl_name": "posix", 00:18:18.649 "recv_buf_size": 2097152, 00:18:18.649 "send_buf_size": 2097152, 00:18:18.649 "enable_recv_pipe": true, 00:18:18.649 "enable_quickack": false, 00:18:18.649 "enable_placement_id": 0, 00:18:18.649 "enable_zerocopy_send_server": true, 00:18:18.649 "enable_zerocopy_send_client": false, 00:18:18.649 "zerocopy_threshold": 0, 00:18:18.649 "tls_version": 0, 00:18:18.649 "enable_ktls": false 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "sock_impl_set_options", 00:18:18.649 "params": { 00:18:18.649 "impl_name": "ssl", 00:18:18.649 "recv_buf_size": 4096, 00:18:18.649 "send_buf_size": 4096, 00:18:18.649 "enable_recv_pipe": true, 00:18:18.649 "enable_quickack": false, 00:18:18.649 "enable_placement_id": 0, 00:18:18.649 "enable_zerocopy_send_server": true, 00:18:18.649 "enable_zerocopy_send_client": false, 00:18:18.649 "zerocopy_threshold": 0, 00:18:18.649 "tls_version": 0, 00:18:18.649 "enable_ktls": false 00:18:18.649 } 00:18:18.649 } 00:18:18.649 ] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "vmd", 00:18:18.649 "config": [] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "accel", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "accel_set_options", 00:18:18.649 "params": { 00:18:18.649 "small_cache_size": 128, 00:18:18.649 "large_cache_size": 16, 00:18:18.649 "task_count": 2048, 00:18:18.649 "sequence_count": 2048, 00:18:18.649 "buf_count": 2048 00:18:18.649 } 00:18:18.649 } 00:18:18.649 ] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "bdev", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "bdev_set_options", 00:18:18.649 "params": { 00:18:18.649 "bdev_io_pool_size": 65535, 00:18:18.649 "bdev_io_cache_size": 256, 00:18:18.649 "bdev_auto_examine": true, 00:18:18.649 "iobuf_small_cache_size": 128, 00:18:18.649 "iobuf_large_cache_size": 16 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_raid_set_options", 00:18:18.649 "params": { 00:18:18.649 "process_window_size_kb": 1024 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_iscsi_set_options", 00:18:18.649 "params": { 00:18:18.649 "timeout_sec": 30 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_nvme_set_options", 00:18:18.649 "params": { 00:18:18.649 "action_on_timeout": "none", 00:18:18.649 "timeout_us": 0, 00:18:18.649 "timeout_admin_us": 0, 00:18:18.649 "keep_alive_timeout_ms": 10000, 00:18:18.649 "transport_retry_count": 4, 00:18:18.649 "arbitration_burst": 0, 00:18:18.649 "low_priority_weight": 0, 00:18:18.649 "medium_priority_weight": 0, 00:18:18.649 "high_priority_weight": 0, 00:18:18.649 "nvme_adminq_poll_period_us": 10000, 00:18:18.649 "nvme_ioq_poll_period_us": 0, 00:18:18.649 "io_queue_requests": 0, 00:18:18.649 "delay_cmd_submit": true, 00:18:18.649 "bdev_retry_count": 3, 00:18:18.649 "transport_ack_timeout": 0, 00:18:18.649 "ctrlr_loss_timeout_sec": 0, 00:18:18.649 "reconnect_delay_sec": 0, 00:18:18.649 "fast_io_fail_timeout_sec": 0, 00:18:18.649 "generate_uuids": false, 00:18:18.649 "transport_tos": 0, 00:18:18.649 "io_path_stat": false, 00:18:18.649 "allow_accel_sequence": false 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_nvme_set_hotplug", 00:18:18.649 "params": { 00:18:18.649 "period_us": 100000, 00:18:18.649 "enable": false 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_malloc_create", 00:18:18.649 "params": { 00:18:18.649 "name": "malloc0", 00:18:18.649 "num_blocks": 8192, 00:18:18.649 "block_size": 4096, 00:18:18.649 "physical_block_size": 4096, 00:18:18.649 "uuid": "42a21bba-9a6b-47f6-97f2-7d7fc5b5b11e", 00:18:18.649 "optimal_io_boundary": 0 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "bdev_wait_for_examine" 00:18:18.649 } 00:18:18.649 ] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "nbd", 00:18:18.649 "config": [] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "scheduler", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "framework_set_scheduler", 00:18:18.649 "params": { 00:18:18.649 "name": "static" 00:18:18.649 } 00:18:18.649 } 00:18:18.649 ] 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "subsystem": "nvmf", 00:18:18.649 "config": [ 00:18:18.649 { 00:18:18.649 "method": "nvmf_set_config", 00:18:18.649 "params": { 00:18:18.649 "discovery_filter": "match_any", 00:18:18.649 "admin_cmd_passthru": { 00:18:18.649 "identify_ctrlr": false 00:18:18.649 } 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "nvmf_set_max_subsystems", 00:18:18.649 "params": { 00:18:18.649 "max_subsystems": 1024 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "nvmf_set_crdt", 00:18:18.649 "params": { 00:18:18.649 "crdt1": 0, 00:18:18.649 "crdt2": 0, 00:18:18.649 "crdt3": 0 00:18:18.649 } 00:18:18.649 }, 00:18:18.649 { 00:18:18.649 "method": "nvmf_create_transport", 00:18:18.649 "params": { 00:18:18.649 "trtype": "TCP", 00:18:18.649 "max_queue_depth": 128, 00:18:18.649 "max_io_qpairs_per_ctrlr": 127, 00:18:18.649 "in_capsule_data_size": 4096, 00:18:18.649 "max_io_size": 131072, 00:18:18.650 "io_unit_size": 131072, 00:18:18.650 "max_aq_depth": 128, 00:18:18.650 "num_shared_buffers": 511, 00:18:18.650 "buf_cache_size": 4294967295, 00:18:18.650 "dif_insert_or_strip": false, 00:18:18.650 "zcopy": false, 00:18:18.650 "c2h_success": false, 00:18:18.650 "sock_priority": 0, 00:18:18.650 "abort_timeout_sec": 1 00:18:18.650 } 00:18:18.650 }, 00:18:18.650 { 00:18:18.650 "method": "nvmf_create_subsystem", 00:18:18.650 "params": { 00:18:18.650 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.650 "allow_any_host": false, 00:18:18.650 "serial_number": "SPDK00000000000001", 00:18:18.650 "model_number": "SPDK bdev Controller", 00:18:18.650 "max_namespaces": 10, 00:18:18.650 "min_cntlid": 1, 00:18:18.650 "max_cntlid": 65519, 00:18:18.650 "ana_reporting": false 00:18:18.650 } 00:18:18.650 }, 00:18:18.650 { 00:18:18.650 "method": "nvmf_subsystem_add_host", 00:18:18.650 "params": { 00:18:18.650 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.650 "host": "nqn.2016-06.io.spdk:host1", 00:18:18.650 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:18.650 } 00:18:18.650 }, 00:18:18.650 { 00:18:18.650 "method": "nvmf_subsystem_add_ns", 00:18:18.650 "params": { 00:18:18.650 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.650 "namespace": { 00:18:18.650 "nsid": 1, 00:18:18.650 "bdev_name": "malloc0", 00:18:18.650 "nguid": "42A21BBA9A6B47F697F27D7FC5B5B11E", 00:18:18.650 "uuid": "42a21bba-9a6b-47f6-97f2-7d7fc5b5b11e" 00:18:18.650 } 00:18:18.650 } 00:18:18.650 }, 00:18:18.650 { 00:18:18.650 "method": "nvmf_subsystem_add_listener", 00:18:18.650 "params": { 00:18:18.650 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.650 "listen_address": { 00:18:18.650 "trtype": "TCP", 00:18:18.650 "adrfam": "IPv4", 00:18:18.650 "traddr": "10.0.0.2", 00:18:18.650 "trsvcid": "4420" 00:18:18.650 }, 00:18:18.650 "secure_channel": true 00:18:18.650 } 00:18:18.650 } 00:18:18.650 ] 00:18:18.650 } 00:18:18.650 ] 00:18:18.650 }' 00:18:18.650 15:19:17 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:18.908 15:19:17 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:18.908 "subsystems": [ 00:18:18.908 { 00:18:18.908 "subsystem": "iobuf", 00:18:18.908 "config": [ 00:18:18.908 { 00:18:18.908 "method": "iobuf_set_options", 00:18:18.908 "params": { 00:18:18.908 "small_pool_count": 8192, 00:18:18.908 "large_pool_count": 1024, 00:18:18.908 "small_bufsize": 8192, 00:18:18.908 "large_bufsize": 135168 00:18:18.908 } 00:18:18.908 } 00:18:18.908 ] 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "subsystem": "sock", 00:18:18.908 "config": [ 00:18:18.908 { 00:18:18.908 "method": "sock_impl_set_options", 00:18:18.908 "params": { 00:18:18.908 "impl_name": "posix", 00:18:18.908 "recv_buf_size": 2097152, 00:18:18.908 "send_buf_size": 2097152, 00:18:18.908 "enable_recv_pipe": true, 00:18:18.908 "enable_quickack": false, 00:18:18.908 "enable_placement_id": 0, 00:18:18.908 "enable_zerocopy_send_server": true, 00:18:18.908 "enable_zerocopy_send_client": false, 00:18:18.908 "zerocopy_threshold": 0, 00:18:18.908 "tls_version": 0, 00:18:18.908 "enable_ktls": false 00:18:18.908 } 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "method": "sock_impl_set_options", 00:18:18.908 "params": { 00:18:18.908 "impl_name": "ssl", 00:18:18.908 "recv_buf_size": 4096, 00:18:18.908 "send_buf_size": 4096, 00:18:18.908 "enable_recv_pipe": true, 00:18:18.908 "enable_quickack": false, 00:18:18.908 "enable_placement_id": 0, 00:18:18.908 "enable_zerocopy_send_server": true, 00:18:18.908 "enable_zerocopy_send_client": false, 00:18:18.908 "zerocopy_threshold": 0, 00:18:18.908 "tls_version": 0, 00:18:18.908 "enable_ktls": false 00:18:18.908 } 00:18:18.908 } 00:18:18.908 ] 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "subsystem": "vmd", 00:18:18.908 "config": [] 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "subsystem": "accel", 00:18:18.908 "config": [ 00:18:18.908 { 00:18:18.908 "method": "accel_set_options", 00:18:18.908 "params": { 00:18:18.908 "small_cache_size": 128, 00:18:18.908 "large_cache_size": 16, 00:18:18.908 "task_count": 2048, 00:18:18.908 "sequence_count": 2048, 00:18:18.908 "buf_count": 2048 00:18:18.908 } 00:18:18.908 } 00:18:18.908 ] 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "subsystem": "bdev", 00:18:18.908 "config": [ 00:18:18.908 { 00:18:18.908 "method": "bdev_set_options", 00:18:18.908 "params": { 00:18:18.908 "bdev_io_pool_size": 65535, 00:18:18.908 "bdev_io_cache_size": 256, 00:18:18.908 "bdev_auto_examine": true, 00:18:18.908 "iobuf_small_cache_size": 128, 00:18:18.908 "iobuf_large_cache_size": 16 00:18:18.908 } 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "method": "bdev_raid_set_options", 00:18:18.908 "params": { 00:18:18.908 "process_window_size_kb": 1024 00:18:18.908 } 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "method": "bdev_iscsi_set_options", 00:18:18.908 "params": { 00:18:18.908 "timeout_sec": 30 00:18:18.908 } 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "method": "bdev_nvme_set_options", 00:18:18.908 "params": { 00:18:18.908 "action_on_timeout": "none", 00:18:18.908 "timeout_us": 0, 00:18:18.908 "timeout_admin_us": 0, 00:18:18.908 "keep_alive_timeout_ms": 10000, 00:18:18.908 "transport_retry_count": 4, 00:18:18.908 "arbitration_burst": 0, 00:18:18.908 "low_priority_weight": 0, 00:18:18.908 "medium_priority_weight": 0, 00:18:18.908 "high_priority_weight": 0, 00:18:18.908 "nvme_adminq_poll_period_us": 10000, 00:18:18.908 "nvme_ioq_poll_period_us": 0, 00:18:18.908 "io_queue_requests": 512, 00:18:18.908 "delay_cmd_submit": true, 00:18:18.908 "bdev_retry_count": 3, 00:18:18.908 "transport_ack_timeout": 0, 00:18:18.908 "ctrlr_loss_timeout_sec": 0, 00:18:18.908 "reconnect_delay_sec": 0, 00:18:18.908 "fast_io_fail_timeout_sec": 0, 00:18:18.908 "generate_uuids": false, 00:18:18.908 "transport_tos": 0, 00:18:18.908 "io_path_stat": false, 00:18:18.908 "allow_accel_sequence": false 00:18:18.908 } 00:18:18.908 }, 00:18:18.908 { 00:18:18.908 "method": "bdev_nvme_attach_controller", 00:18:18.908 "params": { 00:18:18.908 "name": "TLSTEST", 00:18:18.908 "trtype": "TCP", 00:18:18.908 "adrfam": "IPv4", 00:18:18.908 "traddr": "10.0.0.2", 00:18:18.908 "trsvcid": "4420", 00:18:18.908 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.908 "prchk_reftag": false, 00:18:18.908 "prchk_guard": false, 00:18:18.908 "ctrlr_loss_timeout_sec": 0, 00:18:18.909 "reconnect_delay_sec": 0, 00:18:18.909 "fast_io_fail_timeout_sec": 0, 00:18:18.909 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:18.909 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.909 "hdgst": false, 00:18:18.909 "ddgst": false 00:18:18.909 } 00:18:18.909 }, 00:18:18.909 { 00:18:18.909 "method": "bdev_nvme_set_hotplug", 00:18:18.909 "params": { 00:18:18.909 "period_us": 100000, 00:18:18.909 "enable": false 00:18:18.909 } 00:18:18.909 }, 00:18:18.909 { 00:18:18.909 "method": "bdev_wait_for_examine" 00:18:18.909 } 00:18:18.909 ] 00:18:18.909 }, 00:18:18.909 { 00:18:18.909 "subsystem": "nbd", 00:18:18.909 "config": [] 00:18:18.909 } 00:18:18.909 ] 00:18:18.909 }' 00:18:18.909 15:19:17 -- target/tls.sh@208 -- # killprocess 2787852 00:18:18.909 15:19:17 -- common/autotest_common.sh@936 -- # '[' -z 2787852 ']' 00:18:18.909 15:19:17 -- common/autotest_common.sh@940 -- # kill -0 2787852 00:18:18.909 15:19:17 -- common/autotest_common.sh@941 -- # uname 00:18:18.909 15:19:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.909 15:19:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2787852 00:18:18.909 15:19:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:18.909 15:19:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:18.909 15:19:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2787852' 00:18:18.909 killing process with pid 2787852 00:18:18.909 15:19:17 -- common/autotest_common.sh@955 -- # kill 2787852 00:18:18.909 Received shutdown signal, test time was about 10.000000 seconds 00:18:18.909 00:18:18.909 Latency(us) 00:18:18.909 [2024-11-19T14:19:17.472Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.909 [2024-11-19T14:19:17.472Z] =================================================================================================================== 00:18:18.909 [2024-11-19T14:19:17.472Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:18.909 15:19:17 -- common/autotest_common.sh@960 -- # wait 2787852 00:18:19.167 15:19:17 -- target/tls.sh@209 -- # killprocess 2787478 00:18:19.167 15:19:17 -- common/autotest_common.sh@936 -- # '[' -z 2787478 ']' 00:18:19.167 15:19:17 -- common/autotest_common.sh@940 -- # kill -0 2787478 00:18:19.167 15:19:17 -- common/autotest_common.sh@941 -- # uname 00:18:19.167 15:19:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.426 15:19:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2787478 00:18:19.426 15:19:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:19.426 15:19:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:19.426 15:19:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2787478' 00:18:19.426 killing process with pid 2787478 00:18:19.426 15:19:17 -- common/autotest_common.sh@955 -- # kill 2787478 00:18:19.426 15:19:17 -- common/autotest_common.sh@960 -- # wait 2787478 00:18:19.685 15:19:18 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:19.685 15:19:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:19.685 15:19:18 -- target/tls.sh@212 -- # echo '{ 00:18:19.685 "subsystems": [ 00:18:19.685 { 00:18:19.685 "subsystem": "iobuf", 00:18:19.685 "config": [ 00:18:19.685 { 00:18:19.685 "method": "iobuf_set_options", 00:18:19.685 "params": { 00:18:19.685 "small_pool_count": 8192, 00:18:19.685 "large_pool_count": 1024, 00:18:19.685 "small_bufsize": 8192, 00:18:19.685 "large_bufsize": 135168 00:18:19.685 } 00:18:19.685 } 00:18:19.685 ] 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "subsystem": "sock", 00:18:19.685 "config": [ 00:18:19.685 { 00:18:19.685 "method": "sock_impl_set_options", 00:18:19.685 "params": { 00:18:19.685 "impl_name": "posix", 00:18:19.685 "recv_buf_size": 2097152, 00:18:19.685 "send_buf_size": 2097152, 00:18:19.685 "enable_recv_pipe": true, 00:18:19.685 "enable_quickack": false, 00:18:19.685 "enable_placement_id": 0, 00:18:19.685 "enable_zerocopy_send_server": true, 00:18:19.685 "enable_zerocopy_send_client": false, 00:18:19.685 "zerocopy_threshold": 0, 00:18:19.685 "tls_version": 0, 00:18:19.685 "enable_ktls": false 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "sock_impl_set_options", 00:18:19.685 "params": { 00:18:19.685 "impl_name": "ssl", 00:18:19.685 "recv_buf_size": 4096, 00:18:19.685 "send_buf_size": 4096, 00:18:19.685 "enable_recv_pipe": true, 00:18:19.685 "enable_quickack": false, 00:18:19.685 "enable_placement_id": 0, 00:18:19.685 "enable_zerocopy_send_server": true, 00:18:19.685 "enable_zerocopy_send_client": false, 00:18:19.685 "zerocopy_threshold": 0, 00:18:19.685 "tls_version": 0, 00:18:19.685 "enable_ktls": false 00:18:19.685 } 00:18:19.685 } 00:18:19.685 ] 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "subsystem": "vmd", 00:18:19.685 "config": [] 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "subsystem": "accel", 00:18:19.685 "config": [ 00:18:19.685 { 00:18:19.685 "method": "accel_set_options", 00:18:19.685 "params": { 00:18:19.685 "small_cache_size": 128, 00:18:19.685 "large_cache_size": 16, 00:18:19.685 "task_count": 2048, 00:18:19.685 "sequence_count": 2048, 00:18:19.685 "buf_count": 2048 00:18:19.685 } 00:18:19.685 } 00:18:19.685 ] 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "subsystem": "bdev", 00:18:19.685 "config": [ 00:18:19.685 { 00:18:19.685 "method": "bdev_set_options", 00:18:19.685 "params": { 00:18:19.685 "bdev_io_pool_size": 65535, 00:18:19.685 "bdev_io_cache_size": 256, 00:18:19.685 "bdev_auto_examine": true, 00:18:19.685 "iobuf_small_cache_size": 128, 00:18:19.685 "iobuf_large_cache_size": 16 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "bdev_raid_set_options", 00:18:19.685 "params": { 00:18:19.685 "process_window_size_kb": 1024 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "bdev_iscsi_set_options", 00:18:19.685 "params": { 00:18:19.685 "timeout_sec": 30 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "bdev_nvme_set_options", 00:18:19.685 "params": { 00:18:19.685 "action_on_timeout": "none", 00:18:19.685 "timeout_us": 0, 00:18:19.685 "timeout_admin_us": 0, 00:18:19.685 "keep_alive_timeout_ms": 10000, 00:18:19.685 "transport_retry_count": 4, 00:18:19.685 "arbitration_burst": 0, 00:18:19.685 "low_priority_weight": 0, 00:18:19.685 "medium_priority_weight": 0, 00:18:19.685 "high_priority_weight": 0, 00:18:19.685 "nvme_adminq_poll_period_us": 10000, 00:18:19.685 "nvme_ioq_poll_period_us": 0, 00:18:19.685 "io_queue_requests": 0, 00:18:19.685 "delay_cmd_submit": true, 00:18:19.685 "bdev_retry_count": 3, 00:18:19.685 "transport_ack_timeout": 0, 00:18:19.685 "ctrlr_loss_timeout_sec": 0, 00:18:19.685 "reconnect_delay_sec": 0, 00:18:19.685 "fast_io_fail_timeout_sec": 0, 00:18:19.685 "generate_uuids": false, 00:18:19.685 "transport_tos": 0, 00:18:19.685 "io_path_stat": false, 00:18:19.685 "allow_accel_sequence": false 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "bdev_nvme_set_hotplug", 00:18:19.685 "params": { 00:18:19.685 "period_us": 100000, 00:18:19.685 "enable": false 00:18:19.685 } 00:18:19.685 }, 00:18:19.685 { 00:18:19.685 "method": "bdev_malloc_create", 00:18:19.685 "params": { 00:18:19.685 "name": "malloc0", 00:18:19.685 "num_blocks": 8192, 00:18:19.686 "block_size": 4096, 00:18:19.686 "physical_block_size": 4096, 00:18:19.686 "uuid": "42a21bba-9a6b-47f6-97f2-7d7fc5b5b11e", 00:18:19.686 "optimal_io_boundary": 0 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "bdev_wait_for_examine" 00:18:19.686 } 00:18:19.686 ] 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "subsystem": "nbd", 00:18:19.686 "config": [] 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "subsystem": "scheduler", 00:18:19.686 "config": [ 00:18:19.686 { 00:18:19.686 "method": "framework_set_scheduler", 00:18:19.686 "params": { 00:18:19.686 "name": "static" 00:18:19.686 } 00:18:19.686 } 00:18:19.686 ] 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "subsystem": "nvmf", 00:18:19.686 "config": [ 00:18:19.686 { 00:18:19.686 "method": "nvmf_set_config", 00:18:19.686 "params": { 00:18:19.686 "discovery_filter": "match_any", 00:18:19.686 "admin_cmd_passthru": { 00:18:19.686 "identify_ctrlr": false 00:18:19.686 } 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_set_max_subsystems", 00:18:19.686 "params": { 00:18:19.686 "max_subsystems": 1024 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_set_crdt", 00:18:19.686 "params": { 00:18:19.686 "crdt1": 0, 00:18:19.686 "crdt2": 0, 00:18:19.686 "crdt3": 0 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_create_transport", 00:18:19.686 "params": { 00:18:19.686 "trtype": "TCP", 00:18:19.686 "max_queue_depth": 128, 00:18:19.686 "max_io_qpairs_per_ctrlr": 127, 00:18:19.686 "in_capsule_data_size": 4096, 00:18:19.686 "max_io_size": 131072, 00:18:19.686 "io_unit_size": 131072, 00:18:19.686 "max_aq_depth": 128, 00:18:19.686 "num_shared_buffers": 511, 00:18:19.686 "buf_cache_size": 4294967295, 00:18:19.686 "dif_insert_or_strip": false, 00:18:19.686 "zcopy": false, 00:18:19.686 "c2h_success": false, 00:18:19.686 "sock_priority": 0, 00:18:19.686 "abort_timeout_sec": 1 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_create_subsystem", 00:18:19.686 "params": { 00:18:19.686 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.686 "allow_any_host": false, 00:18:19.686 "serial_number": "SPDK00000000000001", 00:18:19.686 "model_number": "SPDK bdev Controller", 00:18:19.686 "max_namespaces": 10, 00:18:19.686 "min_cntlid": 1, 00:18:19.686 "max_cntlid": 65519, 00:18:19.686 "ana_reporting": false 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_subsystem_add_host", 00:18:19.686 "params": { 00:18:19.686 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.686 "host": "nqn.2016-06.io.spdk:host1", 00:18:19.686 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_subsystem_add_ns", 00:18:19.686 "params": { 00:18:19.686 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.686 "namespace": { 00:18:19.686 "nsid": 1, 00:18:19.686 "bdev_name": "malloc0", 00:18:19.686 "nguid": "42A21BBA9A6B47F697F27D7FC5B5B11E", 00:18:19.686 "uuid": "42a21bba-9a6b-47f6-97f2-7d7fc5b5b11e" 00:18:19.686 } 00:18:19.686 } 00:18:19.686 }, 00:18:19.686 { 00:18:19.686 "method": "nvmf_subsystem_add_listener", 00:18:19.686 "params": { 00:18:19.686 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.686 "listen_address": { 00:18:19.686 "trtype": "TCP", 00:18:19.686 "adrfam": "IPv4", 00:18:19.686 "traddr": "10.0.0.2", 00:18:19.686 "trsvcid": "4420" 00:18:19.686 }, 00:18:19.686 "secure_channel": true 00:18:19.686 } 00:18:19.686 } 00:18:19.686 ] 00:18:19.686 } 00:18:19.686 ] 00:18:19.686 }' 00:18:19.686 15:19:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:19.686 15:19:18 -- common/autotest_common.sh@10 -- # set +x 00:18:19.686 15:19:18 -- nvmf/common.sh@469 -- # nvmfpid=2788153 00:18:19.686 15:19:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:19.686 15:19:18 -- nvmf/common.sh@470 -- # waitforlisten 2788153 00:18:19.686 15:19:18 -- common/autotest_common.sh@829 -- # '[' -z 2788153 ']' 00:18:19.686 15:19:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:19.686 15:19:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:19.686 15:19:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:19.686 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:19.686 15:19:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:19.686 15:19:18 -- common/autotest_common.sh@10 -- # set +x 00:18:19.686 [2024-11-19 15:19:18.077506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:19.686 [2024-11-19 15:19:18.077594] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:19.686 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.686 [2024-11-19 15:19:18.145703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.944 [2024-11-19 15:19:18.263532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:19.944 [2024-11-19 15:19:18.263716] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:19.944 [2024-11-19 15:19:18.263751] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:19.944 [2024-11-19 15:19:18.263763] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:19.944 [2024-11-19 15:19:18.263794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:19.944 [2024-11-19 15:19:18.493644] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:20.202 [2024-11-19 15:19:18.525657] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:20.202 [2024-11-19 15:19:18.525933] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:20.772 15:19:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.772 15:19:19 -- common/autotest_common.sh@862 -- # return 0 00:18:20.772 15:19:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:20.772 15:19:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:20.772 15:19:19 -- common/autotest_common.sh@10 -- # set +x 00:18:20.772 15:19:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:20.772 15:19:19 -- target/tls.sh@216 -- # bdevperf_pid=2788306 00:18:20.772 15:19:19 -- target/tls.sh@217 -- # waitforlisten 2788306 /var/tmp/bdevperf.sock 00:18:20.772 15:19:19 -- common/autotest_common.sh@829 -- # '[' -z 2788306 ']' 00:18:20.772 15:19:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:20.772 15:19:19 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:20.772 15:19:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:20.772 15:19:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:20.772 15:19:19 -- target/tls.sh@213 -- # echo '{ 00:18:20.772 "subsystems": [ 00:18:20.772 { 00:18:20.772 "subsystem": "iobuf", 00:18:20.772 "config": [ 00:18:20.772 { 00:18:20.772 "method": "iobuf_set_options", 00:18:20.772 "params": { 00:18:20.772 "small_pool_count": 8192, 00:18:20.772 "large_pool_count": 1024, 00:18:20.772 "small_bufsize": 8192, 00:18:20.772 "large_bufsize": 135168 00:18:20.772 } 00:18:20.772 } 00:18:20.772 ] 00:18:20.772 }, 00:18:20.772 { 00:18:20.772 "subsystem": "sock", 00:18:20.773 "config": [ 00:18:20.773 { 00:18:20.773 "method": "sock_impl_set_options", 00:18:20.773 "params": { 00:18:20.773 "impl_name": "posix", 00:18:20.773 "recv_buf_size": 2097152, 00:18:20.773 "send_buf_size": 2097152, 00:18:20.773 "enable_recv_pipe": true, 00:18:20.773 "enable_quickack": false, 00:18:20.773 "enable_placement_id": 0, 00:18:20.773 "enable_zerocopy_send_server": true, 00:18:20.773 "enable_zerocopy_send_client": false, 00:18:20.773 "zerocopy_threshold": 0, 00:18:20.773 "tls_version": 0, 00:18:20.773 "enable_ktls": false 00:18:20.773 } 00:18:20.773 }, 00:18:20.773 { 00:18:20.773 "method": "sock_impl_set_options", 00:18:20.773 "params": { 00:18:20.773 "impl_name": "ssl", 00:18:20.773 "recv_buf_size": 4096, 00:18:20.773 "send_buf_size": 4096, 00:18:20.773 "enable_recv_pipe": true, 00:18:20.773 "enable_quickack": false, 00:18:20.773 "enable_placement_id": 0, 00:18:20.773 "enable_zerocopy_send_server": true, 00:18:20.773 "enable_zerocopy_send_client": false, 00:18:20.773 "zerocopy_threshold": 0, 00:18:20.773 "tls_version": 0, 00:18:20.773 "enable_ktls": false 00:18:20.773 } 00:18:20.773 } 00:18:20.773 ] 00:18:20.773 }, 00:18:20.773 { 00:18:20.773 "subsystem": "vmd", 00:18:20.773 "config": [] 00:18:20.773 }, 00:18:20.773 { 00:18:20.773 "subsystem": "accel", 00:18:20.773 "config": [ 00:18:20.773 { 00:18:20.773 "method": "accel_set_options", 00:18:20.773 "params": { 00:18:20.773 "small_cache_size": 128, 00:18:20.773 "large_cache_size": 16, 00:18:20.773 "task_count": 2048, 00:18:20.773 "sequence_count": 2048, 00:18:20.773 "buf_count": 2048 00:18:20.773 } 00:18:20.773 } 00:18:20.773 ] 00:18:20.773 }, 00:18:20.773 { 00:18:20.773 "subsystem": "bdev", 00:18:20.773 "config": [ 00:18:20.773 { 00:18:20.773 "method": "bdev_set_options", 00:18:20.773 "params": { 00:18:20.773 "bdev_io_pool_size": 65535, 00:18:20.773 "bdev_io_cache_size": 256, 00:18:20.773 "bdev_auto_examine": true, 00:18:20.774 "iobuf_small_cache_size": 128, 00:18:20.774 "iobuf_large_cache_size": 16 00:18:20.774 } 00:18:20.774 }, 00:18:20.774 { 00:18:20.774 "method": "bdev_raid_set_options", 00:18:20.774 "params": { 00:18:20.774 "process_window_size_kb": 1024 00:18:20.774 } 00:18:20.774 }, 00:18:20.774 { 00:18:20.774 "method": "bdev_iscsi_set_options", 00:18:20.774 "params": { 00:18:20.774 "timeout_sec": 30 00:18:20.774 } 00:18:20.774 }, 00:18:20.774 { 00:18:20.774 "method": "bdev_nvme_set_options", 00:18:20.774 "params": { 00:18:20.774 "action_on_timeout": "none", 00:18:20.774 "timeout_us": 0, 00:18:20.774 "timeout_admin_us": 0, 00:18:20.774 "keep_alive_timeout_ms": 10000, 00:18:20.774 "transport_retry_count": 4, 00:18:20.774 "arbitration_burst": 0, 00:18:20.774 "low_priority_weight": 0, 00:18:20.774 "medium_priority_weight": 0, 00:18:20.774 "high_priority_weight": 0, 00:18:20.774 "nvme_adminq_poll_period_us": 10000, 00:18:20.774 "nvme_ioq_poll_period_us": 0, 00:18:20.774 "io_queue_requests": 512, 00:18:20.774 "delay_cmd_submit": true, 00:18:20.774 "bdev_retry_count": 3, 00:18:20.774 "transport_ack_timeout": 0, 00:18:20.774 "ctrlr_loss_timeout_sec": 0, 00:18:20.774 "reconnect_delay_sec": 0, 00:18:20.774 "fast_io_fail_timeout_sec": 0, 00:18:20.774 "generate_uuids": false, 00:18:20.774 "transport_tos": 0, 00:18:20.774 "io_path_stat": false, 00:18:20.774 "allow_accel_sequence": false 00:18:20.774 } 00:18:20.774 }, 00:18:20.774 { 00:18:20.774 "method": "bdev_nvme_attach_controller", 00:18:20.774 "params": { 00:18:20.774 "name": "TLSTEST", 00:18:20.775 "trtype": "TCP", 00:18:20.775 "adrfam": "IPv4", 00:18:20.775 "traddr": "10.0.0.2", 00:18:20.775 "trsvcid": "4420", 00:18:20.775 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.775 "prchk_reftag": false, 00:18:20.775 "prchk_guard": false, 00:18:20.775 "ctrlr_loss_timeout_sec": 0, 00:18:20.775 "reconnect_delay_sec": 0, 00:18:20.775 "fast_io_fail_timeout_sec": 0, 00:18:20.775 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:20.775 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:20.775 "hdgst":Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:20.775 false, 00:18:20.775 "ddgst": false 00:18:20.775 } 00:18:20.775 }, 00:18:20.775 { 00:18:20.775 "method": "bdev_nvme_set_hotplug", 00:18:20.775 "params": { 00:18:20.775 "period_us": 100000, 00:18:20.775 "enable": false 00:18:20.775 } 00:18:20.775 }, 00:18:20.775 { 00:18:20.775 "method": "bdev_wait_for_examine" 00:18:20.775 } 00:18:20.775 ] 00:18:20.775 }, 00:18:20.775 { 00:18:20.775 "subsystem": "nbd", 00:18:20.775 "config": [] 00:18:20.775 } 00:18:20.775 ] 00:18:20.775 }' 00:18:20.775 15:19:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:20.775 15:19:19 -- common/autotest_common.sh@10 -- # set +x 00:18:20.775 [2024-11-19 15:19:19.203016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:20.775 [2024-11-19 15:19:19.203106] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2788306 ] 00:18:20.775 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.775 [2024-11-19 15:19:19.260308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.036 [2024-11-19 15:19:19.363607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:21.036 [2024-11-19 15:19:19.520219] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:21.602 15:19:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:21.860 15:19:20 -- common/autotest_common.sh@862 -- # return 0 00:18:21.860 15:19:20 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:21.860 Running I/O for 10 seconds... 00:18:31.831 00:18:31.831 Latency(us) 00:18:31.831 [2024-11-19T14:19:30.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:31.831 [2024-11-19T14:19:30.394Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:31.831 Verification LBA range: start 0x0 length 0x2000 00:18:31.831 TLSTESTn1 : 10.02 4491.10 17.54 0.00 0.00 28455.18 7087.60 68351.62 00:18:31.831 [2024-11-19T14:19:30.394Z] =================================================================================================================== 00:18:31.831 [2024-11-19T14:19:30.394Z] Total : 4491.10 17.54 0.00 0.00 28455.18 7087.60 68351.62 00:18:31.831 0 00:18:31.831 15:19:30 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:31.831 15:19:30 -- target/tls.sh@223 -- # killprocess 2788306 00:18:31.831 15:19:30 -- common/autotest_common.sh@936 -- # '[' -z 2788306 ']' 00:18:31.831 15:19:30 -- common/autotest_common.sh@940 -- # kill -0 2788306 00:18:31.831 15:19:30 -- common/autotest_common.sh@941 -- # uname 00:18:31.831 15:19:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:31.831 15:19:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2788306 00:18:31.831 15:19:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:31.831 15:19:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:31.831 15:19:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2788306' 00:18:31.831 killing process with pid 2788306 00:18:31.831 15:19:30 -- common/autotest_common.sh@955 -- # kill 2788306 00:18:31.831 Received shutdown signal, test time was about 10.000000 seconds 00:18:31.831 00:18:31.831 Latency(us) 00:18:31.831 [2024-11-19T14:19:30.394Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:31.831 [2024-11-19T14:19:30.394Z] =================================================================================================================== 00:18:31.831 [2024-11-19T14:19:30.394Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:31.831 15:19:30 -- common/autotest_common.sh@960 -- # wait 2788306 00:18:32.090 15:19:30 -- target/tls.sh@224 -- # killprocess 2788153 00:18:32.090 15:19:30 -- common/autotest_common.sh@936 -- # '[' -z 2788153 ']' 00:18:32.090 15:19:30 -- common/autotest_common.sh@940 -- # kill -0 2788153 00:18:32.090 15:19:30 -- common/autotest_common.sh@941 -- # uname 00:18:32.090 15:19:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.090 15:19:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2788153 00:18:32.090 15:19:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:32.090 15:19:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:32.090 15:19:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2788153' 00:18:32.090 killing process with pid 2788153 00:18:32.090 15:19:30 -- common/autotest_common.sh@955 -- # kill 2788153 00:18:32.090 15:19:30 -- common/autotest_common.sh@960 -- # wait 2788153 00:18:32.657 15:19:30 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:32.657 15:19:30 -- target/tls.sh@227 -- # cleanup 00:18:32.657 15:19:30 -- target/tls.sh@15 -- # process_shm --id 0 00:18:32.657 15:19:30 -- common/autotest_common.sh@806 -- # type=--id 00:18:32.657 15:19:30 -- common/autotest_common.sh@807 -- # id=0 00:18:32.657 15:19:30 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:32.657 15:19:30 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:32.657 15:19:30 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:32.657 15:19:30 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:32.657 15:19:30 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:32.657 15:19:30 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:32.657 nvmf_trace.0 00:18:32.657 15:19:30 -- common/autotest_common.sh@821 -- # return 0 00:18:32.657 15:19:30 -- target/tls.sh@16 -- # killprocess 2788306 00:18:32.657 15:19:30 -- common/autotest_common.sh@936 -- # '[' -z 2788306 ']' 00:18:32.657 15:19:30 -- common/autotest_common.sh@940 -- # kill -0 2788306 00:18:32.657 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2788306) - No such process 00:18:32.657 15:19:30 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2788306 is not found' 00:18:32.657 Process with pid 2788306 is not found 00:18:32.657 15:19:30 -- target/tls.sh@17 -- # nvmftestfini 00:18:32.657 15:19:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:32.657 15:19:30 -- nvmf/common.sh@116 -- # sync 00:18:32.657 15:19:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:32.657 15:19:30 -- nvmf/common.sh@119 -- # set +e 00:18:32.657 15:19:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:32.657 15:19:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:32.657 rmmod nvme_tcp 00:18:32.657 rmmod nvme_fabrics 00:18:32.657 rmmod nvme_keyring 00:18:32.657 15:19:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:32.657 15:19:31 -- nvmf/common.sh@123 -- # set -e 00:18:32.657 15:19:31 -- nvmf/common.sh@124 -- # return 0 00:18:32.657 15:19:31 -- nvmf/common.sh@477 -- # '[' -n 2788153 ']' 00:18:32.657 15:19:31 -- nvmf/common.sh@478 -- # killprocess 2788153 00:18:32.657 15:19:31 -- common/autotest_common.sh@936 -- # '[' -z 2788153 ']' 00:18:32.657 15:19:31 -- common/autotest_common.sh@940 -- # kill -0 2788153 00:18:32.657 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2788153) - No such process 00:18:32.657 15:19:31 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2788153 is not found' 00:18:32.657 Process with pid 2788153 is not found 00:18:32.657 15:19:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:32.657 15:19:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:32.657 15:19:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:32.657 15:19:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:32.657 15:19:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:32.657 15:19:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:32.657 15:19:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:32.657 15:19:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:34.561 15:19:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:34.561 15:19:33 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:34.561 00:18:34.561 real 1m16.631s 00:18:34.561 user 2m5.128s 00:18:34.561 sys 0m23.141s 00:18:34.561 15:19:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:34.561 15:19:33 -- common/autotest_common.sh@10 -- # set +x 00:18:34.561 ************************************ 00:18:34.561 END TEST nvmf_tls 00:18:34.561 ************************************ 00:18:34.561 15:19:33 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:34.561 15:19:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:34.561 15:19:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:34.561 15:19:33 -- common/autotest_common.sh@10 -- # set +x 00:18:34.561 ************************************ 00:18:34.561 START TEST nvmf_fips 00:18:34.561 ************************************ 00:18:34.561 15:19:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:34.820 * Looking for test storage... 00:18:34.821 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:34.821 15:19:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:34.821 15:19:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:34.821 15:19:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:34.821 15:19:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:34.821 15:19:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:34.821 15:19:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:34.821 15:19:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:34.821 15:19:33 -- scripts/common.sh@335 -- # IFS=.-: 00:18:34.821 15:19:33 -- scripts/common.sh@335 -- # read -ra ver1 00:18:34.821 15:19:33 -- scripts/common.sh@336 -- # IFS=.-: 00:18:34.821 15:19:33 -- scripts/common.sh@336 -- # read -ra ver2 00:18:34.821 15:19:33 -- scripts/common.sh@337 -- # local 'op=<' 00:18:34.821 15:19:33 -- scripts/common.sh@339 -- # ver1_l=2 00:18:34.821 15:19:33 -- scripts/common.sh@340 -- # ver2_l=1 00:18:34.821 15:19:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:34.821 15:19:33 -- scripts/common.sh@343 -- # case "$op" in 00:18:34.821 15:19:33 -- scripts/common.sh@344 -- # : 1 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # decimal 1 00:18:34.821 15:19:33 -- scripts/common.sh@352 -- # local d=1 00:18:34.821 15:19:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:34.821 15:19:33 -- scripts/common.sh@354 -- # echo 1 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:34.821 15:19:33 -- scripts/common.sh@365 -- # decimal 2 00:18:34.821 15:19:33 -- scripts/common.sh@352 -- # local d=2 00:18:34.821 15:19:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:34.821 15:19:33 -- scripts/common.sh@354 -- # echo 2 00:18:34.821 15:19:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:34.821 15:19:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:34.821 15:19:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:34.821 15:19:33 -- scripts/common.sh@367 -- # return 0 00:18:34.821 15:19:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:34.821 15:19:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:34.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:34.821 --rc genhtml_branch_coverage=1 00:18:34.821 --rc genhtml_function_coverage=1 00:18:34.821 --rc genhtml_legend=1 00:18:34.821 --rc geninfo_all_blocks=1 00:18:34.821 --rc geninfo_unexecuted_blocks=1 00:18:34.821 00:18:34.821 ' 00:18:34.821 15:19:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:34.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:34.821 --rc genhtml_branch_coverage=1 00:18:34.821 --rc genhtml_function_coverage=1 00:18:34.821 --rc genhtml_legend=1 00:18:34.821 --rc geninfo_all_blocks=1 00:18:34.821 --rc geninfo_unexecuted_blocks=1 00:18:34.821 00:18:34.821 ' 00:18:34.821 15:19:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:34.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:34.821 --rc genhtml_branch_coverage=1 00:18:34.821 --rc genhtml_function_coverage=1 00:18:34.821 --rc genhtml_legend=1 00:18:34.821 --rc geninfo_all_blocks=1 00:18:34.821 --rc geninfo_unexecuted_blocks=1 00:18:34.821 00:18:34.821 ' 00:18:34.821 15:19:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:34.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:34.821 --rc genhtml_branch_coverage=1 00:18:34.821 --rc genhtml_function_coverage=1 00:18:34.821 --rc genhtml_legend=1 00:18:34.821 --rc geninfo_all_blocks=1 00:18:34.821 --rc geninfo_unexecuted_blocks=1 00:18:34.821 00:18:34.821 ' 00:18:34.821 15:19:33 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:34.821 15:19:33 -- nvmf/common.sh@7 -- # uname -s 00:18:34.821 15:19:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:34.821 15:19:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:34.821 15:19:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:34.821 15:19:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:34.821 15:19:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:34.821 15:19:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:34.821 15:19:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:34.821 15:19:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:34.821 15:19:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:34.821 15:19:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:34.821 15:19:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:34.821 15:19:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:34.821 15:19:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:34.821 15:19:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:34.821 15:19:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:34.821 15:19:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:34.821 15:19:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:34.821 15:19:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:34.821 15:19:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:34.821 15:19:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:34.821 15:19:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:34.821 15:19:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:34.821 15:19:33 -- paths/export.sh@5 -- # export PATH 00:18:34.821 15:19:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:34.821 15:19:33 -- nvmf/common.sh@46 -- # : 0 00:18:34.821 15:19:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:34.821 15:19:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:34.821 15:19:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:34.821 15:19:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:34.821 15:19:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:34.821 15:19:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:34.821 15:19:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:34.821 15:19:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:34.821 15:19:33 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:34.821 15:19:33 -- fips/fips.sh@89 -- # check_openssl_version 00:18:34.821 15:19:33 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:34.821 15:19:33 -- fips/fips.sh@85 -- # openssl version 00:18:34.821 15:19:33 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:34.821 15:19:33 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:34.821 15:19:33 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:34.821 15:19:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:34.821 15:19:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:34.821 15:19:33 -- scripts/common.sh@335 -- # IFS=.-: 00:18:34.821 15:19:33 -- scripts/common.sh@335 -- # read -ra ver1 00:18:34.821 15:19:33 -- scripts/common.sh@336 -- # IFS=.-: 00:18:34.821 15:19:33 -- scripts/common.sh@336 -- # read -ra ver2 00:18:34.821 15:19:33 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:34.821 15:19:33 -- scripts/common.sh@339 -- # ver1_l=3 00:18:34.821 15:19:33 -- scripts/common.sh@340 -- # ver2_l=3 00:18:34.821 15:19:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:34.821 15:19:33 -- scripts/common.sh@343 -- # case "$op" in 00:18:34.821 15:19:33 -- scripts/common.sh@347 -- # : 1 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # decimal 3 00:18:34.821 15:19:33 -- scripts/common.sh@352 -- # local d=3 00:18:34.821 15:19:33 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:34.821 15:19:33 -- scripts/common.sh@354 -- # echo 3 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:34.821 15:19:33 -- scripts/common.sh@365 -- # decimal 3 00:18:34.821 15:19:33 -- scripts/common.sh@352 -- # local d=3 00:18:34.821 15:19:33 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:34.821 15:19:33 -- scripts/common.sh@354 -- # echo 3 00:18:34.821 15:19:33 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:34.821 15:19:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:34.821 15:19:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v++ )) 00:18:34.821 15:19:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # decimal 1 00:18:34.821 15:19:33 -- scripts/common.sh@352 -- # local d=1 00:18:34.821 15:19:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:34.821 15:19:33 -- scripts/common.sh@354 -- # echo 1 00:18:34.821 15:19:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:34.821 15:19:33 -- scripts/common.sh@365 -- # decimal 0 00:18:34.822 15:19:33 -- scripts/common.sh@352 -- # local d=0 00:18:34.822 15:19:33 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:34.822 15:19:33 -- scripts/common.sh@354 -- # echo 0 00:18:34.822 15:19:33 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:34.822 15:19:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:34.822 15:19:33 -- scripts/common.sh@366 -- # return 0 00:18:34.822 15:19:33 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:34.822 15:19:33 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:34.822 15:19:33 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:34.822 15:19:33 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:34.822 15:19:33 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:34.822 15:19:33 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:34.822 15:19:33 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:34.822 15:19:33 -- fips/fips.sh@113 -- # build_openssl_config 00:18:34.822 15:19:33 -- fips/fips.sh@37 -- # cat 00:18:34.822 15:19:33 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:34.822 15:19:33 -- fips/fips.sh@58 -- # cat - 00:18:34.822 15:19:33 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:34.822 15:19:33 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:34.822 15:19:33 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:34.822 15:19:33 -- fips/fips.sh@116 -- # openssl list -providers 00:18:34.822 15:19:33 -- fips/fips.sh@116 -- # grep name 00:18:34.822 15:19:33 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:34.822 15:19:33 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:34.822 15:19:33 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:34.822 15:19:33 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:34.822 15:19:33 -- fips/fips.sh@127 -- # : 00:18:34.822 15:19:33 -- common/autotest_common.sh@650 -- # local es=0 00:18:34.822 15:19:33 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:34.822 15:19:33 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:34.822 15:19:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:34.822 15:19:33 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:34.822 15:19:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:34.822 15:19:33 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:34.822 15:19:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:34.822 15:19:33 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:34.822 15:19:33 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:34.822 15:19:33 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:34.822 Error setting digest 00:18:34.822 40F21E07BF7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:34.822 40F21E07BF7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:34.822 15:19:33 -- common/autotest_common.sh@653 -- # es=1 00:18:34.822 15:19:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:34.822 15:19:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:34.822 15:19:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:34.822 15:19:33 -- fips/fips.sh@130 -- # nvmftestinit 00:18:34.822 15:19:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:34.822 15:19:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:34.822 15:19:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:34.822 15:19:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:34.822 15:19:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:34.822 15:19:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.822 15:19:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:34.822 15:19:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:34.822 15:19:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:34.822 15:19:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:34.822 15:19:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:34.822 15:19:33 -- common/autotest_common.sh@10 -- # set +x 00:18:37.355 15:19:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:37.355 15:19:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:37.355 15:19:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:37.355 15:19:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:37.355 15:19:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:37.355 15:19:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:37.355 15:19:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:37.355 15:19:35 -- nvmf/common.sh@294 -- # net_devs=() 00:18:37.355 15:19:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:37.355 15:19:35 -- nvmf/common.sh@295 -- # e810=() 00:18:37.355 15:19:35 -- nvmf/common.sh@295 -- # local -ga e810 00:18:37.355 15:19:35 -- nvmf/common.sh@296 -- # x722=() 00:18:37.355 15:19:35 -- nvmf/common.sh@296 -- # local -ga x722 00:18:37.355 15:19:35 -- nvmf/common.sh@297 -- # mlx=() 00:18:37.355 15:19:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:37.355 15:19:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:37.355 15:19:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:37.355 15:19:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:37.355 15:19:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:37.356 15:19:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:37.356 15:19:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:37.356 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:37.356 15:19:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:37.356 15:19:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:37.356 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:37.356 15:19:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:37.356 15:19:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:37.356 15:19:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:37.356 15:19:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:37.356 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:37.356 15:19:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:37.356 15:19:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:37.356 15:19:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:37.356 15:19:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:37.356 15:19:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:37.356 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:37.356 15:19:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:37.356 15:19:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:37.356 15:19:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:37.356 15:19:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:37.356 15:19:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:37.356 15:19:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:37.356 15:19:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:37.356 15:19:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:37.356 15:19:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:37.356 15:19:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:37.356 15:19:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:37.356 15:19:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:37.356 15:19:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:37.356 15:19:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:37.356 15:19:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:37.356 15:19:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:37.356 15:19:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:37.356 15:19:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:37.356 15:19:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:37.356 15:19:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:37.356 15:19:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:37.356 15:19:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:37.356 15:19:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:37.356 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:37.356 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:18:37.356 00:18:37.356 --- 10.0.0.2 ping statistics --- 00:18:37.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:37.356 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:18:37.356 15:19:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:37.356 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:37.356 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:18:37.356 00:18:37.356 --- 10.0.0.1 ping statistics --- 00:18:37.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:37.356 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:18:37.356 15:19:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:37.356 15:19:35 -- nvmf/common.sh@410 -- # return 0 00:18:37.356 15:19:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:37.356 15:19:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:37.356 15:19:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:37.356 15:19:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:37.356 15:19:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:37.356 15:19:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:37.356 15:19:35 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:37.356 15:19:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:37.356 15:19:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:37.356 15:19:35 -- common/autotest_common.sh@10 -- # set +x 00:18:37.356 15:19:35 -- nvmf/common.sh@469 -- # nvmfpid=2791773 00:18:37.356 15:19:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:37.356 15:19:35 -- nvmf/common.sh@470 -- # waitforlisten 2791773 00:18:37.356 15:19:35 -- common/autotest_common.sh@829 -- # '[' -z 2791773 ']' 00:18:37.356 15:19:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:37.356 15:19:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:37.356 15:19:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:37.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:37.356 15:19:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:37.356 15:19:35 -- common/autotest_common.sh@10 -- # set +x 00:18:37.356 [2024-11-19 15:19:35.595823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:37.356 [2024-11-19 15:19:35.595897] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:37.356 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.356 [2024-11-19 15:19:35.674434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.356 [2024-11-19 15:19:35.806174] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:37.356 [2024-11-19 15:19:35.806355] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:37.356 [2024-11-19 15:19:35.806386] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:37.356 [2024-11-19 15:19:35.806413] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:37.356 [2024-11-19 15:19:35.806468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:38.290 15:19:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:38.290 15:19:36 -- common/autotest_common.sh@862 -- # return 0 00:18:38.290 15:19:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:38.290 15:19:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:38.290 15:19:36 -- common/autotest_common.sh@10 -- # set +x 00:18:38.290 15:19:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:38.290 15:19:36 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:38.290 15:19:36 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:38.290 15:19:36 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.290 15:19:36 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:38.290 15:19:36 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.290 15:19:36 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.290 15:19:36 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.290 15:19:36 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:38.549 [2024-11-19 15:19:36.997805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:38.549 [2024-11-19 15:19:37.013787] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:38.549 [2024-11-19 15:19:37.014018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:38.549 malloc0 00:18:38.549 15:19:37 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:38.549 15:19:37 -- fips/fips.sh@147 -- # bdevperf_pid=2791937 00:18:38.549 15:19:37 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:38.549 15:19:37 -- fips/fips.sh@148 -- # waitforlisten 2791937 /var/tmp/bdevperf.sock 00:18:38.549 15:19:37 -- common/autotest_common.sh@829 -- # '[' -z 2791937 ']' 00:18:38.549 15:19:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:38.549 15:19:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:38.549 15:19:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:38.549 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:38.549 15:19:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:38.549 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:18:38.808 [2024-11-19 15:19:37.130973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:38.808 [2024-11-19 15:19:37.131063] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2791937 ] 00:18:38.808 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.808 [2024-11-19 15:19:37.191496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:38.808 [2024-11-19 15:19:37.293470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:39.743 15:19:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:39.743 15:19:38 -- common/autotest_common.sh@862 -- # return 0 00:18:39.743 15:19:38 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.001 [2024-11-19 15:19:38.343283] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:40.001 TLSTESTn1 00:18:40.001 15:19:38 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:40.001 Running I/O for 10 seconds... 00:18:52.203 00:18:52.203 Latency(us) 00:18:52.203 [2024-11-19T14:19:50.766Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:52.203 [2024-11-19T14:19:50.766Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:52.203 Verification LBA range: start 0x0 length 0x2000 00:18:52.203 TLSTESTn1 : 10.02 4464.65 17.44 0.00 0.00 28626.42 5995.33 45826.65 00:18:52.203 [2024-11-19T14:19:50.766Z] =================================================================================================================== 00:18:52.203 [2024-11-19T14:19:50.766Z] Total : 4464.65 17.44 0.00 0.00 28626.42 5995.33 45826.65 00:18:52.203 0 00:18:52.203 15:19:48 -- fips/fips.sh@1 -- # cleanup 00:18:52.203 15:19:48 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:52.203 15:19:48 -- common/autotest_common.sh@806 -- # type=--id 00:18:52.203 15:19:48 -- common/autotest_common.sh@807 -- # id=0 00:18:52.203 15:19:48 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:52.203 15:19:48 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:52.203 15:19:48 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:52.203 15:19:48 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:52.203 15:19:48 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:52.203 15:19:48 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:52.203 nvmf_trace.0 00:18:52.203 15:19:48 -- common/autotest_common.sh@821 -- # return 0 00:18:52.203 15:19:48 -- fips/fips.sh@16 -- # killprocess 2791937 00:18:52.203 15:19:48 -- common/autotest_common.sh@936 -- # '[' -z 2791937 ']' 00:18:52.203 15:19:48 -- common/autotest_common.sh@940 -- # kill -0 2791937 00:18:52.203 15:19:48 -- common/autotest_common.sh@941 -- # uname 00:18:52.203 15:19:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.203 15:19:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2791937 00:18:52.203 15:19:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:52.203 15:19:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:52.203 15:19:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2791937' 00:18:52.203 killing process with pid 2791937 00:18:52.203 15:19:48 -- common/autotest_common.sh@955 -- # kill 2791937 00:18:52.203 Received shutdown signal, test time was about 10.000000 seconds 00:18:52.203 00:18:52.203 Latency(us) 00:18:52.203 [2024-11-19T14:19:50.766Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:52.203 [2024-11-19T14:19:50.766Z] =================================================================================================================== 00:18:52.203 [2024-11-19T14:19:50.766Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:52.203 15:19:48 -- common/autotest_common.sh@960 -- # wait 2791937 00:18:52.203 15:19:48 -- fips/fips.sh@17 -- # nvmftestfini 00:18:52.203 15:19:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:52.203 15:19:48 -- nvmf/common.sh@116 -- # sync 00:18:52.203 15:19:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:52.203 15:19:48 -- nvmf/common.sh@119 -- # set +e 00:18:52.203 15:19:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:52.203 15:19:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:52.203 rmmod nvme_tcp 00:18:52.203 rmmod nvme_fabrics 00:18:52.203 rmmod nvme_keyring 00:18:52.203 15:19:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:52.203 15:19:49 -- nvmf/common.sh@123 -- # set -e 00:18:52.203 15:19:49 -- nvmf/common.sh@124 -- # return 0 00:18:52.203 15:19:49 -- nvmf/common.sh@477 -- # '[' -n 2791773 ']' 00:18:52.203 15:19:49 -- nvmf/common.sh@478 -- # killprocess 2791773 00:18:52.203 15:19:49 -- common/autotest_common.sh@936 -- # '[' -z 2791773 ']' 00:18:52.203 15:19:49 -- common/autotest_common.sh@940 -- # kill -0 2791773 00:18:52.203 15:19:49 -- common/autotest_common.sh@941 -- # uname 00:18:52.203 15:19:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.203 15:19:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2791773 00:18:52.203 15:19:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:52.203 15:19:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:52.203 15:19:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2791773' 00:18:52.203 killing process with pid 2791773 00:18:52.203 15:19:49 -- common/autotest_common.sh@955 -- # kill 2791773 00:18:52.203 15:19:49 -- common/autotest_common.sh@960 -- # wait 2791773 00:18:52.203 15:19:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:52.203 15:19:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:52.203 15:19:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:52.203 15:19:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:52.203 15:19:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:52.203 15:19:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.203 15:19:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.203 15:19:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.141 15:19:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:53.141 15:19:51 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:53.141 00:18:53.141 real 0m18.297s 00:18:53.141 user 0m24.236s 00:18:53.141 sys 0m5.797s 00:18:53.141 15:19:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:53.141 15:19:51 -- common/autotest_common.sh@10 -- # set +x 00:18:53.141 ************************************ 00:18:53.141 END TEST nvmf_fips 00:18:53.141 ************************************ 00:18:53.141 15:19:51 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:53.141 15:19:51 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:53.141 15:19:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:53.141 15:19:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:53.141 15:19:51 -- common/autotest_common.sh@10 -- # set +x 00:18:53.141 ************************************ 00:18:53.141 START TEST nvmf_fuzz 00:18:53.141 ************************************ 00:18:53.141 15:19:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:53.141 * Looking for test storage... 00:18:53.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:53.141 15:19:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:53.141 15:19:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:53.141 15:19:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:53.141 15:19:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:53.141 15:19:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:53.141 15:19:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:53.141 15:19:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:53.141 15:19:51 -- scripts/common.sh@335 -- # IFS=.-: 00:18:53.141 15:19:51 -- scripts/common.sh@335 -- # read -ra ver1 00:18:53.141 15:19:51 -- scripts/common.sh@336 -- # IFS=.-: 00:18:53.141 15:19:51 -- scripts/common.sh@336 -- # read -ra ver2 00:18:53.141 15:19:51 -- scripts/common.sh@337 -- # local 'op=<' 00:18:53.141 15:19:51 -- scripts/common.sh@339 -- # ver1_l=2 00:18:53.141 15:19:51 -- scripts/common.sh@340 -- # ver2_l=1 00:18:53.141 15:19:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:53.141 15:19:51 -- scripts/common.sh@343 -- # case "$op" in 00:18:53.141 15:19:51 -- scripts/common.sh@344 -- # : 1 00:18:53.141 15:19:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:53.141 15:19:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:53.141 15:19:51 -- scripts/common.sh@364 -- # decimal 1 00:18:53.141 15:19:51 -- scripts/common.sh@352 -- # local d=1 00:18:53.141 15:19:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:53.141 15:19:51 -- scripts/common.sh@354 -- # echo 1 00:18:53.141 15:19:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:53.141 15:19:51 -- scripts/common.sh@365 -- # decimal 2 00:18:53.141 15:19:51 -- scripts/common.sh@352 -- # local d=2 00:18:53.141 15:19:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:53.141 15:19:51 -- scripts/common.sh@354 -- # echo 2 00:18:53.141 15:19:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:53.141 15:19:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:53.141 15:19:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:53.141 15:19:51 -- scripts/common.sh@367 -- # return 0 00:18:53.141 15:19:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:53.141 15:19:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:53.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.141 --rc genhtml_branch_coverage=1 00:18:53.141 --rc genhtml_function_coverage=1 00:18:53.141 --rc genhtml_legend=1 00:18:53.141 --rc geninfo_all_blocks=1 00:18:53.141 --rc geninfo_unexecuted_blocks=1 00:18:53.142 00:18:53.142 ' 00:18:53.142 15:19:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:53.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.142 --rc genhtml_branch_coverage=1 00:18:53.142 --rc genhtml_function_coverage=1 00:18:53.142 --rc genhtml_legend=1 00:18:53.142 --rc geninfo_all_blocks=1 00:18:53.142 --rc geninfo_unexecuted_blocks=1 00:18:53.142 00:18:53.142 ' 00:18:53.142 15:19:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:53.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.142 --rc genhtml_branch_coverage=1 00:18:53.142 --rc genhtml_function_coverage=1 00:18:53.142 --rc genhtml_legend=1 00:18:53.142 --rc geninfo_all_blocks=1 00:18:53.142 --rc geninfo_unexecuted_blocks=1 00:18:53.142 00:18:53.142 ' 00:18:53.142 15:19:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:53.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.142 --rc genhtml_branch_coverage=1 00:18:53.142 --rc genhtml_function_coverage=1 00:18:53.142 --rc genhtml_legend=1 00:18:53.142 --rc geninfo_all_blocks=1 00:18:53.142 --rc geninfo_unexecuted_blocks=1 00:18:53.142 00:18:53.142 ' 00:18:53.142 15:19:51 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:53.142 15:19:51 -- nvmf/common.sh@7 -- # uname -s 00:18:53.142 15:19:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:53.142 15:19:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:53.142 15:19:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:53.142 15:19:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:53.142 15:19:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:53.142 15:19:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:53.142 15:19:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:53.142 15:19:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:53.142 15:19:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:53.142 15:19:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:53.142 15:19:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.142 15:19:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.142 15:19:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:53.142 15:19:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:53.142 15:19:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:53.142 15:19:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:53.142 15:19:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:53.142 15:19:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:53.142 15:19:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:53.142 15:19:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.142 15:19:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.142 15:19:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.142 15:19:51 -- paths/export.sh@5 -- # export PATH 00:18:53.142 15:19:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.142 15:19:51 -- nvmf/common.sh@46 -- # : 0 00:18:53.142 15:19:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:53.142 15:19:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:53.142 15:19:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:53.142 15:19:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:53.142 15:19:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:53.142 15:19:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:53.142 15:19:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:53.142 15:19:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:53.142 15:19:51 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:53.142 15:19:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:53.142 15:19:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:53.142 15:19:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:53.142 15:19:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:53.142 15:19:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:53.142 15:19:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.142 15:19:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.142 15:19:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.142 15:19:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:53.142 15:19:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:53.142 15:19:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:53.142 15:19:51 -- common/autotest_common.sh@10 -- # set +x 00:18:55.677 15:19:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:55.677 15:19:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:55.677 15:19:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:55.677 15:19:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:55.677 15:19:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:55.677 15:19:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:55.677 15:19:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:55.677 15:19:53 -- nvmf/common.sh@294 -- # net_devs=() 00:18:55.677 15:19:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:55.677 15:19:53 -- nvmf/common.sh@295 -- # e810=() 00:18:55.677 15:19:53 -- nvmf/common.sh@295 -- # local -ga e810 00:18:55.677 15:19:53 -- nvmf/common.sh@296 -- # x722=() 00:18:55.677 15:19:53 -- nvmf/common.sh@296 -- # local -ga x722 00:18:55.677 15:19:53 -- nvmf/common.sh@297 -- # mlx=() 00:18:55.677 15:19:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:55.677 15:19:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:55.677 15:19:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:55.677 15:19:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:55.678 15:19:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:55.678 15:19:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:55.678 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:55.678 15:19:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:55.678 15:19:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:55.678 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:55.678 15:19:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:55.678 15:19:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:55.678 15:19:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:55.678 15:19:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:55.678 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:55.678 15:19:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:55.678 15:19:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:55.678 15:19:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:55.678 15:19:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:55.678 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:55.678 15:19:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:55.678 15:19:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:55.678 15:19:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:55.678 15:19:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:55.678 15:19:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:55.678 15:19:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:55.678 15:19:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:55.678 15:19:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:55.678 15:19:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:55.678 15:19:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:55.678 15:19:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:55.678 15:19:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:55.678 15:19:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:55.678 15:19:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:55.678 15:19:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:55.678 15:19:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:55.678 15:19:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:55.678 15:19:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:55.678 15:19:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:55.678 15:19:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:55.678 15:19:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:55.678 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:55.678 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:18:55.678 00:18:55.678 --- 10.0.0.2 ping statistics --- 00:18:55.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:55.678 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:18:55.678 15:19:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:55.678 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:55.678 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:18:55.678 00:18:55.678 --- 10.0.0.1 ping statistics --- 00:18:55.678 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:55.678 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:18:55.678 15:19:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:55.678 15:19:53 -- nvmf/common.sh@410 -- # return 0 00:18:55.678 15:19:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:55.678 15:19:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:55.678 15:19:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:55.678 15:19:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:55.678 15:19:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:55.678 15:19:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:55.678 15:19:53 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2795378 00:18:55.678 15:19:53 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:55.678 15:19:53 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:55.678 15:19:53 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2795378 00:18:55.678 15:19:53 -- common/autotest_common.sh@829 -- # '[' -z 2795378 ']' 00:18:55.678 15:19:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:55.678 15:19:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:55.678 15:19:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:55.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:55.678 15:19:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:55.678 15:19:53 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 15:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:56.613 15:19:54 -- common/autotest_common.sh@862 -- # return 0 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:56.613 15:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.613 15:19:54 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 15:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:56.613 15:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.613 15:19:54 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 Malloc0 00:18:56.613 15:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:56.613 15:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.613 15:19:54 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 15:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:56.613 15:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.613 15:19:54 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 15:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:56.613 15:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.613 15:19:54 -- common/autotest_common.sh@10 -- # set +x 00:18:56.613 15:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:56.613 15:19:54 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:28.769 Fuzzing completed. Shutting down the fuzz application 00:19:28.769 00:19:28.769 Dumping successful admin opcodes: 00:19:28.769 8, 9, 10, 24, 00:19:28.769 Dumping successful io opcodes: 00:19:28.769 0, 9, 00:19:28.769 NS: 0x200003aeff00 I/O qp, Total commands completed: 457939, total successful commands: 2657, random_seed: 1447577856 00:19:28.769 NS: 0x200003aeff00 admin qp, Total commands completed: 57296, total successful commands: 456, random_seed: 2201759296 00:19:28.769 15:20:25 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:28.769 Fuzzing completed. Shutting down the fuzz application 00:19:28.769 00:19:28.769 Dumping successful admin opcodes: 00:19:28.769 24, 00:19:28.769 Dumping successful io opcodes: 00:19:28.769 00:19:28.769 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1090514955 00:19:28.769 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1090652184 00:19:28.769 15:20:26 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:28.769 15:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.769 15:20:26 -- common/autotest_common.sh@10 -- # set +x 00:19:28.769 15:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.769 15:20:26 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:28.769 15:20:26 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:28.769 15:20:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:28.769 15:20:26 -- nvmf/common.sh@116 -- # sync 00:19:28.769 15:20:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:28.769 15:20:26 -- nvmf/common.sh@119 -- # set +e 00:19:28.769 15:20:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:28.769 15:20:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:28.769 rmmod nvme_tcp 00:19:28.769 rmmod nvme_fabrics 00:19:28.769 rmmod nvme_keyring 00:19:28.769 15:20:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:28.769 15:20:27 -- nvmf/common.sh@123 -- # set -e 00:19:28.769 15:20:27 -- nvmf/common.sh@124 -- # return 0 00:19:28.769 15:20:27 -- nvmf/common.sh@477 -- # '[' -n 2795378 ']' 00:19:28.769 15:20:27 -- nvmf/common.sh@478 -- # killprocess 2795378 00:19:28.769 15:20:27 -- common/autotest_common.sh@936 -- # '[' -z 2795378 ']' 00:19:28.769 15:20:27 -- common/autotest_common.sh@940 -- # kill -0 2795378 00:19:28.769 15:20:27 -- common/autotest_common.sh@941 -- # uname 00:19:28.769 15:20:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:28.769 15:20:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2795378 00:19:28.769 15:20:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:28.769 15:20:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:28.769 15:20:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2795378' 00:19:28.769 killing process with pid 2795378 00:19:28.769 15:20:27 -- common/autotest_common.sh@955 -- # kill 2795378 00:19:28.769 15:20:27 -- common/autotest_common.sh@960 -- # wait 2795378 00:19:29.028 15:20:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:29.028 15:20:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:29.028 15:20:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:29.028 15:20:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:29.028 15:20:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:29.028 15:20:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.028 15:20:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.028 15:20:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:30.931 15:20:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:30.931 15:20:29 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:30.931 00:19:30.931 real 0m38.068s 00:19:30.931 user 0m51.612s 00:19:30.931 sys 0m15.502s 00:19:30.931 15:20:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:30.931 15:20:29 -- common/autotest_common.sh@10 -- # set +x 00:19:30.931 ************************************ 00:19:30.931 END TEST nvmf_fuzz 00:19:30.931 ************************************ 00:19:31.190 15:20:29 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:31.190 15:20:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:31.190 15:20:29 -- common/autotest_common.sh@10 -- # set +x 00:19:31.190 ************************************ 00:19:31.190 START TEST nvmf_multiconnection 00:19:31.190 ************************************ 00:19:31.190 15:20:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:31.190 * Looking for test storage... 00:19:31.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:31.190 15:20:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:31.190 15:20:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:31.190 15:20:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:31.190 15:20:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:31.190 15:20:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:31.190 15:20:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:31.190 15:20:29 -- scripts/common.sh@335 -- # IFS=.-: 00:19:31.190 15:20:29 -- scripts/common.sh@335 -- # read -ra ver1 00:19:31.190 15:20:29 -- scripts/common.sh@336 -- # IFS=.-: 00:19:31.190 15:20:29 -- scripts/common.sh@336 -- # read -ra ver2 00:19:31.190 15:20:29 -- scripts/common.sh@337 -- # local 'op=<' 00:19:31.190 15:20:29 -- scripts/common.sh@339 -- # ver1_l=2 00:19:31.190 15:20:29 -- scripts/common.sh@340 -- # ver2_l=1 00:19:31.190 15:20:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:31.190 15:20:29 -- scripts/common.sh@343 -- # case "$op" in 00:19:31.190 15:20:29 -- scripts/common.sh@344 -- # : 1 00:19:31.190 15:20:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:31.190 15:20:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:31.190 15:20:29 -- scripts/common.sh@364 -- # decimal 1 00:19:31.190 15:20:29 -- scripts/common.sh@352 -- # local d=1 00:19:31.190 15:20:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:31.190 15:20:29 -- scripts/common.sh@354 -- # echo 1 00:19:31.190 15:20:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:31.190 15:20:29 -- scripts/common.sh@365 -- # decimal 2 00:19:31.190 15:20:29 -- scripts/common.sh@352 -- # local d=2 00:19:31.190 15:20:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:31.190 15:20:29 -- scripts/common.sh@354 -- # echo 2 00:19:31.190 15:20:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:31.190 15:20:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:31.190 15:20:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:31.190 15:20:29 -- scripts/common.sh@367 -- # return 0 00:19:31.190 15:20:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:31.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.190 --rc genhtml_branch_coverage=1 00:19:31.190 --rc genhtml_function_coverage=1 00:19:31.190 --rc genhtml_legend=1 00:19:31.190 --rc geninfo_all_blocks=1 00:19:31.190 --rc geninfo_unexecuted_blocks=1 00:19:31.190 00:19:31.190 ' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:31.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.190 --rc genhtml_branch_coverage=1 00:19:31.190 --rc genhtml_function_coverage=1 00:19:31.190 --rc genhtml_legend=1 00:19:31.190 --rc geninfo_all_blocks=1 00:19:31.190 --rc geninfo_unexecuted_blocks=1 00:19:31.190 00:19:31.190 ' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:31.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.190 --rc genhtml_branch_coverage=1 00:19:31.190 --rc genhtml_function_coverage=1 00:19:31.190 --rc genhtml_legend=1 00:19:31.190 --rc geninfo_all_blocks=1 00:19:31.190 --rc geninfo_unexecuted_blocks=1 00:19:31.190 00:19:31.190 ' 00:19:31.190 15:20:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:31.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:31.190 --rc genhtml_branch_coverage=1 00:19:31.190 --rc genhtml_function_coverage=1 00:19:31.190 --rc genhtml_legend=1 00:19:31.190 --rc geninfo_all_blocks=1 00:19:31.190 --rc geninfo_unexecuted_blocks=1 00:19:31.190 00:19:31.190 ' 00:19:31.190 15:20:29 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:31.190 15:20:29 -- nvmf/common.sh@7 -- # uname -s 00:19:31.190 15:20:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:31.190 15:20:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:31.190 15:20:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:31.190 15:20:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:31.190 15:20:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:31.190 15:20:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:31.190 15:20:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:31.190 15:20:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:31.190 15:20:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:31.190 15:20:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:31.190 15:20:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:31.190 15:20:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:31.190 15:20:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:31.190 15:20:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:31.190 15:20:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:31.190 15:20:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:31.190 15:20:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:31.190 15:20:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:31.190 15:20:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:31.190 15:20:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.190 15:20:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.190 15:20:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.190 15:20:29 -- paths/export.sh@5 -- # export PATH 00:19:31.190 15:20:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.190 15:20:29 -- nvmf/common.sh@46 -- # : 0 00:19:31.190 15:20:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:31.190 15:20:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:31.190 15:20:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:31.190 15:20:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:31.190 15:20:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:31.190 15:20:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:31.191 15:20:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:31.191 15:20:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:31.191 15:20:29 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:31.191 15:20:29 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:31.191 15:20:29 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:31.191 15:20:29 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:31.191 15:20:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:31.191 15:20:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:31.191 15:20:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:31.191 15:20:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:31.191 15:20:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:31.191 15:20:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:31.191 15:20:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:31.191 15:20:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:31.191 15:20:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:31.191 15:20:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:31.191 15:20:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:31.191 15:20:29 -- common/autotest_common.sh@10 -- # set +x 00:19:33.725 15:20:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:33.725 15:20:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:33.725 15:20:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:33.725 15:20:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:33.725 15:20:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:33.725 15:20:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:33.725 15:20:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:33.725 15:20:31 -- nvmf/common.sh@294 -- # net_devs=() 00:19:33.725 15:20:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:33.725 15:20:31 -- nvmf/common.sh@295 -- # e810=() 00:19:33.725 15:20:31 -- nvmf/common.sh@295 -- # local -ga e810 00:19:33.725 15:20:31 -- nvmf/common.sh@296 -- # x722=() 00:19:33.725 15:20:31 -- nvmf/common.sh@296 -- # local -ga x722 00:19:33.725 15:20:31 -- nvmf/common.sh@297 -- # mlx=() 00:19:33.725 15:20:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:33.725 15:20:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:33.725 15:20:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:33.725 15:20:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:33.725 15:20:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:33.725 15:20:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:33.725 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:33.725 15:20:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:33.725 15:20:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:33.725 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:33.725 15:20:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:33.725 15:20:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:33.725 15:20:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:33.725 15:20:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:33.725 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:33.725 15:20:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:33.725 15:20:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:33.725 15:20:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:33.725 15:20:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:33.725 15:20:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:33.725 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:33.725 15:20:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:33.725 15:20:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:33.725 15:20:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:33.725 15:20:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:33.725 15:20:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:33.725 15:20:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:33.725 15:20:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:33.725 15:20:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:33.725 15:20:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:33.725 15:20:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:33.725 15:20:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:33.725 15:20:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:33.725 15:20:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:33.725 15:20:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:33.725 15:20:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:33.725 15:20:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:33.725 15:20:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:33.725 15:20:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:33.725 15:20:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:33.725 15:20:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:33.725 15:20:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:33.725 15:20:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:33.725 15:20:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:33.725 15:20:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:33.725 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:33.725 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:19:33.725 00:19:33.725 --- 10.0.0.2 ping statistics --- 00:19:33.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.725 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:19:33.726 15:20:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:33.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:33.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:19:33.726 00:19:33.726 --- 10.0.0.1 ping statistics --- 00:19:33.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.726 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:19:33.726 15:20:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:33.726 15:20:31 -- nvmf/common.sh@410 -- # return 0 00:19:33.726 15:20:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:33.726 15:20:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:33.726 15:20:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:33.726 15:20:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:33.726 15:20:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:33.726 15:20:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:33.726 15:20:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:33.726 15:20:31 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:33.726 15:20:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:33.726 15:20:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:33.726 15:20:31 -- common/autotest_common.sh@10 -- # set +x 00:19:33.726 15:20:31 -- nvmf/common.sh@469 -- # nvmfpid=2801262 00:19:33.726 15:20:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:33.726 15:20:31 -- nvmf/common.sh@470 -- # waitforlisten 2801262 00:19:33.726 15:20:31 -- common/autotest_common.sh@829 -- # '[' -z 2801262 ']' 00:19:33.726 15:20:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:33.726 15:20:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:33.726 15:20:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:33.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:33.726 15:20:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:33.726 15:20:31 -- common/autotest_common.sh@10 -- # set +x 00:19:33.726 [2024-11-19 15:20:31.871861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:33.726 [2024-11-19 15:20:31.871936] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:33.726 EAL: No free 2048 kB hugepages reported on node 1 00:19:33.726 [2024-11-19 15:20:31.941828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:33.726 [2024-11-19 15:20:32.061916] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:33.726 [2024-11-19 15:20:32.062081] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:33.726 [2024-11-19 15:20:32.062103] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:33.726 [2024-11-19 15:20:32.062118] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:33.726 [2024-11-19 15:20:32.062653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:33.726 [2024-11-19 15:20:32.062725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:33.726 [2024-11-19 15:20:32.062757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:33.726 [2024-11-19 15:20:32.062761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:34.293 15:20:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:34.293 15:20:32 -- common/autotest_common.sh@862 -- # return 0 00:19:34.293 15:20:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:34.293 15:20:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:34.293 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.293 15:20:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:34.293 15:20:32 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:34.293 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.293 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.293 [2024-11-19 15:20:32.851172] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:34.552 15:20:32 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:32 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 Malloc1 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 [2024-11-19 15:20:32.906262] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:32 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 Malloc2 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:32 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 Malloc3 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:32 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:34.552 15:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 Malloc4 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 Malloc5 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.552 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.552 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.552 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:34.552 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.552 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 Malloc6 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.811 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 Malloc7 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.811 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 Malloc8 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.811 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 Malloc9 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.811 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.811 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:34.811 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.811 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.812 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 Malloc10 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.812 15:20:33 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:34.812 Malloc11 00:19:34.812 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.812 15:20:33 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:34.812 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.812 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:35.070 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.070 15:20:33 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:35.070 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.070 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:35.070 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.070 15:20:33 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:35.070 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:35.070 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:35.070 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:35.070 15:20:33 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:35.070 15:20:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.070 15:20:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:35.636 15:20:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:35.636 15:20:33 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.636 15:20:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.636 15:20:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.636 15:20:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.535 15:20:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.535 15:20:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.535 15:20:35 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:37.535 15:20:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.535 15:20:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.535 15:20:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.535 15:20:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.535 15:20:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:38.100 15:20:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:38.100 15:20:36 -- common/autotest_common.sh@1187 -- # local i=0 00:19:38.100 15:20:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.100 15:20:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:38.100 15:20:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:40.628 15:20:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:40.628 15:20:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:40.628 15:20:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:40.628 15:20:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:40.628 15:20:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.628 15:20:38 -- common/autotest_common.sh@1197 -- # return 0 00:19:40.628 15:20:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.628 15:20:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:40.886 15:20:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:40.886 15:20:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:40.886 15:20:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:40.886 15:20:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:40.886 15:20:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:43.414 15:20:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:43.414 15:20:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:43.414 15:20:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:43.414 15:20:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:43.414 15:20:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:43.414 15:20:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:43.414 15:20:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:43.414 15:20:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:43.672 15:20:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:43.672 15:20:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.672 15:20:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.672 15:20:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.672 15:20:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.573 15:20:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.573 15:20:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.573 15:20:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:45.831 15:20:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.831 15:20:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.831 15:20:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.831 15:20:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.831 15:20:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:46.399 15:20:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:46.399 15:20:44 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.399 15:20:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.399 15:20:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.399 15:20:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.300 15:20:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.300 15:20:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.300 15:20:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:48.300 15:20:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.300 15:20:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.300 15:20:46 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.300 15:20:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.300 15:20:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:49.234 15:20:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:49.234 15:20:47 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.234 15:20:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.234 15:20:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.234 15:20:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.135 15:20:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.135 15:20:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.135 15:20:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:51.135 15:20:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.135 15:20:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.135 15:20:49 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.135 15:20:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.135 15:20:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:52.069 15:20:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:52.069 15:20:50 -- common/autotest_common.sh@1187 -- # local i=0 00:19:52.070 15:20:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.070 15:20:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:52.070 15:20:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.970 15:20:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.970 15:20:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.970 15:20:52 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:53.970 15:20:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.970 15:20:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.970 15:20:52 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.970 15:20:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.970 15:20:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:54.905 15:20:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:54.905 15:20:53 -- common/autotest_common.sh@1187 -- # local i=0 00:19:54.905 15:20:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:54.905 15:20:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:54.905 15:20:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:56.805 15:20:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:56.805 15:20:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:56.805 15:20:55 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:56.805 15:20:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:56.805 15:20:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:56.805 15:20:55 -- common/autotest_common.sh@1197 -- # return 0 00:19:56.805 15:20:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.805 15:20:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:57.372 15:20:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:57.372 15:20:55 -- common/autotest_common.sh@1187 -- # local i=0 00:19:57.372 15:20:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:57.372 15:20:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:57.372 15:20:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:59.914 15:20:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:59.914 15:20:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:59.914 15:20:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:59.914 15:20:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:59.914 15:20:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:59.914 15:20:57 -- common/autotest_common.sh@1197 -- # return 0 00:19:59.914 15:20:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.914 15:20:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:00.479 15:20:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:00.479 15:20:58 -- common/autotest_common.sh@1187 -- # local i=0 00:20:00.479 15:20:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:00.479 15:20:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:00.479 15:20:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:02.379 15:21:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:02.379 15:21:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:02.379 15:21:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:02.379 15:21:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:02.379 15:21:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:02.379 15:21:00 -- common/autotest_common.sh@1197 -- # return 0 00:20:02.379 15:21:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:02.379 15:21:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:03.314 15:21:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:03.314 15:21:01 -- common/autotest_common.sh@1187 -- # local i=0 00:20:03.314 15:21:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:03.314 15:21:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:03.314 15:21:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:05.212 15:21:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:05.212 15:21:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:05.212 15:21:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:05.470 15:21:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:05.470 15:21:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:05.470 15:21:03 -- common/autotest_common.sh@1197 -- # return 0 00:20:05.470 15:21:03 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:05.470 [global] 00:20:05.470 thread=1 00:20:05.470 invalidate=1 00:20:05.470 rw=read 00:20:05.470 time_based=1 00:20:05.470 runtime=10 00:20:05.470 ioengine=libaio 00:20:05.470 direct=1 00:20:05.470 bs=262144 00:20:05.470 iodepth=64 00:20:05.470 norandommap=1 00:20:05.470 numjobs=1 00:20:05.470 00:20:05.470 [job0] 00:20:05.470 filename=/dev/nvme0n1 00:20:05.470 [job1] 00:20:05.470 filename=/dev/nvme10n1 00:20:05.470 [job2] 00:20:05.470 filename=/dev/nvme1n1 00:20:05.470 [job3] 00:20:05.470 filename=/dev/nvme2n1 00:20:05.470 [job4] 00:20:05.470 filename=/dev/nvme3n1 00:20:05.470 [job5] 00:20:05.470 filename=/dev/nvme4n1 00:20:05.470 [job6] 00:20:05.470 filename=/dev/nvme5n1 00:20:05.470 [job7] 00:20:05.470 filename=/dev/nvme6n1 00:20:05.470 [job8] 00:20:05.470 filename=/dev/nvme7n1 00:20:05.470 [job9] 00:20:05.470 filename=/dev/nvme8n1 00:20:05.470 [job10] 00:20:05.470 filename=/dev/nvme9n1 00:20:05.470 Could not set queue depth (nvme0n1) 00:20:05.470 Could not set queue depth (nvme10n1) 00:20:05.470 Could not set queue depth (nvme1n1) 00:20:05.470 Could not set queue depth (nvme2n1) 00:20:05.470 Could not set queue depth (nvme3n1) 00:20:05.470 Could not set queue depth (nvme4n1) 00:20:05.470 Could not set queue depth (nvme5n1) 00:20:05.470 Could not set queue depth (nvme6n1) 00:20:05.470 Could not set queue depth (nvme7n1) 00:20:05.470 Could not set queue depth (nvme8n1) 00:20:05.470 Could not set queue depth (nvme9n1) 00:20:05.729 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.729 fio-3.35 00:20:05.729 Starting 11 threads 00:20:17.940 00:20:17.940 job0: (groupid=0, jobs=1): err= 0: pid=2805876: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=829, BW=207MiB/s (217MB/s)(2102MiB/10134msec) 00:20:17.940 slat (usec): min=12, max=157609, avg=1089.53, stdev=4162.10 00:20:17.940 clat (msec): min=6, max=297, avg=75.98, stdev=44.67 00:20:17.940 lat (msec): min=6, max=330, avg=77.07, stdev=45.28 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 16], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 36], 00:20:17.940 | 30.00th=[ 50], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 75], 00:20:17.940 | 70.00th=[ 86], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 161], 00:20:17.940 | 99.00th=[ 234], 99.50th=[ 251], 99.90th=[ 292], 99.95th=[ 292], 00:20:17.940 | 99.99th=[ 296] 00:20:17.940 bw ( KiB/s): min=70656, max=484864, per=10.86%, avg=213555.20, stdev=100318.30, samples=20 00:20:17.940 iops : min= 276, max= 1894, avg=834.20, stdev=391.87, samples=20 00:20:17.940 lat (msec) : 10=0.31%, 20=1.24%, 50=28.91%, 100=48.08%, 250=20.91% 00:20:17.940 lat (msec) : 500=0.55% 00:20:17.940 cpu : usr=0.54%, sys=2.53%, ctx=1471, majf=0, minf=4098 00:20:17.940 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:17.940 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.940 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.940 issued rwts: total=8406,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.940 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.940 job1: (groupid=0, jobs=1): err= 0: pid=2805891: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=1015, BW=254MiB/s (266MB/s)(2576MiB/10146msec) 00:20:17.940 slat (usec): min=9, max=122786, avg=811.44, stdev=2953.79 00:20:17.940 clat (usec): min=900, max=256773, avg=62142.31, stdev=34880.64 00:20:17.940 lat (usec): min=932, max=285342, avg=62953.75, stdev=35291.51 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 27], 20.00th=[ 32], 00:20:17.940 | 30.00th=[ 39], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 68], 00:20:17.940 | 70.00th=[ 78], 80.00th=[ 90], 90.00th=[ 104], 95.00th=[ 114], 00:20:17.940 | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 245], 99.95th=[ 249], 00:20:17.940 | 99.99th=[ 255] 00:20:17.940 bw ( KiB/s): min=137216, max=498688, per=13.33%, avg=262187.05, stdev=91379.73, samples=20 00:20:17.940 iops : min= 536, max= 1948, avg=1024.15, stdev=356.97, samples=20 00:20:17.940 lat (usec) : 1000=0.04% 00:20:17.940 lat (msec) : 2=0.29%, 4=0.95%, 10=1.92%, 20=3.99%, 50=31.32% 00:20:17.940 lat (msec) : 100=48.93%, 250=12.52%, 500=0.04% 00:20:17.940 cpu : usr=0.62%, sys=2.92%, ctx=1888, majf=0, minf=4097 00:20:17.940 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:17.940 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.940 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.940 issued rwts: total=10305,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.940 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.940 job2: (groupid=0, jobs=1): err= 0: pid=2805892: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=582, BW=146MiB/s (153MB/s)(1477MiB/10136msec) 00:20:17.940 slat (usec): min=8, max=137621, avg=1167.48, stdev=6302.43 00:20:17.940 clat (msec): min=2, max=303, avg=108.52, stdev=67.86 00:20:17.940 lat (msec): min=2, max=322, avg=109.69, stdev=68.88 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 13], 20.00th=[ 31], 00:20:17.940 | 30.00th=[ 67], 40.00th=[ 91], 50.00th=[ 112], 60.00th=[ 131], 00:20:17.940 | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 199], 95.00th=[ 211], 00:20:17.940 | 99.00th=[ 253], 99.50th=[ 259], 99.90th=[ 296], 99.95th=[ 296], 00:20:17.940 | 99.99th=[ 305] 00:20:17.940 bw ( KiB/s): min=85504, max=265216, per=7.61%, avg=149606.40, stdev=51240.30, samples=20 00:20:17.940 iops : min= 334, max= 1036, avg=584.40, stdev=200.16, samples=20 00:20:17.940 lat (msec) : 4=1.46%, 10=5.89%, 20=7.87%, 50=10.73%, 100=17.84% 00:20:17.940 lat (msec) : 250=55.15%, 500=1.07% 00:20:17.940 cpu : usr=0.31%, sys=1.82%, ctx=1333, majf=0, minf=4097 00:20:17.940 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:17.940 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.940 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.940 issued rwts: total=5908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.940 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.940 job3: (groupid=0, jobs=1): err= 0: pid=2805893: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=612, BW=153MiB/s (160MB/s)(1550MiB/10129msec) 00:20:17.940 slat (usec): min=9, max=162371, avg=958.58, stdev=5852.11 00:20:17.940 clat (usec): min=1868, max=295619, avg=103482.20, stdev=68294.30 00:20:17.940 lat (usec): min=1913, max=343750, avg=104440.78, stdev=69199.79 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 33], 00:20:17.940 | 30.00th=[ 55], 40.00th=[ 71], 50.00th=[ 88], 60.00th=[ 117], 00:20:17.940 | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 197], 95.00th=[ 222], 00:20:17.940 | 99.00th=[ 251], 99.50th=[ 264], 99.90th=[ 292], 99.95th=[ 296], 00:20:17.940 | 99.99th=[ 296] 00:20:17.940 bw ( KiB/s): min=77312, max=441856, per=7.99%, avg=157132.80, stdev=87262.10, samples=20 00:20:17.940 iops : min= 302, max= 1726, avg=613.80, stdev=340.87, samples=20 00:20:17.940 lat (msec) : 2=0.03%, 4=0.24%, 10=1.42%, 20=9.72%, 50=16.90% 00:20:17.940 lat (msec) : 100=26.27%, 250=44.35%, 500=1.06% 00:20:17.940 cpu : usr=0.30%, sys=1.52%, ctx=1408, majf=0, minf=4098 00:20:17.940 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:17.940 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.940 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.940 issued rwts: total=6201,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.940 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.940 job4: (groupid=0, jobs=1): err= 0: pid=2805894: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=629, BW=157MiB/s (165MB/s)(1597MiB/10139msec) 00:20:17.940 slat (usec): min=9, max=124206, avg=1070.00, stdev=5185.38 00:20:17.940 clat (usec): min=717, max=316532, avg=100439.67, stdev=59412.00 00:20:17.940 lat (usec): min=735, max=317299, avg=101509.67, stdev=60245.48 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 17], 20.00th=[ 48], 00:20:17.940 | 30.00th=[ 67], 40.00th=[ 82], 50.00th=[ 97], 60.00th=[ 109], 00:20:17.940 | 70.00th=[ 124], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 203], 00:20:17.940 | 99.00th=[ 236], 99.50th=[ 245], 99.90th=[ 288], 99.95th=[ 309], 00:20:17.940 | 99.99th=[ 317] 00:20:17.940 bw ( KiB/s): min=84992, max=302592, per=8.23%, avg=161860.15, stdev=56861.00, samples=20 00:20:17.940 iops : min= 332, max= 1182, avg=632.25, stdev=222.11, samples=20 00:20:17.940 lat (usec) : 750=0.02%, 1000=0.05% 00:20:17.940 lat (msec) : 2=0.20%, 4=0.92%, 10=4.27%, 20=6.03%, 50=9.52% 00:20:17.940 lat (msec) : 100=31.77%, 250=46.81%, 500=0.41% 00:20:17.940 cpu : usr=0.26%, sys=1.73%, ctx=1524, majf=0, minf=4097 00:20:17.940 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:17.940 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.940 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.940 issued rwts: total=6386,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.940 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.940 job5: (groupid=0, jobs=1): err= 0: pid=2805895: Tue Nov 19 15:21:14 2024 00:20:17.940 read: IOPS=633, BW=158MiB/s (166MB/s)(1605MiB/10134msec) 00:20:17.940 slat (usec): min=13, max=135361, avg=1441.22, stdev=6585.88 00:20:17.940 clat (msec): min=3, max=311, avg=99.46, stdev=56.55 00:20:17.940 lat (msec): min=3, max=319, avg=100.90, stdev=57.61 00:20:17.940 clat percentiles (msec): 00:20:17.940 | 1.00th=[ 13], 5.00th=[ 29], 10.00th=[ 40], 20.00th=[ 52], 00:20:17.940 | 30.00th=[ 61], 40.00th=[ 71], 50.00th=[ 81], 60.00th=[ 103], 00:20:17.940 | 70.00th=[ 130], 80.00th=[ 157], 90.00th=[ 184], 95.00th=[ 201], 00:20:17.940 | 99.00th=[ 245], 99.50th=[ 268], 99.90th=[ 300], 99.95th=[ 313], 00:20:17.940 | 99.99th=[ 313] 00:20:17.940 bw ( KiB/s): min=69632, max=325632, per=8.27%, avg=162764.80, stdev=80391.45, samples=20 00:20:17.940 iops : min= 272, max= 1272, avg=635.80, stdev=314.03, samples=20 00:20:17.940 lat (msec) : 4=0.02%, 10=0.40%, 20=2.62%, 50=16.29%, 100=39.57% 00:20:17.940 lat (msec) : 250=40.23%, 500=0.87% 00:20:17.941 cpu : usr=0.35%, sys=2.15%, ctx=1097, majf=0, minf=3721 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=6421,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 job6: (groupid=0, jobs=1): err= 0: pid=2805896: Tue Nov 19 15:21:14 2024 00:20:17.941 read: IOPS=634, BW=159MiB/s (166MB/s)(1608MiB/10132msec) 00:20:17.941 slat (usec): min=8, max=106649, avg=1111.20, stdev=4357.44 00:20:17.941 clat (usec): min=1234, max=252813, avg=99595.86, stdev=55142.21 00:20:17.941 lat (usec): min=1258, max=310193, avg=100707.06, stdev=55830.12 00:20:17.941 clat percentiles (msec): 00:20:17.941 | 1.00th=[ 4], 5.00th=[ 23], 10.00th=[ 36], 20.00th=[ 53], 00:20:17.941 | 30.00th=[ 64], 40.00th=[ 80], 50.00th=[ 91], 60.00th=[ 103], 00:20:17.941 | 70.00th=[ 118], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 199], 00:20:17.941 | 99.00th=[ 224], 99.50th=[ 234], 99.90th=[ 251], 99.95th=[ 253], 00:20:17.941 | 99.99th=[ 253] 00:20:17.941 bw ( KiB/s): min=81920, max=304128, per=8.29%, avg=163088.85, stdev=65733.73, samples=20 00:20:17.941 iops : min= 320, max= 1188, avg=637.05, stdev=256.77, samples=20 00:20:17.941 lat (msec) : 2=0.26%, 4=0.76%, 10=1.68%, 20=1.69%, 50=14.38% 00:20:17.941 lat (msec) : 100=39.16%, 250=41.99%, 500=0.08% 00:20:17.941 cpu : usr=0.30%, sys=1.95%, ctx=1326, majf=0, minf=4097 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=6433,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 job7: (groupid=0, jobs=1): err= 0: pid=2805897: Tue Nov 19 15:21:14 2024 00:20:17.941 read: IOPS=577, BW=144MiB/s (151MB/s)(1463MiB/10139msec) 00:20:17.941 slat (usec): min=9, max=113865, avg=1356.86, stdev=6081.72 00:20:17.941 clat (msec): min=2, max=306, avg=109.41, stdev=65.13 00:20:17.941 lat (msec): min=2, max=306, avg=110.77, stdev=66.10 00:20:17.941 clat percentiles (msec): 00:20:17.941 | 1.00th=[ 7], 5.00th=[ 18], 10.00th=[ 28], 20.00th=[ 39], 00:20:17.941 | 30.00th=[ 66], 40.00th=[ 84], 50.00th=[ 104], 60.00th=[ 125], 00:20:17.941 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 199], 95.00th=[ 209], 00:20:17.941 | 99.00th=[ 249], 99.50th=[ 264], 99.90th=[ 296], 99.95th=[ 309], 00:20:17.941 | 99.99th=[ 309] 00:20:17.941 bw ( KiB/s): min=65536, max=357888, per=7.53%, avg=148198.40, stdev=69085.65, samples=20 00:20:17.941 iops : min= 256, max= 1398, avg=578.90, stdev=269.87, samples=20 00:20:17.941 lat (msec) : 4=0.39%, 10=2.15%, 20=3.13%, 50=18.28%, 100=24.68% 00:20:17.941 lat (msec) : 250=50.39%, 500=0.97% 00:20:17.941 cpu : usr=0.38%, sys=1.68%, ctx=1260, majf=0, minf=4097 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=5852,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 job8: (groupid=0, jobs=1): err= 0: pid=2805899: Tue Nov 19 15:21:14 2024 00:20:17.941 read: IOPS=752, BW=188MiB/s (197MB/s)(1890MiB/10054msec) 00:20:17.941 slat (usec): min=9, max=70235, avg=1159.54, stdev=3861.10 00:20:17.941 clat (usec): min=1583, max=276331, avg=83862.76, stdev=50430.08 00:20:17.941 lat (usec): min=1616, max=286564, avg=85022.30, stdev=51071.57 00:20:17.941 clat percentiles (msec): 00:20:17.941 | 1.00th=[ 5], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 40], 00:20:17.941 | 30.00th=[ 54], 40.00th=[ 63], 50.00th=[ 72], 60.00th=[ 82], 00:20:17.941 | 70.00th=[ 96], 80.00th=[ 122], 90.00th=[ 165], 95.00th=[ 192], 00:20:17.941 | 99.00th=[ 226], 99.50th=[ 239], 99.90th=[ 262], 99.95th=[ 268], 00:20:17.941 | 99.99th=[ 275] 00:20:17.941 bw ( KiB/s): min=77312, max=410112, per=9.76%, avg=191936.00, stdev=95909.21, samples=20 00:20:17.941 iops : min= 302, max= 1602, avg=749.75, stdev=374.65, samples=20 00:20:17.941 lat (msec) : 2=0.01%, 4=0.93%, 10=0.98%, 20=0.81%, 50=23.61% 00:20:17.941 lat (msec) : 100=45.15%, 250=28.32%, 500=0.20% 00:20:17.941 cpu : usr=0.39%, sys=2.56%, ctx=1455, majf=0, minf=4097 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=7561,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 job9: (groupid=0, jobs=1): err= 0: pid=2805905: Tue Nov 19 15:21:14 2024 00:20:17.941 read: IOPS=796, BW=199MiB/s (209MB/s)(2002MiB/10053msec) 00:20:17.941 slat (usec): min=10, max=145692, avg=1161.94, stdev=4829.93 00:20:17.941 clat (msec): min=2, max=330, avg=79.10, stdev=54.95 00:20:17.941 lat (msec): min=3, max=330, avg=80.26, stdev=55.82 00:20:17.941 clat percentiles (msec): 00:20:17.941 | 1.00th=[ 17], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 31], 00:20:17.941 | 30.00th=[ 40], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 75], 00:20:17.941 | 70.00th=[ 89], 80.00th=[ 121], 90.00th=[ 178], 95.00th=[ 199], 00:20:17.941 | 99.00th=[ 215], 99.50th=[ 224], 99.90th=[ 279], 99.95th=[ 305], 00:20:17.941 | 99.99th=[ 330] 00:20:17.941 bw ( KiB/s): min=73728, max=541184, per=10.34%, avg=203392.00, stdev=130259.68, samples=20 00:20:17.941 iops : min= 288, max= 2114, avg=794.50, stdev=508.83, samples=20 00:20:17.941 lat (msec) : 4=0.01%, 10=0.41%, 20=0.70%, 50=36.50%, 100=36.81% 00:20:17.941 lat (msec) : 250=25.36%, 500=0.20% 00:20:17.941 cpu : usr=0.34%, sys=2.90%, ctx=1438, majf=0, minf=4097 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=8008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 job10: (groupid=0, jobs=1): err= 0: pid=2805906: Tue Nov 19 15:21:14 2024 00:20:17.941 read: IOPS=644, BW=161MiB/s (169MB/s)(1619MiB/10053msec) 00:20:17.941 slat (usec): min=8, max=177173, avg=979.80, stdev=5125.05 00:20:17.941 clat (usec): min=915, max=355645, avg=98269.60, stdev=59446.39 00:20:17.941 lat (usec): min=942, max=355698, avg=99249.40, stdev=60255.99 00:20:17.941 clat percentiles (msec): 00:20:17.941 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 30], 20.00th=[ 49], 00:20:17.941 | 30.00th=[ 64], 40.00th=[ 72], 50.00th=[ 84], 60.00th=[ 100], 00:20:17.941 | 70.00th=[ 121], 80.00th=[ 161], 90.00th=[ 190], 95.00th=[ 207], 00:20:17.941 | 99.00th=[ 239], 99.50th=[ 247], 99.90th=[ 271], 99.95th=[ 300], 00:20:17.941 | 99.99th=[ 355] 00:20:17.941 bw ( KiB/s): min=74752, max=317952, per=8.35%, avg=164198.40, stdev=60358.68, samples=20 00:20:17.941 iops : min= 292, max= 1242, avg=641.40, stdev=235.78, samples=20 00:20:17.941 lat (usec) : 1000=0.06% 00:20:17.941 lat (msec) : 2=0.12%, 4=1.07%, 10=2.86%, 20=2.58%, 50=13.83% 00:20:17.941 lat (msec) : 100=40.27%, 250=38.77%, 500=0.45% 00:20:17.941 cpu : usr=0.26%, sys=1.76%, ctx=1541, majf=0, minf=4097 00:20:17.941 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:17.941 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.941 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:17.941 issued rwts: total=6477,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.941 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:17.941 00:20:17.941 Run status group 0 (all jobs): 00:20:17.941 READ: bw=1921MiB/s (2014MB/s), 144MiB/s-254MiB/s (151MB/s-266MB/s), io=19.0GiB (20.4GB), run=10053-10146msec 00:20:17.941 00:20:17.941 Disk stats (read/write): 00:20:17.941 nvme0n1: ios=16659/0, merge=0/0, ticks=1230673/0, in_queue=1230673, util=97.10% 00:20:17.941 nvme10n1: ios=20172/0, merge=0/0, ticks=1239900/0, in_queue=1239900, util=97.30% 00:20:17.941 nvme1n1: ios=11577/0, merge=0/0, ticks=1232445/0, in_queue=1232445, util=97.61% 00:20:17.941 nvme2n1: ios=12234/0, merge=0/0, ticks=1236772/0, in_queue=1236772, util=97.77% 00:20:17.941 nvme3n1: ios=12584/0, merge=0/0, ticks=1233283/0, in_queue=1233283, util=97.83% 00:20:17.941 nvme4n1: ios=12696/0, merge=0/0, ticks=1229595/0, in_queue=1229595, util=98.19% 00:20:17.941 nvme5n1: ios=12459/0, merge=0/0, ticks=1238277/0, in_queue=1238277, util=98.33% 00:20:17.941 nvme6n1: ios=11517/0, merge=0/0, ticks=1229742/0, in_queue=1229742, util=98.49% 00:20:17.941 nvme7n1: ios=14860/0, merge=0/0, ticks=1233789/0, in_queue=1233789, util=98.90% 00:20:17.941 nvme8n1: ios=15782/0, merge=0/0, ticks=1231798/0, in_queue=1231798, util=99.11% 00:20:17.941 nvme9n1: ios=12713/0, merge=0/0, ticks=1237128/0, in_queue=1237128, util=99.23% 00:20:17.941 15:21:14 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:17.941 [global] 00:20:17.941 thread=1 00:20:17.941 invalidate=1 00:20:17.941 rw=randwrite 00:20:17.941 time_based=1 00:20:17.941 runtime=10 00:20:17.941 ioengine=libaio 00:20:17.941 direct=1 00:20:17.941 bs=262144 00:20:17.941 iodepth=64 00:20:17.941 norandommap=1 00:20:17.941 numjobs=1 00:20:17.941 00:20:17.941 [job0] 00:20:17.941 filename=/dev/nvme0n1 00:20:17.941 [job1] 00:20:17.941 filename=/dev/nvme10n1 00:20:17.941 [job2] 00:20:17.941 filename=/dev/nvme1n1 00:20:17.941 [job3] 00:20:17.941 filename=/dev/nvme2n1 00:20:17.941 [job4] 00:20:17.941 filename=/dev/nvme3n1 00:20:17.941 [job5] 00:20:17.941 filename=/dev/nvme4n1 00:20:17.941 [job6] 00:20:17.941 filename=/dev/nvme5n1 00:20:17.941 [job7] 00:20:17.941 filename=/dev/nvme6n1 00:20:17.941 [job8] 00:20:17.941 filename=/dev/nvme7n1 00:20:17.941 [job9] 00:20:17.941 filename=/dev/nvme8n1 00:20:17.941 [job10] 00:20:17.941 filename=/dev/nvme9n1 00:20:17.941 Could not set queue depth (nvme0n1) 00:20:17.941 Could not set queue depth (nvme10n1) 00:20:17.941 Could not set queue depth (nvme1n1) 00:20:17.941 Could not set queue depth (nvme2n1) 00:20:17.941 Could not set queue depth (nvme3n1) 00:20:17.941 Could not set queue depth (nvme4n1) 00:20:17.941 Could not set queue depth (nvme5n1) 00:20:17.942 Could not set queue depth (nvme6n1) 00:20:17.942 Could not set queue depth (nvme7n1) 00:20:17.942 Could not set queue depth (nvme8n1) 00:20:17.942 Could not set queue depth (nvme9n1) 00:20:17.942 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:17.942 fio-3.35 00:20:17.942 Starting 11 threads 00:20:27.922 00:20:27.922 job0: (groupid=0, jobs=1): err= 0: pid=2807456: Tue Nov 19 15:21:25 2024 00:20:27.922 write: IOPS=429, BW=107MiB/s (113MB/s)(1093MiB/10189msec); 0 zone resets 00:20:27.922 slat (usec): min=17, max=62195, avg=1918.01, stdev=4424.34 00:20:27.922 clat (usec): min=951, max=432881, avg=147124.11, stdev=67575.65 00:20:27.922 lat (usec): min=981, max=432922, avg=149042.13, stdev=68410.26 00:20:27.922 clat percentiles (msec): 00:20:27.922 | 1.00th=[ 5], 5.00th=[ 26], 10.00th=[ 83], 20.00th=[ 97], 00:20:27.922 | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 140], 60.00th=[ 157], 00:20:27.922 | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 239], 95.00th=[ 264], 00:20:27.922 | 99.00th=[ 317], 99.50th=[ 388], 99.90th=[ 430], 99.95th=[ 430], 00:20:27.922 | 99.99th=[ 435] 00:20:27.922 bw ( KiB/s): min=53248, max=163840, per=7.70%, avg=110326.45, stdev=32478.97, samples=20 00:20:27.922 iops : min= 208, max= 640, avg=430.95, stdev=126.88, samples=20 00:20:27.922 lat (usec) : 1000=0.05% 00:20:27.922 lat (msec) : 2=0.25%, 4=0.43%, 10=2.08%, 20=1.83%, 50=2.56% 00:20:27.922 lat (msec) : 100=14.70%, 250=70.32%, 500=7.77% 00:20:27.922 cpu : usr=1.29%, sys=1.29%, ctx=1851, majf=0, minf=1 00:20:27.922 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:27.922 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.922 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.922 issued rwts: total=0,4373,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.922 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.922 job1: (groupid=0, jobs=1): err= 0: pid=2807465: Tue Nov 19 15:21:25 2024 00:20:27.922 write: IOPS=444, BW=111MiB/s (117MB/s)(1132MiB/10181msec); 0 zone resets 00:20:27.922 slat (usec): min=23, max=73584, avg=1696.72, stdev=4681.57 00:20:27.922 clat (usec): min=949, max=452975, avg=142081.04, stdev=80758.08 00:20:27.922 lat (usec): min=995, max=453010, avg=143777.76, stdev=81826.39 00:20:27.922 clat percentiles (msec): 00:20:27.922 | 1.00th=[ 8], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 64], 00:20:27.922 | 30.00th=[ 102], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 165], 00:20:27.922 | 70.00th=[ 184], 80.00th=[ 207], 90.00th=[ 247], 95.00th=[ 275], 00:20:27.922 | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 435], 99.95th=[ 435], 00:20:27.922 | 99.99th=[ 451] 00:20:27.922 bw ( KiB/s): min=57856, max=232448, per=7.98%, avg=114330.25, stdev=46260.21, samples=20 00:20:27.922 iops : min= 226, max= 908, avg=446.55, stdev=180.73, samples=20 00:20:27.922 lat (usec) : 1000=0.02% 00:20:27.922 lat (msec) : 2=0.07%, 4=0.35%, 10=1.57%, 20=4.99%, 50=9.96% 00:20:27.922 lat (msec) : 100=12.72%, 250=61.14%, 500=9.19% 00:20:27.922 cpu : usr=1.39%, sys=1.43%, ctx=2460, majf=0, minf=1 00:20:27.922 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:27.922 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.922 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.922 issued rwts: total=0,4529,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.922 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.922 job2: (groupid=0, jobs=1): err= 0: pid=2807471: Tue Nov 19 15:21:25 2024 00:20:27.922 write: IOPS=463, BW=116MiB/s (121MB/s)(1171MiB/10110msec); 0 zone resets 00:20:27.922 slat (usec): min=19, max=175454, avg=1716.29, stdev=5540.89 00:20:27.922 clat (msec): min=3, max=439, avg=136.36, stdev=70.53 00:20:27.922 lat (msec): min=5, max=439, avg=138.08, stdev=71.47 00:20:27.922 clat percentiles (msec): 00:20:27.922 | 1.00th=[ 17], 5.00th=[ 32], 10.00th=[ 54], 20.00th=[ 79], 00:20:27.922 | 30.00th=[ 106], 40.00th=[ 121], 50.00th=[ 132], 60.00th=[ 146], 00:20:27.922 | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 209], 95.00th=[ 255], 00:20:27.922 | 99.00th=[ 388], 99.50th=[ 401], 99.90th=[ 422], 99.95th=[ 422], 00:20:27.922 | 99.99th=[ 439] 00:20:27.922 bw ( KiB/s): min=40448, max=208384, per=8.25%, avg=118233.85, stdev=39164.94, samples=20 00:20:27.922 iops : min= 158, max= 814, avg=461.85, stdev=152.99, samples=20 00:20:27.922 lat (msec) : 4=0.04%, 10=0.23%, 20=1.82%, 50=6.96%, 100=19.33% 00:20:27.922 lat (msec) : 250=66.45%, 500=5.17% 00:20:27.922 cpu : usr=1.36%, sys=1.50%, ctx=2087, majf=0, minf=1 00:20:27.922 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:27.922 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.922 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.922 issued rwts: total=0,4682,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.922 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.922 job3: (groupid=0, jobs=1): err= 0: pid=2807472: Tue Nov 19 15:21:25 2024 00:20:27.922 write: IOPS=462, BW=116MiB/s (121MB/s)(1179MiB/10189msec); 0 zone resets 00:20:27.922 slat (usec): min=17, max=81784, avg=1689.53, stdev=4390.01 00:20:27.922 clat (usec): min=1225, max=487234, avg=136516.73, stdev=71618.54 00:20:27.922 lat (usec): min=1313, max=487266, avg=138206.26, stdev=72465.79 00:20:27.922 clat percentiles (msec): 00:20:27.922 | 1.00th=[ 17], 5.00th=[ 38], 10.00th=[ 48], 20.00th=[ 78], 00:20:27.923 | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 142], 00:20:27.923 | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 232], 95.00th=[ 279], 00:20:27.923 | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 472], 99.95th=[ 472], 00:20:27.923 | 99.99th=[ 489] 00:20:27.923 bw ( KiB/s): min=55808, max=269824, per=8.31%, avg=119109.40, stdev=47400.06, samples=20 00:20:27.923 iops : min= 218, max= 1054, avg=465.25, stdev=185.18, samples=20 00:20:27.923 lat (msec) : 2=0.08%, 4=0.02%, 10=0.32%, 20=1.21%, 50=11.22% 00:20:27.923 lat (msec) : 100=15.48%, 250=64.50%, 500=7.17% 00:20:27.923 cpu : usr=1.56%, sys=1.53%, ctx=2160, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,4716,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job4: (groupid=0, jobs=1): err= 0: pid=2807473: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=370, BW=92.7MiB/s (97.2MB/s)(935MiB/10083msec); 0 zone resets 00:20:27.923 slat (usec): min=24, max=93778, avg=2404.41, stdev=5487.38 00:20:27.923 clat (usec): min=921, max=430733, avg=170065.07, stdev=72357.69 00:20:27.923 lat (usec): min=967, max=430773, avg=172469.49, stdev=73382.18 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 6], 5.00th=[ 60], 10.00th=[ 80], 20.00th=[ 108], 00:20:27.923 | 30.00th=[ 138], 40.00th=[ 155], 50.00th=[ 169], 60.00th=[ 180], 00:20:27.923 | 70.00th=[ 203], 80.00th=[ 224], 90.00th=[ 257], 95.00th=[ 296], 00:20:27.923 | 99.00th=[ 405], 99.50th=[ 414], 99.90th=[ 426], 99.95th=[ 430], 00:20:27.923 | 99.99th=[ 430] 00:20:27.923 bw ( KiB/s): min=38912, max=206435, per=6.57%, avg=94110.55, stdev=38990.64, samples=20 00:20:27.923 iops : min= 152, max= 806, avg=367.60, stdev=152.25, samples=20 00:20:27.923 lat (usec) : 1000=0.05% 00:20:27.923 lat (msec) : 2=0.24%, 4=0.43%, 10=0.43%, 20=0.51%, 50=2.51% 00:20:27.923 lat (msec) : 100=14.17%, 250=70.78%, 500=10.88% 00:20:27.923 cpu : usr=0.99%, sys=1.32%, ctx=1378, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,3740,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job5: (groupid=0, jobs=1): err= 0: pid=2807476: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=548, BW=137MiB/s (144MB/s)(1387MiB/10109msec); 0 zone resets 00:20:27.923 slat (usec): min=24, max=101394, avg=1383.89, stdev=3812.13 00:20:27.923 clat (usec): min=1302, max=430530, avg=114884.88, stdev=71329.48 00:20:27.923 lat (usec): min=1390, max=432976, avg=116268.77, stdev=72203.53 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 8], 5.00th=[ 18], 10.00th=[ 29], 20.00th=[ 48], 00:20:27.923 | 30.00th=[ 59], 40.00th=[ 89], 50.00th=[ 114], 60.00th=[ 127], 00:20:27.923 | 70.00th=[ 148], 80.00th=[ 182], 90.00th=[ 209], 95.00th=[ 234], 00:20:27.923 | 99.00th=[ 317], 99.50th=[ 368], 99.90th=[ 401], 99.95th=[ 422], 00:20:27.923 | 99.99th=[ 430] 00:20:27.923 bw ( KiB/s): min=50789, max=318976, per=9.80%, avg=140434.25, stdev=65823.01, samples=20 00:20:27.923 iops : min= 198, max= 1246, avg=548.55, stdev=257.15, samples=20 00:20:27.923 lat (msec) : 2=0.16%, 4=0.23%, 10=1.62%, 20=4.29%, 50=15.73% 00:20:27.923 lat (msec) : 100=22.09%, 250=52.17%, 500=3.69% 00:20:27.923 cpu : usr=1.72%, sys=2.02%, ctx=2723, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,5549,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job6: (groupid=0, jobs=1): err= 0: pid=2807477: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=588, BW=147MiB/s (154MB/s)(1483MiB/10081msec); 0 zone resets 00:20:27.923 slat (usec): min=16, max=64693, avg=1008.88, stdev=3257.57 00:20:27.923 clat (usec): min=933, max=322807, avg=107708.70, stdev=72425.47 00:20:27.923 lat (usec): min=977, max=322876, avg=108717.58, stdev=73178.42 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 17], 20.00th=[ 33], 00:20:27.923 | 30.00th=[ 59], 40.00th=[ 80], 50.00th=[ 100], 60.00th=[ 120], 00:20:27.923 | 70.00th=[ 144], 80.00th=[ 186], 90.00th=[ 211], 95.00th=[ 228], 00:20:27.923 | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 317], 00:20:27.923 | 99.99th=[ 321] 00:20:27.923 bw ( KiB/s): min=77824, max=387584, per=10.48%, avg=150175.75, stdev=66765.46, samples=20 00:20:27.923 iops : min= 304, max= 1514, avg=586.60, stdev=260.79, samples=20 00:20:27.923 lat (usec) : 1000=0.02% 00:20:27.923 lat (msec) : 2=0.30%, 4=0.94%, 10=4.35%, 20=6.56%, 50=15.50% 00:20:27.923 lat (msec) : 100=22.73%, 250=46.80%, 500=2.80% 00:20:27.923 cpu : usr=1.71%, sys=2.08%, ctx=3740, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,5930,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job7: (groupid=0, jobs=1): err= 0: pid=2807478: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=465, BW=116MiB/s (122MB/s)(1176MiB/10117msec); 0 zone resets 00:20:27.923 slat (usec): min=21, max=76142, avg=1880.20, stdev=5141.33 00:20:27.923 clat (usec): min=1055, max=443866, avg=135669.48, stdev=96338.88 00:20:27.923 lat (usec): min=1155, max=443913, avg=137549.68, stdev=97748.07 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 20], 20.00th=[ 41], 00:20:27.923 | 30.00th=[ 51], 40.00th=[ 91], 50.00th=[ 133], 60.00th=[ 161], 00:20:27.923 | 70.00th=[ 197], 80.00th=[ 230], 90.00th=[ 259], 95.00th=[ 292], 00:20:27.923 | 99.00th=[ 388], 99.50th=[ 422], 99.90th=[ 439], 99.95th=[ 443], 00:20:27.923 | 99.99th=[ 443] 00:20:27.923 bw ( KiB/s): min=38912, max=345088, per=8.29%, avg=118820.80, stdev=75978.30, samples=20 00:20:27.923 iops : min= 152, max= 1348, avg=464.10, stdev=296.78, samples=20 00:20:27.923 lat (msec) : 2=0.09%, 4=0.38%, 10=2.83%, 20=7.23%, 50=18.75% 00:20:27.923 lat (msec) : 100=12.41%, 250=47.01%, 500=11.31% 00:20:27.923 cpu : usr=1.44%, sys=1.64%, ctx=2160, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,4705,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job8: (groupid=0, jobs=1): err= 0: pid=2807480: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=667, BW=167MiB/s (175MB/s)(1686MiB/10109msec); 0 zone resets 00:20:27.923 slat (usec): min=18, max=199321, avg=1137.58, stdev=3805.89 00:20:27.923 clat (usec): min=933, max=483577, avg=94731.46, stdev=56256.67 00:20:27.923 lat (usec): min=1016, max=483621, avg=95869.05, stdev=56684.44 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 6], 5.00th=[ 29], 10.00th=[ 39], 20.00th=[ 44], 00:20:27.923 | 30.00th=[ 61], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 102], 00:20:27.923 | 70.00th=[ 118], 80.00th=[ 138], 90.00th=[ 169], 95.00th=[ 190], 00:20:27.923 | 99.00th=[ 262], 99.50th=[ 338], 99.90th=[ 472], 99.95th=[ 481], 00:20:27.923 | 99.99th=[ 485] 00:20:27.923 bw ( KiB/s): min=84992, max=351232, per=11.94%, avg=170995.65, stdev=78413.89, samples=20 00:20:27.923 iops : min= 332, max= 1372, avg=667.95, stdev=306.31, samples=20 00:20:27.923 lat (usec) : 1000=0.04% 00:20:27.923 lat (msec) : 2=0.25%, 4=0.40%, 10=0.70%, 20=1.05%, 50=22.69% 00:20:27.923 lat (msec) : 100=33.99%, 250=39.74%, 500=1.13% 00:20:27.923 cpu : usr=2.14%, sys=1.86%, ctx=2980, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,6743,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job9: (groupid=0, jobs=1): err= 0: pid=2807481: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=737, BW=184MiB/s (193MB/s)(1876MiB/10182msec); 0 zone resets 00:20:27.923 slat (usec): min=15, max=169966, avg=709.28, stdev=3320.79 00:20:27.923 clat (usec): min=774, max=458279, avg=86070.94, stdev=74450.70 00:20:27.923 lat (usec): min=802, max=543075, avg=86780.22, stdev=75191.76 00:20:27.923 clat percentiles (usec): 00:20:27.923 | 1.00th=[ 1909], 5.00th=[ 5932], 10.00th=[ 11731], 20.00th=[ 28967], 00:20:27.923 | 30.00th=[ 40633], 40.00th=[ 45876], 50.00th=[ 63701], 60.00th=[ 79168], 00:20:27.923 | 70.00th=[112722], 80.00th=[137364], 90.00th=[185598], 95.00th=[231736], 00:20:27.923 | 99.00th=[341836], 99.50th=[400557], 99.90th=[438305], 99.95th=[446694], 00:20:27.923 | 99.99th=[459277] 00:20:27.923 bw ( KiB/s): min=61440, max=367104, per=13.30%, avg=190530.00, stdev=90111.92, samples=20 00:20:27.923 iops : min= 240, max= 1434, avg=744.25, stdev=351.99, samples=20 00:20:27.923 lat (usec) : 1000=0.08% 00:20:27.923 lat (msec) : 2=1.08%, 4=2.01%, 10=5.26%, 20=6.48%, 50=28.27% 00:20:27.923 lat (msec) : 100=23.82%, 250=29.75%, 500=3.24% 00:20:27.923 cpu : usr=2.23%, sys=2.44%, ctx=5103, majf=0, minf=1 00:20:27.923 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:27.923 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.923 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.923 issued rwts: total=0,7505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.923 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.923 job10: (groupid=0, jobs=1): err= 0: pid=2807482: Tue Nov 19 15:21:25 2024 00:20:27.923 write: IOPS=445, BW=111MiB/s (117MB/s)(1136MiB/10189msec); 0 zone resets 00:20:27.923 slat (usec): min=23, max=53293, avg=1796.88, stdev=4315.10 00:20:27.923 clat (msec): min=6, max=533, avg=141.58, stdev=66.43 00:20:27.923 lat (msec): min=6, max=533, avg=143.37, stdev=67.20 00:20:27.923 clat percentiles (msec): 00:20:27.923 | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 71], 20.00th=[ 93], 00:20:27.924 | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 125], 60.00th=[ 142], 00:20:27.924 | 70.00th=[ 161], 80.00th=[ 203], 90.00th=[ 234], 95.00th=[ 257], 00:20:27.924 | 99.00th=[ 347], 99.50th=[ 439], 99.90th=[ 518], 99.95th=[ 518], 00:20:27.924 | 99.99th=[ 535] 00:20:27.924 bw ( KiB/s): min=49564, max=225280, per=8.01%, avg=114718.50, stdev=41087.93, samples=20 00:20:27.924 iops : min= 193, max= 880, avg=448.05, stdev=160.57, samples=20 00:20:27.924 lat (msec) : 10=0.11%, 20=0.55%, 50=1.54%, 100=26.83%, 250=64.50% 00:20:27.924 lat (msec) : 500=6.25%, 750=0.22% 00:20:27.924 cpu : usr=1.39%, sys=1.63%, ctx=1884, majf=0, minf=1 00:20:27.924 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:27.924 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.924 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:27.924 issued rwts: total=0,4544,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.924 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:27.924 00:20:27.924 Run status group 0 (all jobs): 00:20:27.924 WRITE: bw=1399MiB/s (1467MB/s), 92.7MiB/s-184MiB/s (97.2MB/s-193MB/s), io=13.9GiB (14.9GB), run=10081-10189msec 00:20:27.924 00:20:27.924 Disk stats (read/write): 00:20:27.924 nvme0n1: ios=49/8730, merge=0/0, ticks=30/1240557, in_queue=1240587, util=97.33% 00:20:27.924 nvme10n1: ios=44/9047, merge=0/0, ticks=844/1240466, in_queue=1241310, util=100.00% 00:20:27.924 nvme1n1: ios=49/9157, merge=0/0, ticks=3637/1183788, in_queue=1187425, util=100.00% 00:20:27.924 nvme2n1: ios=0/9417, merge=0/0, ticks=0/1243152, in_queue=1243152, util=97.82% 00:20:27.924 nvme3n1: ios=48/7254, merge=0/0, ticks=636/1213042, in_queue=1213678, util=100.00% 00:20:27.924 nvme4n1: ios=47/10892, merge=0/0, ticks=523/1213381, in_queue=1213904, util=100.00% 00:20:27.924 nvme5n1: ios=37/11639, merge=0/0, ticks=310/1227693, in_queue=1228003, util=100.00% 00:20:27.924 nvme6n1: ios=16/9027, merge=0/0, ticks=1395/1201435, in_queue=1202830, util=100.00% 00:20:27.924 nvme7n1: ios=44/13281, merge=0/0, ticks=3331/1195462, in_queue=1198793, util=100.00% 00:20:27.924 nvme8n1: ios=0/15003, merge=0/0, ticks=0/1255724, in_queue=1255724, util=99.05% 00:20:27.924 nvme9n1: ios=42/9073, merge=0/0, ticks=344/1241548, in_queue=1241892, util=100.00% 00:20:27.924 15:21:25 -- target/multiconnection.sh@36 -- # sync 00:20:27.924 15:21:25 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:27.924 15:21:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:27.924 15:21:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:27.924 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:27.924 15:21:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:27.924 15:21:25 -- common/autotest_common.sh@1208 -- # local i=0 00:20:27.924 15:21:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:27.924 15:21:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:27.924 15:21:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:27.924 15:21:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:27.924 15:21:25 -- common/autotest_common.sh@1220 -- # return 0 00:20:27.924 15:21:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:27.924 15:21:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.924 15:21:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.924 15:21:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.924 15:21:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:27.924 15:21:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:27.924 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:27.924 15:21:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:27.924 15:21:26 -- common/autotest_common.sh@1208 -- # local i=0 00:20:27.924 15:21:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:27.924 15:21:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:27.924 15:21:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:27.924 15:21:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:27.924 15:21:26 -- common/autotest_common.sh@1220 -- # return 0 00:20:27.924 15:21:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:27.924 15:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.924 15:21:26 -- common/autotest_common.sh@10 -- # set +x 00:20:27.924 15:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.924 15:21:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:27.924 15:21:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:28.182 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:28.182 15:21:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:28.182 15:21:26 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.182 15:21:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.182 15:21:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:28.182 15:21:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.182 15:21:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:28.182 15:21:26 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.182 15:21:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:28.182 15:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.182 15:21:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.182 15:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.182 15:21:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.182 15:21:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:28.441 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:28.441 15:21:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:28.441 15:21:26 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.441 15:21:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.441 15:21:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:28.441 15:21:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.441 15:21:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:28.441 15:21:26 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.441 15:21:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:28.441 15:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.441 15:21:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.441 15:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.441 15:21:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.441 15:21:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:28.699 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:28.699 15:21:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:28.699 15:21:27 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.699 15:21:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.699 15:21:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:28.699 15:21:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.699 15:21:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:28.699 15:21:27 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.699 15:21:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:28.699 15:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.699 15:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:28.699 15:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.699 15:21:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.699 15:21:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:28.958 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:28.958 15:21:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:28.958 15:21:27 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.958 15:21:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.958 15:21:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:28.958 15:21:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:28.958 15:21:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:28.958 15:21:27 -- common/autotest_common.sh@1220 -- # return 0 00:20:28.958 15:21:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:28.958 15:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:28.958 15:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:28.958 15:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:28.958 15:21:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.958 15:21:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:28.958 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:28.958 15:21:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:28.958 15:21:27 -- common/autotest_common.sh@1208 -- # local i=0 00:20:28.958 15:21:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:28.958 15:21:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:29.217 15:21:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.217 15:21:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:29.217 15:21:27 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.217 15:21:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:29.217 15:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.217 15:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.217 15:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.217 15:21:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.217 15:21:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:29.217 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:29.217 15:21:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:29.217 15:21:27 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.217 15:21:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.217 15:21:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:29.217 15:21:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.217 15:21:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:29.217 15:21:27 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.217 15:21:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:29.217 15:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.217 15:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.217 15:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.217 15:21:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.217 15:21:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:29.476 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:29.476 15:21:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:29.476 15:21:27 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.476 15:21:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.476 15:21:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:29.476 15:21:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.476 15:21:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:29.476 15:21:27 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.476 15:21:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:29.476 15:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.476 15:21:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.476 15:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.476 15:21:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.476 15:21:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:29.476 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:29.476 15:21:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:29.476 15:21:28 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.476 15:21:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.476 15:21:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:29.734 15:21:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.735 15:21:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:29.735 15:21:28 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.735 15:21:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:29.735 15:21:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.735 15:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:29.735 15:21:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.735 15:21:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.735 15:21:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:29.735 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:29.735 15:21:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:29.735 15:21:28 -- common/autotest_common.sh@1208 -- # local i=0 00:20:29.735 15:21:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:29.735 15:21:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:29.735 15:21:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:29.735 15:21:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:29.735 15:21:28 -- common/autotest_common.sh@1220 -- # return 0 00:20:29.735 15:21:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:29.735 15:21:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.735 15:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:29.735 15:21:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.735 15:21:28 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:29.735 15:21:28 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:29.735 15:21:28 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:29.735 15:21:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:29.735 15:21:28 -- nvmf/common.sh@116 -- # sync 00:20:29.735 15:21:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:29.735 15:21:28 -- nvmf/common.sh@119 -- # set +e 00:20:29.735 15:21:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:29.735 15:21:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:29.735 rmmod nvme_tcp 00:20:29.735 rmmod nvme_fabrics 00:20:29.735 rmmod nvme_keyring 00:20:29.735 15:21:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:29.735 15:21:28 -- nvmf/common.sh@123 -- # set -e 00:20:29.735 15:21:28 -- nvmf/common.sh@124 -- # return 0 00:20:29.735 15:21:28 -- nvmf/common.sh@477 -- # '[' -n 2801262 ']' 00:20:29.735 15:21:28 -- nvmf/common.sh@478 -- # killprocess 2801262 00:20:29.735 15:21:28 -- common/autotest_common.sh@936 -- # '[' -z 2801262 ']' 00:20:29.735 15:21:28 -- common/autotest_common.sh@940 -- # kill -0 2801262 00:20:29.735 15:21:28 -- common/autotest_common.sh@941 -- # uname 00:20:29.735 15:21:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:29.735 15:21:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2801262 00:20:29.735 15:21:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:29.735 15:21:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:29.735 15:21:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2801262' 00:20:29.735 killing process with pid 2801262 00:20:29.735 15:21:28 -- common/autotest_common.sh@955 -- # kill 2801262 00:20:29.735 15:21:28 -- common/autotest_common.sh@960 -- # wait 2801262 00:20:30.301 15:21:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:30.301 15:21:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:30.301 15:21:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:30.301 15:21:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:30.301 15:21:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:30.301 15:21:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:30.301 15:21:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:30.301 15:21:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:32.833 15:21:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:32.833 00:20:32.833 real 1m1.348s 00:20:32.833 user 3m24.813s 00:20:32.833 sys 0m25.412s 00:20:32.833 15:21:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:32.833 15:21:30 -- common/autotest_common.sh@10 -- # set +x 00:20:32.833 ************************************ 00:20:32.833 END TEST nvmf_multiconnection 00:20:32.833 ************************************ 00:20:32.833 15:21:30 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:32.833 15:21:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:32.833 15:21:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:32.833 15:21:30 -- common/autotest_common.sh@10 -- # set +x 00:20:32.833 ************************************ 00:20:32.833 START TEST nvmf_initiator_timeout 00:20:32.833 ************************************ 00:20:32.833 15:21:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:32.833 * Looking for test storage... 00:20:32.833 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:32.833 15:21:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:32.833 15:21:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:32.834 15:21:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:32.834 15:21:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:32.834 15:21:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:32.834 15:21:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:32.834 15:21:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:32.834 15:21:31 -- scripts/common.sh@335 -- # IFS=.-: 00:20:32.834 15:21:31 -- scripts/common.sh@335 -- # read -ra ver1 00:20:32.834 15:21:31 -- scripts/common.sh@336 -- # IFS=.-: 00:20:32.834 15:21:31 -- scripts/common.sh@336 -- # read -ra ver2 00:20:32.834 15:21:31 -- scripts/common.sh@337 -- # local 'op=<' 00:20:32.834 15:21:31 -- scripts/common.sh@339 -- # ver1_l=2 00:20:32.834 15:21:31 -- scripts/common.sh@340 -- # ver2_l=1 00:20:32.834 15:21:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:32.834 15:21:31 -- scripts/common.sh@343 -- # case "$op" in 00:20:32.834 15:21:31 -- scripts/common.sh@344 -- # : 1 00:20:32.834 15:21:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:32.834 15:21:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:32.834 15:21:31 -- scripts/common.sh@364 -- # decimal 1 00:20:32.834 15:21:31 -- scripts/common.sh@352 -- # local d=1 00:20:32.834 15:21:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:32.834 15:21:31 -- scripts/common.sh@354 -- # echo 1 00:20:32.834 15:21:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:32.834 15:21:31 -- scripts/common.sh@365 -- # decimal 2 00:20:32.834 15:21:31 -- scripts/common.sh@352 -- # local d=2 00:20:32.834 15:21:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:32.834 15:21:31 -- scripts/common.sh@354 -- # echo 2 00:20:32.834 15:21:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:32.834 15:21:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:32.834 15:21:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:32.834 15:21:31 -- scripts/common.sh@367 -- # return 0 00:20:32.834 15:21:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:32.834 15:21:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:32.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:32.834 --rc genhtml_branch_coverage=1 00:20:32.834 --rc genhtml_function_coverage=1 00:20:32.834 --rc genhtml_legend=1 00:20:32.834 --rc geninfo_all_blocks=1 00:20:32.834 --rc geninfo_unexecuted_blocks=1 00:20:32.834 00:20:32.834 ' 00:20:32.834 15:21:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:32.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:32.834 --rc genhtml_branch_coverage=1 00:20:32.834 --rc genhtml_function_coverage=1 00:20:32.834 --rc genhtml_legend=1 00:20:32.834 --rc geninfo_all_blocks=1 00:20:32.834 --rc geninfo_unexecuted_blocks=1 00:20:32.834 00:20:32.834 ' 00:20:32.834 15:21:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:32.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:32.834 --rc genhtml_branch_coverage=1 00:20:32.834 --rc genhtml_function_coverage=1 00:20:32.834 --rc genhtml_legend=1 00:20:32.834 --rc geninfo_all_blocks=1 00:20:32.834 --rc geninfo_unexecuted_blocks=1 00:20:32.834 00:20:32.834 ' 00:20:32.834 15:21:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:32.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:32.834 --rc genhtml_branch_coverage=1 00:20:32.834 --rc genhtml_function_coverage=1 00:20:32.834 --rc genhtml_legend=1 00:20:32.834 --rc geninfo_all_blocks=1 00:20:32.834 --rc geninfo_unexecuted_blocks=1 00:20:32.834 00:20:32.834 ' 00:20:32.834 15:21:31 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:32.834 15:21:31 -- nvmf/common.sh@7 -- # uname -s 00:20:32.834 15:21:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:32.834 15:21:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:32.834 15:21:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:32.834 15:21:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:32.834 15:21:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:32.834 15:21:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:32.834 15:21:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:32.834 15:21:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:32.834 15:21:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:32.834 15:21:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:32.834 15:21:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:32.834 15:21:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:32.834 15:21:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:32.834 15:21:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:32.834 15:21:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:32.834 15:21:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:32.834 15:21:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:32.834 15:21:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:32.834 15:21:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:32.834 15:21:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.834 15:21:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.834 15:21:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.834 15:21:31 -- paths/export.sh@5 -- # export PATH 00:20:32.834 15:21:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.834 15:21:31 -- nvmf/common.sh@46 -- # : 0 00:20:32.834 15:21:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:32.834 15:21:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:32.834 15:21:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:32.834 15:21:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:32.834 15:21:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:32.834 15:21:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:32.834 15:21:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:32.834 15:21:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:32.834 15:21:31 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:32.834 15:21:31 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:32.834 15:21:31 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:32.834 15:21:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:32.834 15:21:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:32.834 15:21:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:32.834 15:21:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:32.834 15:21:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:32.834 15:21:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:32.834 15:21:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:32.834 15:21:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:32.835 15:21:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:32.835 15:21:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:32.835 15:21:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:32.835 15:21:31 -- common/autotest_common.sh@10 -- # set +x 00:20:34.738 15:21:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:34.738 15:21:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:34.738 15:21:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:34.738 15:21:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:34.738 15:21:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:34.738 15:21:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:34.738 15:21:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:34.738 15:21:33 -- nvmf/common.sh@294 -- # net_devs=() 00:20:34.738 15:21:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:34.738 15:21:33 -- nvmf/common.sh@295 -- # e810=() 00:20:34.738 15:21:33 -- nvmf/common.sh@295 -- # local -ga e810 00:20:34.738 15:21:33 -- nvmf/common.sh@296 -- # x722=() 00:20:34.738 15:21:33 -- nvmf/common.sh@296 -- # local -ga x722 00:20:34.738 15:21:33 -- nvmf/common.sh@297 -- # mlx=() 00:20:34.738 15:21:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:34.738 15:21:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:34.738 15:21:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:34.738 15:21:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:34.738 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:34.738 15:21:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:34.738 15:21:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:34.738 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:34.738 15:21:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:34.738 15:21:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:34.738 15:21:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:34.738 15:21:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:34.738 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:34.738 15:21:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:34.738 15:21:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:34.738 15:21:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:34.738 15:21:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:34.738 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:34.738 15:21:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:34.738 15:21:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:34.738 15:21:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:34.738 15:21:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:34.738 15:21:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:34.738 15:21:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:34.738 15:21:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:34.738 15:21:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:34.738 15:21:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:34.738 15:21:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:34.738 15:21:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:34.738 15:21:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:34.738 15:21:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:34.738 15:21:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:34.738 15:21:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:34.738 15:21:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:34.738 15:21:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:34.738 15:21:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:34.738 15:21:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:34.738 15:21:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:34.738 15:21:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:34.738 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:34.738 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.169 ms 00:20:34.738 00:20:34.738 --- 10.0.0.2 ping statistics --- 00:20:34.738 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:34.738 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:20:34.738 15:21:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:34.738 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:34.738 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:20:34.738 00:20:34.738 --- 10.0.0.1 ping statistics --- 00:20:34.738 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:34.738 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:20:34.738 15:21:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:34.738 15:21:33 -- nvmf/common.sh@410 -- # return 0 00:20:34.738 15:21:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:34.738 15:21:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:34.738 15:21:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:34.738 15:21:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:34.738 15:21:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:34.738 15:21:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:34.738 15:21:33 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:34.738 15:21:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:34.738 15:21:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:34.738 15:21:33 -- common/autotest_common.sh@10 -- # set +x 00:20:34.738 15:21:33 -- nvmf/common.sh@469 -- # nvmfpid=2810914 00:20:34.738 15:21:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:34.738 15:21:33 -- nvmf/common.sh@470 -- # waitforlisten 2810914 00:20:34.738 15:21:33 -- common/autotest_common.sh@829 -- # '[' -z 2810914 ']' 00:20:34.738 15:21:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:34.738 15:21:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:34.738 15:21:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:34.738 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:34.738 15:21:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:34.738 15:21:33 -- common/autotest_common.sh@10 -- # set +x 00:20:34.997 [2024-11-19 15:21:33.305259] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:34.997 [2024-11-19 15:21:33.305345] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:34.997 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.997 [2024-11-19 15:21:33.370801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:34.997 [2024-11-19 15:21:33.477011] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:34.997 [2024-11-19 15:21:33.477169] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:34.997 [2024-11-19 15:21:33.477186] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:34.997 [2024-11-19 15:21:33.477198] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:34.997 [2024-11-19 15:21:33.477250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:34.997 [2024-11-19 15:21:33.477320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.997 [2024-11-19 15:21:33.477377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:34.997 [2024-11-19 15:21:33.477379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:35.930 15:21:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:35.930 15:21:34 -- common/autotest_common.sh@862 -- # return 0 00:20:35.930 15:21:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:35.930 15:21:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 15:21:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 Malloc0 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 Delay0 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 [2024-11-19 15:21:34.386444] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:35.930 15:21:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:35.930 15:21:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.930 [2024-11-19 15:21:34.414762] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:35.930 15:21:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:35.930 15:21:34 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:36.496 15:21:35 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:36.496 15:21:35 -- common/autotest_common.sh@1187 -- # local i=0 00:20:36.496 15:21:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:36.496 15:21:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:36.496 15:21:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:39.021 15:21:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:39.021 15:21:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:39.021 15:21:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:39.021 15:21:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:39.021 15:21:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:39.021 15:21:37 -- common/autotest_common.sh@1197 -- # return 0 00:20:39.021 15:21:37 -- target/initiator_timeout.sh@35 -- # fio_pid=2811456 00:20:39.021 15:21:37 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:39.021 15:21:37 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:39.021 [global] 00:20:39.021 thread=1 00:20:39.021 invalidate=1 00:20:39.021 rw=write 00:20:39.021 time_based=1 00:20:39.021 runtime=60 00:20:39.021 ioengine=libaio 00:20:39.021 direct=1 00:20:39.021 bs=4096 00:20:39.021 iodepth=1 00:20:39.021 norandommap=0 00:20:39.021 numjobs=1 00:20:39.021 00:20:39.021 verify_dump=1 00:20:39.021 verify_backlog=512 00:20:39.021 verify_state_save=0 00:20:39.021 do_verify=1 00:20:39.021 verify=crc32c-intel 00:20:39.021 [job0] 00:20:39.021 filename=/dev/nvme0n1 00:20:39.021 Could not set queue depth (nvme0n1) 00:20:39.021 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:39.021 fio-3.35 00:20:39.021 Starting 1 thread 00:20:41.547 15:21:40 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:41.547 15:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.547 15:21:40 -- common/autotest_common.sh@10 -- # set +x 00:20:41.547 true 00:20:41.547 15:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.547 15:21:40 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:41.547 15:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.547 15:21:40 -- common/autotest_common.sh@10 -- # set +x 00:20:41.547 true 00:20:41.547 15:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.547 15:21:40 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:41.547 15:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.547 15:21:40 -- common/autotest_common.sh@10 -- # set +x 00:20:41.547 true 00:20:41.547 15:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.547 15:21:40 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:41.547 15:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:41.547 15:21:40 -- common/autotest_common.sh@10 -- # set +x 00:20:41.547 true 00:20:41.547 15:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:41.547 15:21:40 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:44.890 15:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.890 15:21:43 -- common/autotest_common.sh@10 -- # set +x 00:20:44.890 true 00:20:44.890 15:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:44.890 15:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.890 15:21:43 -- common/autotest_common.sh@10 -- # set +x 00:20:44.890 true 00:20:44.890 15:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:44.890 15:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.890 15:21:43 -- common/autotest_common.sh@10 -- # set +x 00:20:44.890 true 00:20:44.890 15:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:44.890 15:21:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:44.890 15:21:43 -- common/autotest_common.sh@10 -- # set +x 00:20:44.890 true 00:20:44.890 15:21:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:44.890 15:21:43 -- target/initiator_timeout.sh@54 -- # wait 2811456 00:21:41.102 00:21:41.102 job0: (groupid=0, jobs=1): err= 0: pid=2811525: Tue Nov 19 15:22:37 2024 00:21:41.102 read: IOPS=99, BW=397KiB/s (407kB/s)(23.3MiB/60041msec) 00:21:41.102 slat (usec): min=4, max=11619, avg=18.46, stdev=206.80 00:21:41.102 clat (usec): min=220, max=43972, avg=2938.64, stdev=10082.62 00:21:41.102 lat (usec): min=225, max=43991, avg=2957.10, stdev=10086.37 00:21:41.102 clat percentiles (usec): 00:21:41.102 | 1.00th=[ 233], 5.00th=[ 241], 10.00th=[ 247], 20.00th=[ 258], 00:21:41.102 | 30.00th=[ 269], 40.00th=[ 281], 50.00th=[ 293], 60.00th=[ 310], 00:21:41.102 | 70.00th=[ 322], 80.00th=[ 367], 90.00th=[ 474], 95.00th=[41157], 00:21:41.102 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:21:41.102 | 99.99th=[43779] 00:21:41.102 write: IOPS=102, BW=409KiB/s (419kB/s)(24.0MiB/60041msec); 0 zone resets 00:21:41.102 slat (nsec): min=5627, max=71185, avg=11901.49, stdev=8299.78 00:21:41.102 clat (usec): min=164, max=41025k, avg=6882.39, stdev=523378.33 00:21:41.102 lat (usec): min=170, max=41025k, avg=6894.29, stdev=523378.27 00:21:41.102 clat percentiles (usec): 00:21:41.102 | 1.00th=[ 174], 5.00th=[ 178], 10.00th=[ 180], 00:21:41.102 | 20.00th=[ 184], 30.00th=[ 188], 40.00th=[ 190], 00:21:41.102 | 50.00th=[ 194], 60.00th=[ 196], 70.00th=[ 202], 00:21:41.102 | 80.00th=[ 212], 90.00th=[ 243], 95.00th=[ 289], 00:21:41.102 | 99.00th=[ 322], 99.50th=[ 343], 99.90th=[ 502], 00:21:41.102 | 99.95th=[ 1139], 99.99th=[17112761] 00:21:41.102 bw ( KiB/s): min= 1712, max= 8192, per=100.00%, avg=5461.33, stdev=2608.66, samples=9 00:21:41.102 iops : min= 428, max= 2048, avg=1365.33, stdev=652.16, samples=9 00:21:41.102 lat (usec) : 250=53.03%, 500=43.17%, 750=0.61% 00:21:41.102 lat (msec) : 2=0.02%, 10=0.01%, 50=3.15%, >=2000=0.01% 00:21:41.102 cpu : usr=0.15%, sys=0.28%, ctx=12110, majf=0, minf=1 00:21:41.102 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:41.102 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.102 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:41.102 issued rwts: total=5964,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:41.102 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:41.102 00:21:41.102 Run status group 0 (all jobs): 00:21:41.102 READ: bw=397KiB/s (407kB/s), 397KiB/s-397KiB/s (407kB/s-407kB/s), io=23.3MiB (24.4MB), run=60041-60041msec 00:21:41.102 WRITE: bw=409KiB/s (419kB/s), 409KiB/s-409KiB/s (419kB/s-419kB/s), io=24.0MiB (25.2MB), run=60041-60041msec 00:21:41.102 00:21:41.102 Disk stats (read/write): 00:21:41.102 nvme0n1: ios=6059/6144, merge=0/0, ticks=17357/1234, in_queue=18591, util=99.77% 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:41.102 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:41.102 15:22:37 -- common/autotest_common.sh@1208 -- # local i=0 00:21:41.102 15:22:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:41.102 15:22:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.102 15:22:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:41.102 15:22:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:41.102 15:22:37 -- common/autotest_common.sh@1220 -- # return 0 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:41.102 nvmf hotplug test: fio successful as expected 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:41.102 15:22:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.102 15:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:41.102 15:22:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:41.102 15:22:37 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:41.102 15:22:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:41.102 15:22:37 -- nvmf/common.sh@116 -- # sync 00:21:41.102 15:22:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:41.102 15:22:37 -- nvmf/common.sh@119 -- # set +e 00:21:41.102 15:22:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:41.102 15:22:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:41.102 rmmod nvme_tcp 00:21:41.102 rmmod nvme_fabrics 00:21:41.102 rmmod nvme_keyring 00:21:41.102 15:22:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:41.102 15:22:37 -- nvmf/common.sh@123 -- # set -e 00:21:41.102 15:22:37 -- nvmf/common.sh@124 -- # return 0 00:21:41.102 15:22:37 -- nvmf/common.sh@477 -- # '[' -n 2810914 ']' 00:21:41.102 15:22:37 -- nvmf/common.sh@478 -- # killprocess 2810914 00:21:41.102 15:22:37 -- common/autotest_common.sh@936 -- # '[' -z 2810914 ']' 00:21:41.102 15:22:37 -- common/autotest_common.sh@940 -- # kill -0 2810914 00:21:41.102 15:22:37 -- common/autotest_common.sh@941 -- # uname 00:21:41.102 15:22:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:41.102 15:22:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2810914 00:21:41.102 15:22:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:41.102 15:22:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:41.102 15:22:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2810914' 00:21:41.102 killing process with pid 2810914 00:21:41.102 15:22:37 -- common/autotest_common.sh@955 -- # kill 2810914 00:21:41.102 15:22:37 -- common/autotest_common.sh@960 -- # wait 2810914 00:21:41.103 15:22:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:41.103 15:22:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:41.103 15:22:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:41.103 15:22:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:41.103 15:22:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:41.103 15:22:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.103 15:22:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.103 15:22:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.670 15:22:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:41.670 00:21:41.670 real 1m9.144s 00:21:41.670 user 4m14.533s 00:21:41.670 sys 0m6.556s 00:21:41.670 15:22:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:41.670 15:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:41.670 ************************************ 00:21:41.670 END TEST nvmf_initiator_timeout 00:21:41.670 ************************************ 00:21:41.670 15:22:40 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:41.670 15:22:40 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:41.670 15:22:40 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:41.670 15:22:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.670 15:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:43.575 15:22:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.575 15:22:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.575 15:22:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.575 15:22:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.575 15:22:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.575 15:22:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.575 15:22:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.575 15:22:42 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.575 15:22:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.575 15:22:42 -- nvmf/common.sh@295 -- # e810=() 00:21:43.575 15:22:42 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.575 15:22:42 -- nvmf/common.sh@296 -- # x722=() 00:21:43.575 15:22:42 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.575 15:22:42 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.575 15:22:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.575 15:22:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.575 15:22:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.575 15:22:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.575 15:22:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.575 15:22:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.576 15:22:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.576 15:22:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.576 15:22:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.576 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.576 15:22:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.576 15:22:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.576 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.576 15:22:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.576 15:22:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.576 15:22:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.576 15:22:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.576 15:22:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.576 15:22:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.576 15:22:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.576 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.576 15:22:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.576 15:22:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.576 15:22:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.576 15:22:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.576 15:22:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.576 15:22:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.576 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.576 15:22:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.576 15:22:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.576 15:22:42 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.576 15:22:42 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:43.576 15:22:42 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:43.576 15:22:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:43.576 15:22:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:43.576 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:21:43.576 ************************************ 00:21:43.576 START TEST nvmf_perf_adq 00:21:43.576 ************************************ 00:21:43.576 15:22:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:43.576 * Looking for test storage... 00:21:43.576 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:43.576 15:22:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:43.576 15:22:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:43.576 15:22:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:43.835 15:22:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:43.835 15:22:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:43.835 15:22:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:43.835 15:22:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:43.835 15:22:42 -- scripts/common.sh@335 -- # IFS=.-: 00:21:43.835 15:22:42 -- scripts/common.sh@335 -- # read -ra ver1 00:21:43.835 15:22:42 -- scripts/common.sh@336 -- # IFS=.-: 00:21:43.835 15:22:42 -- scripts/common.sh@336 -- # read -ra ver2 00:21:43.835 15:22:42 -- scripts/common.sh@337 -- # local 'op=<' 00:21:43.835 15:22:42 -- scripts/common.sh@339 -- # ver1_l=2 00:21:43.835 15:22:42 -- scripts/common.sh@340 -- # ver2_l=1 00:21:43.835 15:22:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:43.835 15:22:42 -- scripts/common.sh@343 -- # case "$op" in 00:21:43.835 15:22:42 -- scripts/common.sh@344 -- # : 1 00:21:43.835 15:22:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:43.835 15:22:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:43.835 15:22:42 -- scripts/common.sh@364 -- # decimal 1 00:21:43.835 15:22:42 -- scripts/common.sh@352 -- # local d=1 00:21:43.835 15:22:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:43.835 15:22:42 -- scripts/common.sh@354 -- # echo 1 00:21:43.835 15:22:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:43.835 15:22:42 -- scripts/common.sh@365 -- # decimal 2 00:21:43.835 15:22:42 -- scripts/common.sh@352 -- # local d=2 00:21:43.835 15:22:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:43.835 15:22:42 -- scripts/common.sh@354 -- # echo 2 00:21:43.835 15:22:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:43.835 15:22:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:43.835 15:22:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:43.835 15:22:42 -- scripts/common.sh@367 -- # return 0 00:21:43.835 15:22:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:43.835 15:22:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:43.835 --rc genhtml_branch_coverage=1 00:21:43.835 --rc genhtml_function_coverage=1 00:21:43.835 --rc genhtml_legend=1 00:21:43.835 --rc geninfo_all_blocks=1 00:21:43.835 --rc geninfo_unexecuted_blocks=1 00:21:43.835 00:21:43.835 ' 00:21:43.835 15:22:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:43.835 --rc genhtml_branch_coverage=1 00:21:43.835 --rc genhtml_function_coverage=1 00:21:43.835 --rc genhtml_legend=1 00:21:43.835 --rc geninfo_all_blocks=1 00:21:43.835 --rc geninfo_unexecuted_blocks=1 00:21:43.835 00:21:43.835 ' 00:21:43.835 15:22:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:43.835 --rc genhtml_branch_coverage=1 00:21:43.835 --rc genhtml_function_coverage=1 00:21:43.835 --rc genhtml_legend=1 00:21:43.835 --rc geninfo_all_blocks=1 00:21:43.835 --rc geninfo_unexecuted_blocks=1 00:21:43.835 00:21:43.835 ' 00:21:43.835 15:22:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:43.835 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:43.835 --rc genhtml_branch_coverage=1 00:21:43.835 --rc genhtml_function_coverage=1 00:21:43.835 --rc genhtml_legend=1 00:21:43.835 --rc geninfo_all_blocks=1 00:21:43.835 --rc geninfo_unexecuted_blocks=1 00:21:43.835 00:21:43.835 ' 00:21:43.835 15:22:42 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:43.835 15:22:42 -- nvmf/common.sh@7 -- # uname -s 00:21:43.835 15:22:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:43.835 15:22:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:43.835 15:22:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:43.835 15:22:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:43.835 15:22:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:43.835 15:22:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:43.835 15:22:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:43.835 15:22:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:43.835 15:22:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:43.835 15:22:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:43.835 15:22:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:43.835 15:22:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:43.835 15:22:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:43.835 15:22:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:43.835 15:22:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:43.835 15:22:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:43.835 15:22:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:43.835 15:22:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:43.835 15:22:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:43.835 15:22:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:43.835 15:22:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:43.835 15:22:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:43.835 15:22:42 -- paths/export.sh@5 -- # export PATH 00:21:43.835 15:22:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:43.835 15:22:42 -- nvmf/common.sh@46 -- # : 0 00:21:43.835 15:22:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:43.835 15:22:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:43.835 15:22:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:43.835 15:22:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:43.835 15:22:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:43.835 15:22:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:43.835 15:22:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:43.835 15:22:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:43.835 15:22:42 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:43.835 15:22:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:43.836 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:21:45.740 15:22:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:45.740 15:22:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:45.740 15:22:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:45.740 15:22:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:45.740 15:22:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:45.740 15:22:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:45.740 15:22:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:45.740 15:22:44 -- nvmf/common.sh@294 -- # net_devs=() 00:21:45.740 15:22:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:45.740 15:22:44 -- nvmf/common.sh@295 -- # e810=() 00:21:45.740 15:22:44 -- nvmf/common.sh@295 -- # local -ga e810 00:21:45.740 15:22:44 -- nvmf/common.sh@296 -- # x722=() 00:21:45.740 15:22:44 -- nvmf/common.sh@296 -- # local -ga x722 00:21:45.740 15:22:44 -- nvmf/common.sh@297 -- # mlx=() 00:21:45.740 15:22:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:45.740 15:22:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:45.740 15:22:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:45.740 15:22:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:45.740 15:22:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:45.740 15:22:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.740 15:22:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:45.740 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:45.740 15:22:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.740 15:22:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:45.740 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:45.740 15:22:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:45.740 15:22:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:45.740 15:22:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.740 15:22:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.740 15:22:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.740 15:22:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.740 15:22:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:45.740 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:45.740 15:22:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.740 15:22:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.740 15:22:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.740 15:22:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.740 15:22:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.740 15:22:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:45.740 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:45.740 15:22:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.740 15:22:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:45.740 15:22:44 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:45.740 15:22:44 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:45.740 15:22:44 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:45.740 15:22:44 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:45.740 15:22:44 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:46.676 15:22:44 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:49.207 15:22:47 -- target/perf_adq.sh@54 -- # sleep 5 00:21:54.476 15:22:52 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:54.476 15:22:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:54.476 15:22:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:54.476 15:22:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:54.476 15:22:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:54.476 15:22:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:54.476 15:22:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.476 15:22:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.476 15:22:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.476 15:22:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:54.476 15:22:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:54.476 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.476 15:22:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:54.476 15:22:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:54.476 15:22:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:54.476 15:22:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:54.476 15:22:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:54.476 15:22:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:54.476 15:22:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:54.476 15:22:52 -- nvmf/common.sh@294 -- # net_devs=() 00:21:54.476 15:22:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:54.476 15:22:52 -- nvmf/common.sh@295 -- # e810=() 00:21:54.476 15:22:52 -- nvmf/common.sh@295 -- # local -ga e810 00:21:54.476 15:22:52 -- nvmf/common.sh@296 -- # x722=() 00:21:54.476 15:22:52 -- nvmf/common.sh@296 -- # local -ga x722 00:21:54.476 15:22:52 -- nvmf/common.sh@297 -- # mlx=() 00:21:54.476 15:22:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:54.476 15:22:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:54.476 15:22:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:54.476 15:22:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:54.476 15:22:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:54.476 15:22:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.476 15:22:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:54.476 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:54.476 15:22:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.476 15:22:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.477 15:22:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:54.477 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:54.477 15:22:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:54.477 15:22:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.477 15:22:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.477 15:22:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.477 15:22:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.477 15:22:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:54.477 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:54.477 15:22:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.477 15:22:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.477 15:22:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.477 15:22:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.477 15:22:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.477 15:22:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:54.477 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:54.477 15:22:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.477 15:22:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:54.477 15:22:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:54.477 15:22:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:54.477 15:22:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:54.477 15:22:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:54.477 15:22:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:54.477 15:22:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:54.477 15:22:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:54.477 15:22:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:54.477 15:22:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:54.477 15:22:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:54.477 15:22:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:54.477 15:22:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:54.477 15:22:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:54.477 15:22:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:54.477 15:22:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:54.477 15:22:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:54.477 15:22:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:54.477 15:22:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:54.477 15:22:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:54.477 15:22:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:54.477 15:22:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:54.477 15:22:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:54.477 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:54.477 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:21:54.477 00:21:54.477 --- 10.0.0.2 ping statistics --- 00:21:54.477 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.477 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:21:54.477 15:22:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:54.477 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:54.477 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:21:54.477 00:21:54.477 --- 10.0.0.1 ping statistics --- 00:21:54.477 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.477 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:21:54.477 15:22:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:54.477 15:22:52 -- nvmf/common.sh@410 -- # return 0 00:21:54.477 15:22:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:54.477 15:22:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:54.477 15:22:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:54.477 15:22:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:54.477 15:22:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:54.477 15:22:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:54.477 15:22:52 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:54.477 15:22:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:54.477 15:22:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- nvmf/common.sh@469 -- # nvmfpid=2823458 00:21:54.477 15:22:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:54.477 15:22:52 -- nvmf/common.sh@470 -- # waitforlisten 2823458 00:21:54.477 15:22:52 -- common/autotest_common.sh@829 -- # '[' -z 2823458 ']' 00:21:54.477 15:22:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:54.477 15:22:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:54.477 15:22:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:54.477 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:54.477 15:22:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 [2024-11-19 15:22:52.400594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:54.477 [2024-11-19 15:22:52.400669] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:54.477 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.477 [2024-11-19 15:22:52.465728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:54.477 [2024-11-19 15:22:52.575973] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:54.477 [2024-11-19 15:22:52.576123] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:54.477 [2024-11-19 15:22:52.576141] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:54.477 [2024-11-19 15:22:52.576154] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:54.477 [2024-11-19 15:22:52.576212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:54.477 [2024-11-19 15:22:52.576273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:54.477 [2024-11-19 15:22:52.576338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:54.477 [2024-11-19 15:22:52.576341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:54.477 15:22:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:54.477 15:22:52 -- common/autotest_common.sh@862 -- # return 0 00:21:54.477 15:22:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:54.477 15:22:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:54.477 15:22:52 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:54.477 15:22:52 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 [2024-11-19 15:22:52.780630] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 Malloc1 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:54.477 15:22:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:54.477 15:22:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.477 [2024-11-19 15:22:52.834182] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:54.477 15:22:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.477 15:22:52 -- target/perf_adq.sh@73 -- # perfpid=2823490 00:21:54.477 15:22:52 -- target/perf_adq.sh@74 -- # sleep 2 00:21:54.477 15:22:52 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:54.477 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.380 15:22:54 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:56.380 15:22:54 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:56.380 15:22:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.380 15:22:54 -- target/perf_adq.sh@76 -- # wc -l 00:21:56.380 15:22:54 -- common/autotest_common.sh@10 -- # set +x 00:21:56.380 15:22:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.380 15:22:54 -- target/perf_adq.sh@76 -- # count=4 00:21:56.380 15:22:54 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:56.380 15:22:54 -- target/perf_adq.sh@81 -- # wait 2823490 00:22:04.493 [2024-11-19 15:23:02.963623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xabb6e0 is same with the state(5) to be set 00:22:04.493 Initializing NVMe Controllers 00:22:04.493 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:04.493 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:04.493 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:04.493 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:04.493 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:04.493 Initialization complete. Launching workers. 00:22:04.493 ======================================================== 00:22:04.493 Latency(us) 00:22:04.493 Device Information : IOPS MiB/s Average min max 00:22:04.493 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11177.09 43.66 5726.29 1591.99 9252.67 00:22:04.493 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10646.80 41.59 6010.81 1762.79 10393.46 00:22:04.493 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11183.49 43.69 5723.33 1482.93 9551.75 00:22:04.493 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11177.09 43.66 5725.75 1438.07 10128.82 00:22:04.493 ======================================================== 00:22:04.493 Total : 44184.47 172.60 5793.96 1438.07 10393.46 00:22:04.494 00:22:04.494 15:23:02 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:04.494 15:23:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:04.494 15:23:02 -- nvmf/common.sh@116 -- # sync 00:22:04.494 15:23:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:04.494 15:23:02 -- nvmf/common.sh@119 -- # set +e 00:22:04.494 15:23:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:04.494 15:23:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:04.494 rmmod nvme_tcp 00:22:04.494 rmmod nvme_fabrics 00:22:04.494 rmmod nvme_keyring 00:22:04.494 15:23:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:04.494 15:23:03 -- nvmf/common.sh@123 -- # set -e 00:22:04.494 15:23:03 -- nvmf/common.sh@124 -- # return 0 00:22:04.494 15:23:03 -- nvmf/common.sh@477 -- # '[' -n 2823458 ']' 00:22:04.494 15:23:03 -- nvmf/common.sh@478 -- # killprocess 2823458 00:22:04.494 15:23:03 -- common/autotest_common.sh@936 -- # '[' -z 2823458 ']' 00:22:04.494 15:23:03 -- common/autotest_common.sh@940 -- # kill -0 2823458 00:22:04.494 15:23:03 -- common/autotest_common.sh@941 -- # uname 00:22:04.494 15:23:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:04.494 15:23:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2823458 00:22:04.752 15:23:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:04.753 15:23:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:04.753 15:23:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2823458' 00:22:04.753 killing process with pid 2823458 00:22:04.753 15:23:03 -- common/autotest_common.sh@955 -- # kill 2823458 00:22:04.753 15:23:03 -- common/autotest_common.sh@960 -- # wait 2823458 00:22:05.011 15:23:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:05.011 15:23:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:05.011 15:23:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:05.011 15:23:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:05.011 15:23:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:05.011 15:23:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:05.011 15:23:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:05.011 15:23:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:06.915 15:23:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:06.915 15:23:05 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:06.915 15:23:05 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:07.852 15:23:06 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:10.383 15:23:08 -- target/perf_adq.sh@54 -- # sleep 5 00:22:15.697 15:23:13 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:15.697 15:23:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.697 15:23:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.697 15:23:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.697 15:23:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.697 15:23:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.697 15:23:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.697 15:23:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.697 15:23:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.697 15:23:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.697 15:23:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.697 15:23:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.697 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.697 15:23:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:15.697 15:23:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:15.697 15:23:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:15.697 15:23:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:15.697 15:23:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:15.697 15:23:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:15.697 15:23:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:15.697 15:23:13 -- nvmf/common.sh@294 -- # net_devs=() 00:22:15.697 15:23:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:15.697 15:23:13 -- nvmf/common.sh@295 -- # e810=() 00:22:15.697 15:23:13 -- nvmf/common.sh@295 -- # local -ga e810 00:22:15.697 15:23:13 -- nvmf/common.sh@296 -- # x722=() 00:22:15.697 15:23:13 -- nvmf/common.sh@296 -- # local -ga x722 00:22:15.697 15:23:13 -- nvmf/common.sh@297 -- # mlx=() 00:22:15.697 15:23:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:15.697 15:23:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:15.697 15:23:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:15.697 15:23:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:15.697 15:23:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:15.697 15:23:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:15.698 15:23:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:15.698 15:23:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:15.698 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:15.698 15:23:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:15.698 15:23:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:15.698 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:15.698 15:23:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:15.698 15:23:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:15.698 15:23:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:15.698 15:23:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:15.698 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:15.698 15:23:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:15.698 15:23:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:15.698 15:23:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:15.698 15:23:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:15.698 15:23:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:15.698 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:15.698 15:23:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:15.698 15:23:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:15.698 15:23:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:15.698 15:23:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:15.698 15:23:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:15.698 15:23:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:15.698 15:23:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:15.698 15:23:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:15.698 15:23:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:15.698 15:23:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:15.698 15:23:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:15.698 15:23:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:15.698 15:23:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:15.698 15:23:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:15.698 15:23:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:15.698 15:23:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:15.698 15:23:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:15.698 15:23:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:15.698 15:23:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:15.698 15:23:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:15.698 15:23:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:15.698 15:23:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:15.698 15:23:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:15.698 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:15.698 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.279 ms 00:22:15.698 00:22:15.698 --- 10.0.0.2 ping statistics --- 00:22:15.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:15.698 rtt min/avg/max/mdev = 0.279/0.279/0.279/0.000 ms 00:22:15.698 15:23:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:15.698 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:15.698 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:22:15.698 00:22:15.698 --- 10.0.0.1 ping statistics --- 00:22:15.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:15.698 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:22:15.698 15:23:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:15.698 15:23:13 -- nvmf/common.sh@410 -- # return 0 00:22:15.698 15:23:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:15.698 15:23:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:15.698 15:23:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:15.698 15:23:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:15.698 15:23:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:15.698 15:23:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:15.698 15:23:13 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:15.698 15:23:13 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:15.698 15:23:13 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:15.698 15:23:13 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:15.698 net.core.busy_poll = 1 00:22:15.698 15:23:13 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:15.698 net.core.busy_read = 1 00:22:15.698 15:23:13 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:15.698 15:23:13 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:15.698 15:23:13 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:15.698 15:23:13 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:15.698 15:23:13 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:15.698 15:23:13 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:15.698 15:23:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:15.698 15:23:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:15.698 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 15:23:13 -- nvmf/common.sh@469 -- # nvmfpid=2826177 00:22:15.698 15:23:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:15.698 15:23:13 -- nvmf/common.sh@470 -- # waitforlisten 2826177 00:22:15.698 15:23:13 -- common/autotest_common.sh@829 -- # '[' -z 2826177 ']' 00:22:15.698 15:23:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:15.698 15:23:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:15.698 15:23:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:15.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:15.698 15:23:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:15.698 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 [2024-11-19 15:23:13.721954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:15.698 [2024-11-19 15:23:13.722079] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:15.698 EAL: No free 2048 kB hugepages reported on node 1 00:22:15.698 [2024-11-19 15:23:13.794504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:15.698 [2024-11-19 15:23:13.911517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:15.698 [2024-11-19 15:23:13.911703] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:15.698 [2024-11-19 15:23:13.911725] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:15.698 [2024-11-19 15:23:13.911739] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:15.698 [2024-11-19 15:23:13.911818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:15.698 [2024-11-19 15:23:13.911902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:15.698 [2024-11-19 15:23:13.911992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:15.698 [2024-11-19 15:23:13.911995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:15.698 15:23:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:15.698 15:23:13 -- common/autotest_common.sh@862 -- # return 0 00:22:15.698 15:23:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:15.698 15:23:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:15.698 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 15:23:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:15.698 15:23:13 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:15.698 15:23:13 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:15.698 15:23:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.698 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 15:23:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.698 15:23:13 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:15.698 15:23:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.698 15:23:13 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.698 15:23:14 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:15.698 15:23:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.698 15:23:14 -- common/autotest_common.sh@10 -- # set +x 00:22:15.698 [2024-11-19 15:23:14.071368] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:15.698 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.698 15:23:14 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:15.698 15:23:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.699 15:23:14 -- common/autotest_common.sh@10 -- # set +x 00:22:15.699 Malloc1 00:22:15.699 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.699 15:23:14 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:15.699 15:23:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.699 15:23:14 -- common/autotest_common.sh@10 -- # set +x 00:22:15.699 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.699 15:23:14 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:15.699 15:23:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.699 15:23:14 -- common/autotest_common.sh@10 -- # set +x 00:22:15.699 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.699 15:23:14 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:15.699 15:23:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.699 15:23:14 -- common/autotest_common.sh@10 -- # set +x 00:22:15.699 [2024-11-19 15:23:14.122508] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:15.699 15:23:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.699 15:23:14 -- target/perf_adq.sh@94 -- # perfpid=2826332 00:22:15.699 15:23:14 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:15.699 15:23:14 -- target/perf_adq.sh@95 -- # sleep 2 00:22:15.699 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.600 15:23:16 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:17.600 15:23:16 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:17.600 15:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.600 15:23:16 -- target/perf_adq.sh@97 -- # wc -l 00:22:17.600 15:23:16 -- common/autotest_common.sh@10 -- # set +x 00:22:17.600 15:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.859 15:23:16 -- target/perf_adq.sh@97 -- # count=2 00:22:17.859 15:23:16 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:17.859 15:23:16 -- target/perf_adq.sh@103 -- # wait 2826332 00:22:25.970 Initializing NVMe Controllers 00:22:25.970 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:25.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:25.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:25.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:25.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:25.970 Initialization complete. Launching workers. 00:22:25.970 ======================================================== 00:22:25.970 Latency(us) 00:22:25.970 Device Information : IOPS MiB/s Average min max 00:22:25.970 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 14483.60 56.58 4418.77 1093.38 46812.37 00:22:25.970 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4496.60 17.56 14295.65 2272.39 59652.19 00:22:25.970 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5333.10 20.83 12003.08 1120.95 61930.84 00:22:25.970 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5328.80 20.82 12011.73 1170.66 59114.82 00:22:25.970 ======================================================== 00:22:25.970 Total : 29642.10 115.79 8646.60 1093.38 61930.84 00:22:25.970 00:22:25.970 15:23:24 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:25.970 15:23:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:25.970 15:23:24 -- nvmf/common.sh@116 -- # sync 00:22:25.970 15:23:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:25.970 15:23:24 -- nvmf/common.sh@119 -- # set +e 00:22:25.970 15:23:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:25.970 15:23:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:25.970 rmmod nvme_tcp 00:22:25.970 rmmod nvme_fabrics 00:22:25.970 rmmod nvme_keyring 00:22:25.970 15:23:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:25.970 15:23:24 -- nvmf/common.sh@123 -- # set -e 00:22:25.970 15:23:24 -- nvmf/common.sh@124 -- # return 0 00:22:25.970 15:23:24 -- nvmf/common.sh@477 -- # '[' -n 2826177 ']' 00:22:25.970 15:23:24 -- nvmf/common.sh@478 -- # killprocess 2826177 00:22:25.970 15:23:24 -- common/autotest_common.sh@936 -- # '[' -z 2826177 ']' 00:22:25.970 15:23:24 -- common/autotest_common.sh@940 -- # kill -0 2826177 00:22:25.970 15:23:24 -- common/autotest_common.sh@941 -- # uname 00:22:25.970 15:23:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:25.970 15:23:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2826177 00:22:25.970 15:23:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:25.970 15:23:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:25.970 15:23:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2826177' 00:22:25.970 killing process with pid 2826177 00:22:25.970 15:23:24 -- common/autotest_common.sh@955 -- # kill 2826177 00:22:25.970 15:23:24 -- common/autotest_common.sh@960 -- # wait 2826177 00:22:26.230 15:23:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:26.230 15:23:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:26.230 15:23:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:26.230 15:23:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:26.230 15:23:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:26.230 15:23:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:26.230 15:23:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:26.231 15:23:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.523 15:23:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:29.523 15:23:27 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:29.523 00:22:29.523 real 0m45.660s 00:22:29.523 user 2m35.334s 00:22:29.523 sys 0m11.428s 00:22:29.523 15:23:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:29.523 15:23:27 -- common/autotest_common.sh@10 -- # set +x 00:22:29.523 ************************************ 00:22:29.523 END TEST nvmf_perf_adq 00:22:29.523 ************************************ 00:22:29.523 15:23:27 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:29.523 15:23:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:29.523 15:23:27 -- common/autotest_common.sh@10 -- # set +x 00:22:29.523 ************************************ 00:22:29.523 START TEST nvmf_shutdown 00:22:29.523 ************************************ 00:22:29.523 15:23:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:29.523 * Looking for test storage... 00:22:29.523 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:29.523 15:23:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:29.523 15:23:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:29.523 15:23:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:29.523 15:23:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:29.523 15:23:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:29.523 15:23:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:29.523 15:23:27 -- scripts/common.sh@335 -- # IFS=.-: 00:22:29.523 15:23:27 -- scripts/common.sh@335 -- # read -ra ver1 00:22:29.523 15:23:27 -- scripts/common.sh@336 -- # IFS=.-: 00:22:29.523 15:23:27 -- scripts/common.sh@336 -- # read -ra ver2 00:22:29.523 15:23:27 -- scripts/common.sh@337 -- # local 'op=<' 00:22:29.523 15:23:27 -- scripts/common.sh@339 -- # ver1_l=2 00:22:29.523 15:23:27 -- scripts/common.sh@340 -- # ver2_l=1 00:22:29.523 15:23:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:29.523 15:23:27 -- scripts/common.sh@343 -- # case "$op" in 00:22:29.523 15:23:27 -- scripts/common.sh@344 -- # : 1 00:22:29.523 15:23:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:29.523 15:23:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:29.523 15:23:27 -- scripts/common.sh@364 -- # decimal 1 00:22:29.523 15:23:27 -- scripts/common.sh@352 -- # local d=1 00:22:29.523 15:23:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:29.523 15:23:27 -- scripts/common.sh@354 -- # echo 1 00:22:29.523 15:23:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:29.523 15:23:27 -- scripts/common.sh@365 -- # decimal 2 00:22:29.523 15:23:27 -- scripts/common.sh@352 -- # local d=2 00:22:29.523 15:23:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:29.523 15:23:27 -- scripts/common.sh@354 -- # echo 2 00:22:29.523 15:23:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:29.523 15:23:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:29.523 15:23:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:29.523 15:23:27 -- scripts/common.sh@367 -- # return 0 00:22:29.523 15:23:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:29.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:29.523 --rc genhtml_branch_coverage=1 00:22:29.523 --rc genhtml_function_coverage=1 00:22:29.523 --rc genhtml_legend=1 00:22:29.523 --rc geninfo_all_blocks=1 00:22:29.523 --rc geninfo_unexecuted_blocks=1 00:22:29.523 00:22:29.523 ' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:29.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:29.523 --rc genhtml_branch_coverage=1 00:22:29.523 --rc genhtml_function_coverage=1 00:22:29.523 --rc genhtml_legend=1 00:22:29.523 --rc geninfo_all_blocks=1 00:22:29.523 --rc geninfo_unexecuted_blocks=1 00:22:29.523 00:22:29.523 ' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:29.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:29.523 --rc genhtml_branch_coverage=1 00:22:29.523 --rc genhtml_function_coverage=1 00:22:29.523 --rc genhtml_legend=1 00:22:29.523 --rc geninfo_all_blocks=1 00:22:29.523 --rc geninfo_unexecuted_blocks=1 00:22:29.523 00:22:29.523 ' 00:22:29.523 15:23:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:29.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:29.523 --rc genhtml_branch_coverage=1 00:22:29.523 --rc genhtml_function_coverage=1 00:22:29.523 --rc genhtml_legend=1 00:22:29.523 --rc geninfo_all_blocks=1 00:22:29.523 --rc geninfo_unexecuted_blocks=1 00:22:29.523 00:22:29.523 ' 00:22:29.523 15:23:27 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:29.523 15:23:27 -- nvmf/common.sh@7 -- # uname -s 00:22:29.523 15:23:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:29.523 15:23:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:29.523 15:23:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:29.523 15:23:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:29.523 15:23:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:29.523 15:23:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:29.523 15:23:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:29.523 15:23:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:29.523 15:23:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:29.523 15:23:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:29.523 15:23:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:29.523 15:23:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:29.523 15:23:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:29.523 15:23:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:29.523 15:23:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:29.523 15:23:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:29.523 15:23:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:29.523 15:23:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:29.523 15:23:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:29.523 15:23:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.523 15:23:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.523 15:23:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.523 15:23:27 -- paths/export.sh@5 -- # export PATH 00:22:29.524 15:23:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.524 15:23:27 -- nvmf/common.sh@46 -- # : 0 00:22:29.524 15:23:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:29.524 15:23:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:29.524 15:23:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:29.524 15:23:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:29.524 15:23:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:29.524 15:23:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:29.524 15:23:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:29.524 15:23:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:29.524 15:23:27 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:29.524 15:23:27 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:29.524 15:23:27 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:29.524 15:23:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:29.524 15:23:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:29.524 15:23:27 -- common/autotest_common.sh@10 -- # set +x 00:22:29.524 ************************************ 00:22:29.524 START TEST nvmf_shutdown_tc1 00:22:29.524 ************************************ 00:22:29.524 15:23:27 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:29.524 15:23:27 -- target/shutdown.sh@74 -- # starttarget 00:22:29.524 15:23:27 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:29.524 15:23:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:29.524 15:23:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:29.524 15:23:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:29.524 15:23:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:29.524 15:23:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:29.524 15:23:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.524 15:23:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.524 15:23:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.524 15:23:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:29.524 15:23:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:29.524 15:23:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:29.524 15:23:27 -- common/autotest_common.sh@10 -- # set +x 00:22:31.425 15:23:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:31.425 15:23:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:31.425 15:23:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:31.425 15:23:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:31.425 15:23:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:31.425 15:23:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:31.425 15:23:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:31.425 15:23:29 -- nvmf/common.sh@294 -- # net_devs=() 00:22:31.425 15:23:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:31.425 15:23:29 -- nvmf/common.sh@295 -- # e810=() 00:22:31.425 15:23:29 -- nvmf/common.sh@295 -- # local -ga e810 00:22:31.425 15:23:29 -- nvmf/common.sh@296 -- # x722=() 00:22:31.425 15:23:29 -- nvmf/common.sh@296 -- # local -ga x722 00:22:31.425 15:23:29 -- nvmf/common.sh@297 -- # mlx=() 00:22:31.425 15:23:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:31.425 15:23:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:31.425 15:23:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:31.425 15:23:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:31.425 15:23:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:31.425 15:23:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:31.425 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:31.425 15:23:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:31.425 15:23:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:31.425 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:31.425 15:23:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:31.425 15:23:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.425 15:23:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.425 15:23:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:31.425 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:31.425 15:23:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.425 15:23:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:31.425 15:23:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:31.425 15:23:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:31.425 15:23:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:31.425 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:31.425 15:23:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:31.425 15:23:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:31.425 15:23:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:31.425 15:23:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:31.425 15:23:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:31.425 15:23:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:31.425 15:23:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:31.425 15:23:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:31.425 15:23:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:31.425 15:23:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:31.425 15:23:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:31.425 15:23:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:31.425 15:23:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:31.425 15:23:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:31.425 15:23:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:31.425 15:23:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:31.425 15:23:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:31.684 15:23:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:31.684 15:23:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:31.684 15:23:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:31.684 15:23:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:31.684 15:23:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:31.684 15:23:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:31.684 15:23:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:31.684 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:31.684 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:22:31.684 00:22:31.684 --- 10.0.0.2 ping statistics --- 00:22:31.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:31.684 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:22:31.684 15:23:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:31.684 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:31.684 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:22:31.684 00:22:31.684 --- 10.0.0.1 ping statistics --- 00:22:31.684 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:31.684 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:22:31.684 15:23:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:31.684 15:23:30 -- nvmf/common.sh@410 -- # return 0 00:22:31.684 15:23:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:31.684 15:23:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:31.684 15:23:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:31.684 15:23:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:31.684 15:23:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:31.684 15:23:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:31.684 15:23:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:31.684 15:23:30 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:31.684 15:23:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:31.684 15:23:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:31.684 15:23:30 -- common/autotest_common.sh@10 -- # set +x 00:22:31.684 15:23:30 -- nvmf/common.sh@469 -- # nvmfpid=2829677 00:22:31.684 15:23:30 -- nvmf/common.sh@470 -- # waitforlisten 2829677 00:22:31.684 15:23:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:31.684 15:23:30 -- common/autotest_common.sh@829 -- # '[' -z 2829677 ']' 00:22:31.684 15:23:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:31.684 15:23:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:31.684 15:23:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:31.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:31.684 15:23:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:31.684 15:23:30 -- common/autotest_common.sh@10 -- # set +x 00:22:31.684 [2024-11-19 15:23:30.229038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.684 [2024-11-19 15:23:30.229113] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:31.942 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.942 [2024-11-19 15:23:30.299783] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:31.942 [2024-11-19 15:23:30.422958] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:31.942 [2024-11-19 15:23:30.423118] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:31.942 [2024-11-19 15:23:30.423136] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:31.942 [2024-11-19 15:23:30.423148] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:31.942 [2024-11-19 15:23:30.423246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:31.942 [2024-11-19 15:23:30.423300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:31.942 [2024-11-19 15:23:30.423321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:31.942 [2024-11-19 15:23:30.423324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:32.876 15:23:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:32.876 15:23:31 -- common/autotest_common.sh@862 -- # return 0 00:22:32.876 15:23:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:32.876 15:23:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:32.876 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:32.876 15:23:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:32.876 15:23:31 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:32.876 15:23:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:32.876 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:32.876 [2024-11-19 15:23:31.259336] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:32.876 15:23:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:32.876 15:23:31 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:32.876 15:23:31 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:32.876 15:23:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:32.876 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:32.876 15:23:31 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:32.876 15:23:31 -- target/shutdown.sh@28 -- # cat 00:22:32.876 15:23:31 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:32.876 15:23:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:32.876 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:32.876 Malloc1 00:22:32.876 [2024-11-19 15:23:31.334647] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:32.876 Malloc2 00:22:32.876 Malloc3 00:22:33.134 Malloc4 00:22:33.134 Malloc5 00:22:33.134 Malloc6 00:22:33.134 Malloc7 00:22:33.134 Malloc8 00:22:33.392 Malloc9 00:22:33.392 Malloc10 00:22:33.392 15:23:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.392 15:23:31 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:33.392 15:23:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:33.392 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:33.392 15:23:31 -- target/shutdown.sh@78 -- # perfpid=2829873 00:22:33.392 15:23:31 -- target/shutdown.sh@79 -- # waitforlisten 2829873 /var/tmp/bdevperf.sock 00:22:33.392 15:23:31 -- common/autotest_common.sh@829 -- # '[' -z 2829873 ']' 00:22:33.392 15:23:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:33.392 15:23:31 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:33.392 15:23:31 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:33.392 15:23:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:33.392 15:23:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:33.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:33.392 15:23:31 -- nvmf/common.sh@520 -- # config=() 00:22:33.392 15:23:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:33.392 15:23:31 -- nvmf/common.sh@520 -- # local subsystem config 00:22:33.392 15:23:31 -- common/autotest_common.sh@10 -- # set +x 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.393 { 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme$subsystem", 00:22:33.393 "trtype": "$TEST_TRANSPORT", 00:22:33.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "$NVMF_PORT", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.393 "hdgst": ${hdgst:-false}, 00:22:33.393 "ddgst": ${ddgst:-false} 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 } 00:22:33.393 EOF 00:22:33.393 )") 00:22:33.393 15:23:31 -- nvmf/common.sh@542 -- # cat 00:22:33.393 15:23:31 -- nvmf/common.sh@544 -- # jq . 00:22:33.393 15:23:31 -- nvmf/common.sh@545 -- # IFS=, 00:22:33.393 15:23:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme1", 00:22:33.393 "trtype": "tcp", 00:22:33.393 "traddr": "10.0.0.2", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "4420", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:33.393 "hdgst": false, 00:22:33.393 "ddgst": false 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 },{ 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme2", 00:22:33.393 "trtype": "tcp", 00:22:33.393 "traddr": "10.0.0.2", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "4420", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:33.393 "hdgst": false, 00:22:33.393 "ddgst": false 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 },{ 00:22:33.393 "params": { 00:22:33.393 "name": "Nvme3", 00:22:33.393 "trtype": "tcp", 00:22:33.393 "traddr": "10.0.0.2", 00:22:33.393 "adrfam": "ipv4", 00:22:33.393 "trsvcid": "4420", 00:22:33.393 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:33.393 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:33.393 "hdgst": false, 00:22:33.393 "ddgst": false 00:22:33.393 }, 00:22:33.393 "method": "bdev_nvme_attach_controller" 00:22:33.393 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme4", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme5", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme6", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme7", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme8", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme9", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 },{ 00:22:33.394 "params": { 00:22:33.394 "name": "Nvme10", 00:22:33.394 "trtype": "tcp", 00:22:33.394 "traddr": "10.0.0.2", 00:22:33.394 "adrfam": "ipv4", 00:22:33.394 "trsvcid": "4420", 00:22:33.394 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:33.394 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:33.394 "hdgst": false, 00:22:33.394 "ddgst": false 00:22:33.394 }, 00:22:33.394 "method": "bdev_nvme_attach_controller" 00:22:33.394 }' 00:22:33.394 [2024-11-19 15:23:31.839743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.394 [2024-11-19 15:23:31.839821] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:33.394 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.394 [2024-11-19 15:23:31.903315] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:33.652 [2024-11-19 15:23:32.014503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:35.024 15:23:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:35.024 15:23:33 -- common/autotest_common.sh@862 -- # return 0 00:22:35.024 15:23:33 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:35.024 15:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:35.024 15:23:33 -- common/autotest_common.sh@10 -- # set +x 00:22:35.024 15:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:35.024 15:23:33 -- target/shutdown.sh@83 -- # kill -9 2829873 00:22:35.024 15:23:33 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:35.024 15:23:33 -- target/shutdown.sh@87 -- # sleep 1 00:22:36.396 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2829873 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:36.396 15:23:34 -- target/shutdown.sh@88 -- # kill -0 2829677 00:22:36.396 15:23:34 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:36.396 15:23:34 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:36.396 15:23:34 -- nvmf/common.sh@520 -- # config=() 00:22:36.396 15:23:34 -- nvmf/common.sh@520 -- # local subsystem config 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.396 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.396 { 00:22:36.396 "params": { 00:22:36.396 "name": "Nvme$subsystem", 00:22:36.396 "trtype": "$TEST_TRANSPORT", 00:22:36.396 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.396 "adrfam": "ipv4", 00:22:36.396 "trsvcid": "$NVMF_PORT", 00:22:36.396 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.396 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.396 "hdgst": ${hdgst:-false}, 00:22:36.396 "ddgst": ${ddgst:-false} 00:22:36.396 }, 00:22:36.396 "method": "bdev_nvme_attach_controller" 00:22:36.396 } 00:22:36.396 EOF 00:22:36.396 )") 00:22:36.396 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.397 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.397 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.397 { 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme$subsystem", 00:22:36.397 "trtype": "$TEST_TRANSPORT", 00:22:36.397 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "$NVMF_PORT", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.397 "hdgst": ${hdgst:-false}, 00:22:36.397 "ddgst": ${ddgst:-false} 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 } 00:22:36.397 EOF 00:22:36.397 )") 00:22:36.397 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.397 15:23:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.397 15:23:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.397 { 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme$subsystem", 00:22:36.397 "trtype": "$TEST_TRANSPORT", 00:22:36.397 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "$NVMF_PORT", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.397 "hdgst": ${hdgst:-false}, 00:22:36.397 "ddgst": ${ddgst:-false} 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 } 00:22:36.397 EOF 00:22:36.397 )") 00:22:36.397 15:23:34 -- nvmf/common.sh@542 -- # cat 00:22:36.397 15:23:34 -- nvmf/common.sh@544 -- # jq . 00:22:36.397 15:23:34 -- nvmf/common.sh@545 -- # IFS=, 00:22:36.397 15:23:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme1", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme2", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme3", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme4", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme5", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme6", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme7", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme8", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme9", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 },{ 00:22:36.397 "params": { 00:22:36.397 "name": "Nvme10", 00:22:36.397 "trtype": "tcp", 00:22:36.397 "traddr": "10.0.0.2", 00:22:36.397 "adrfam": "ipv4", 00:22:36.397 "trsvcid": "4420", 00:22:36.397 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:36.397 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:36.397 "hdgst": false, 00:22:36.397 "ddgst": false 00:22:36.397 }, 00:22:36.397 "method": "bdev_nvme_attach_controller" 00:22:36.397 }' 00:22:36.397 [2024-11-19 15:23:34.599754] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.397 [2024-11-19 15:23:34.599835] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2830303 ] 00:22:36.397 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.397 [2024-11-19 15:23:34.663444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:36.397 [2024-11-19 15:23:34.772013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.770 Running I/O for 1 seconds... 00:22:39.143 00:22:39.143 Latency(us) 00:22:39.143 [2024-11-19T14:23:37.706Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.143 Nvme1n1 : 1.08 370.23 23.14 0.00 0.00 166207.00 59419.31 124275.67 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.143 Nvme2n1 : 1.08 367.91 22.99 0.00 0.00 167897.06 44273.21 134373.07 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.143 Nvme3n1 : 1.11 392.59 24.54 0.00 0.00 158436.38 14369.37 121168.78 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.143 Nvme4n1 : 1.11 391.25 24.45 0.00 0.00 157758.99 15825.73 120392.06 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.143 Nvme5n1 : 1.11 389.98 24.37 0.00 0.00 157129.47 16117.00 120392.06 00:22:39.143 [2024-11-19T14:23:37.706Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.143 Verification LBA range: start 0x0 length 0x400 00:22:39.144 Nvme6n1 : 1.09 366.47 22.90 0.00 0.00 163705.10 35535.08 127382.57 00:22:39.144 [2024-11-19T14:23:37.707Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.144 Verification LBA range: start 0x0 length 0x400 00:22:39.144 Nvme7n1 : 1.12 388.04 24.25 0.00 0.00 156329.76 11262.48 128159.29 00:22:39.144 [2024-11-19T14:23:37.707Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.144 Verification LBA range: start 0x0 length 0x400 00:22:39.144 Nvme8n1 : 1.12 387.26 24.20 0.00 0.00 155731.33 9417.77 131266.18 00:22:39.144 [2024-11-19T14:23:37.707Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.144 Verification LBA range: start 0x0 length 0x400 00:22:39.144 Nvme9n1 : 1.12 386.53 24.16 0.00 0.00 155248.68 6699.24 133596.35 00:22:39.144 [2024-11-19T14:23:37.707Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:39.144 Verification LBA range: start 0x0 length 0x400 00:22:39.144 Nvme10n1 : 1.10 363.99 22.75 0.00 0.00 161723.92 25049.32 130489.46 00:22:39.144 [2024-11-19T14:23:37.707Z] =================================================================================================================== 00:22:39.144 [2024-11-19T14:23:37.707Z] Total : 3804.25 237.77 0.00 0.00 159850.65 6699.24 134373.07 00:22:39.144 15:23:37 -- target/shutdown.sh@93 -- # stoptarget 00:22:39.144 15:23:37 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:39.144 15:23:37 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:39.144 15:23:37 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:39.144 15:23:37 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:39.144 15:23:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:39.144 15:23:37 -- nvmf/common.sh@116 -- # sync 00:22:39.144 15:23:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:39.144 15:23:37 -- nvmf/common.sh@119 -- # set +e 00:22:39.144 15:23:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:39.144 15:23:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:39.144 rmmod nvme_tcp 00:22:39.144 rmmod nvme_fabrics 00:22:39.144 rmmod nvme_keyring 00:22:39.144 15:23:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:39.144 15:23:37 -- nvmf/common.sh@123 -- # set -e 00:22:39.144 15:23:37 -- nvmf/common.sh@124 -- # return 0 00:22:39.144 15:23:37 -- nvmf/common.sh@477 -- # '[' -n 2829677 ']' 00:22:39.144 15:23:37 -- nvmf/common.sh@478 -- # killprocess 2829677 00:22:39.144 15:23:37 -- common/autotest_common.sh@936 -- # '[' -z 2829677 ']' 00:22:39.144 15:23:37 -- common/autotest_common.sh@940 -- # kill -0 2829677 00:22:39.402 15:23:37 -- common/autotest_common.sh@941 -- # uname 00:22:39.402 15:23:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:39.402 15:23:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2829677 00:22:39.402 15:23:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:39.402 15:23:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:39.402 15:23:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2829677' 00:22:39.402 killing process with pid 2829677 00:22:39.402 15:23:37 -- common/autotest_common.sh@955 -- # kill 2829677 00:22:39.402 15:23:37 -- common/autotest_common.sh@960 -- # wait 2829677 00:22:39.967 15:23:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:39.967 15:23:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:39.967 15:23:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:39.967 15:23:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:39.967 15:23:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:39.967 15:23:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:39.967 15:23:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:39.967 15:23:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:41.888 15:23:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:41.888 00:22:41.888 real 0m12.390s 00:22:41.888 user 0m35.863s 00:22:41.888 sys 0m3.380s 00:22:41.888 15:23:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:41.888 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:22:41.888 ************************************ 00:22:41.888 END TEST nvmf_shutdown_tc1 00:22:41.888 ************************************ 00:22:41.888 15:23:40 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:41.888 15:23:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:41.888 15:23:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:41.888 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:22:41.888 ************************************ 00:22:41.888 START TEST nvmf_shutdown_tc2 00:22:41.889 ************************************ 00:22:41.889 15:23:40 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:41.889 15:23:40 -- target/shutdown.sh@98 -- # starttarget 00:22:41.889 15:23:40 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:41.889 15:23:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:41.889 15:23:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:41.889 15:23:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:41.889 15:23:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:41.889 15:23:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:41.889 15:23:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:41.889 15:23:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:41.889 15:23:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:41.889 15:23:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:41.889 15:23:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:41.889 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:22:41.889 15:23:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:41.889 15:23:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:41.889 15:23:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:41.889 15:23:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:41.889 15:23:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:41.889 15:23:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:41.889 15:23:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:41.889 15:23:40 -- nvmf/common.sh@294 -- # net_devs=() 00:22:41.889 15:23:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:41.889 15:23:40 -- nvmf/common.sh@295 -- # e810=() 00:22:41.889 15:23:40 -- nvmf/common.sh@295 -- # local -ga e810 00:22:41.889 15:23:40 -- nvmf/common.sh@296 -- # x722=() 00:22:41.889 15:23:40 -- nvmf/common.sh@296 -- # local -ga x722 00:22:41.889 15:23:40 -- nvmf/common.sh@297 -- # mlx=() 00:22:41.889 15:23:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:41.889 15:23:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:41.889 15:23:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:41.889 15:23:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:41.889 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:41.889 15:23:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:41.889 15:23:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:41.889 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:41.889 15:23:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:41.889 15:23:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:41.889 15:23:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:41.889 15:23:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:41.889 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:41.889 15:23:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:41.889 15:23:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:41.889 15:23:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:41.889 15:23:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:41.889 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:41.889 15:23:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:41.889 15:23:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:41.889 15:23:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:41.889 15:23:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:41.889 15:23:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:41.889 15:23:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:41.889 15:23:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:41.889 15:23:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:41.889 15:23:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:41.889 15:23:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:41.889 15:23:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:41.889 15:23:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:41.889 15:23:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:41.889 15:23:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:41.889 15:23:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:41.889 15:23:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:41.889 15:23:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:41.889 15:23:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:41.889 15:23:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:41.889 15:23:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:41.889 15:23:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:41.889 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:41.889 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:22:41.889 00:22:41.889 --- 10.0.0.2 ping statistics --- 00:22:41.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:41.889 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:22:41.889 15:23:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:41.889 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:41.889 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:22:41.889 00:22:41.889 --- 10.0.0.1 ping statistics --- 00:22:41.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:41.889 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:22:41.889 15:23:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:41.889 15:23:40 -- nvmf/common.sh@410 -- # return 0 00:22:41.889 15:23:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:41.889 15:23:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:41.889 15:23:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:41.889 15:23:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:41.889 15:23:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:41.889 15:23:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:42.147 15:23:40 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:42.147 15:23:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:42.147 15:23:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:42.147 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:22:42.147 15:23:40 -- nvmf/common.sh@469 -- # nvmfpid=2831088 00:22:42.147 15:23:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:42.147 15:23:40 -- nvmf/common.sh@470 -- # waitforlisten 2831088 00:22:42.147 15:23:40 -- common/autotest_common.sh@829 -- # '[' -z 2831088 ']' 00:22:42.147 15:23:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:42.147 15:23:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:42.147 15:23:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:42.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:42.147 15:23:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:42.147 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:22:42.147 [2024-11-19 15:23:40.514644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:42.148 [2024-11-19 15:23:40.514756] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:42.148 EAL: No free 2048 kB hugepages reported on node 1 00:22:42.148 [2024-11-19 15:23:40.582471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:42.148 [2024-11-19 15:23:40.698259] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:42.148 [2024-11-19 15:23:40.698441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:42.148 [2024-11-19 15:23:40.698471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:42.148 [2024-11-19 15:23:40.698492] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:42.148 [2024-11-19 15:23:40.698589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:42.148 [2024-11-19 15:23:40.698738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:42.148 [2024-11-19 15:23:40.698840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:42.148 [2024-11-19 15:23:40.698848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:43.082 15:23:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:43.082 15:23:41 -- common/autotest_common.sh@862 -- # return 0 00:22:43.082 15:23:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:43.082 15:23:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:43.082 15:23:41 -- common/autotest_common.sh@10 -- # set +x 00:22:43.082 15:23:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:43.082 15:23:41 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:43.082 15:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.082 15:23:41 -- common/autotest_common.sh@10 -- # set +x 00:22:43.082 [2024-11-19 15:23:41.500280] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:43.082 15:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.082 15:23:41 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:43.082 15:23:41 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:43.082 15:23:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:43.082 15:23:41 -- common/autotest_common.sh@10 -- # set +x 00:22:43.082 15:23:41 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:43.082 15:23:41 -- target/shutdown.sh@28 -- # cat 00:22:43.082 15:23:41 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:43.082 15:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.082 15:23:41 -- common/autotest_common.sh@10 -- # set +x 00:22:43.082 Malloc1 00:22:43.082 [2024-11-19 15:23:41.575636] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:43.082 Malloc2 00:22:43.340 Malloc3 00:22:43.340 Malloc4 00:22:43.340 Malloc5 00:22:43.340 Malloc6 00:22:43.340 Malloc7 00:22:43.340 Malloc8 00:22:43.599 Malloc9 00:22:43.599 Malloc10 00:22:43.599 15:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.599 15:23:42 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:43.599 15:23:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:43.599 15:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:43.599 15:23:42 -- target/shutdown.sh@102 -- # perfpid=2831287 00:22:43.599 15:23:42 -- target/shutdown.sh@103 -- # waitforlisten 2831287 /var/tmp/bdevperf.sock 00:22:43.599 15:23:42 -- common/autotest_common.sh@829 -- # '[' -z 2831287 ']' 00:22:43.599 15:23:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:43.599 15:23:42 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:43.599 15:23:42 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:43.599 15:23:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:43.599 15:23:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:43.599 15:23:42 -- nvmf/common.sh@520 -- # config=() 00:22:43.599 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:43.599 15:23:42 -- nvmf/common.sh@520 -- # local subsystem config 00:22:43.599 15:23:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:43.599 15:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:43.599 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.599 { 00:22:43.599 "params": { 00:22:43.599 "name": "Nvme$subsystem", 00:22:43.599 "trtype": "$TEST_TRANSPORT", 00:22:43.599 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.599 "adrfam": "ipv4", 00:22:43.599 "trsvcid": "$NVMF_PORT", 00:22:43.599 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.599 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.599 "hdgst": ${hdgst:-false}, 00:22:43.599 "ddgst": ${ddgst:-false} 00:22:43.599 }, 00:22:43.599 "method": "bdev_nvme_attach_controller" 00:22:43.599 } 00:22:43.599 EOF 00:22:43.599 )") 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.599 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.599 { 00:22:43.599 "params": { 00:22:43.599 "name": "Nvme$subsystem", 00:22:43.599 "trtype": "$TEST_TRANSPORT", 00:22:43.599 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.599 "adrfam": "ipv4", 00:22:43.599 "trsvcid": "$NVMF_PORT", 00:22:43.599 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.599 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.599 "hdgst": ${hdgst:-false}, 00:22:43.599 "ddgst": ${ddgst:-false} 00:22:43.599 }, 00:22:43.599 "method": "bdev_nvme_attach_controller" 00:22:43.599 } 00:22:43.599 EOF 00:22:43.599 )") 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.599 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.599 { 00:22:43.599 "params": { 00:22:43.599 "name": "Nvme$subsystem", 00:22:43.599 "trtype": "$TEST_TRANSPORT", 00:22:43.599 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.599 "adrfam": "ipv4", 00:22:43.599 "trsvcid": "$NVMF_PORT", 00:22:43.599 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.599 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.599 "hdgst": ${hdgst:-false}, 00:22:43.599 "ddgst": ${ddgst:-false} 00:22:43.599 }, 00:22:43.599 "method": "bdev_nvme_attach_controller" 00:22:43.599 } 00:22:43.599 EOF 00:22:43.599 )") 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.599 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.599 { 00:22:43.599 "params": { 00:22:43.599 "name": "Nvme$subsystem", 00:22:43.599 "trtype": "$TEST_TRANSPORT", 00:22:43.599 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.599 "adrfam": "ipv4", 00:22:43.599 "trsvcid": "$NVMF_PORT", 00:22:43.599 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.599 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.599 "hdgst": ${hdgst:-false}, 00:22:43.599 "ddgst": ${ddgst:-false} 00:22:43.599 }, 00:22:43.599 "method": "bdev_nvme_attach_controller" 00:22:43.599 } 00:22:43.599 EOF 00:22:43.599 )") 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.599 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.599 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.599 { 00:22:43.599 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.600 { 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.600 { 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.600 { 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.600 { 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:43.600 { 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme$subsystem", 00:22:43.600 "trtype": "$TEST_TRANSPORT", 00:22:43.600 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "$NVMF_PORT", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:43.600 "hdgst": ${hdgst:-false}, 00:22:43.600 "ddgst": ${ddgst:-false} 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 } 00:22:43.600 EOF 00:22:43.600 )") 00:22:43.600 15:23:42 -- nvmf/common.sh@542 -- # cat 00:22:43.600 15:23:42 -- nvmf/common.sh@544 -- # jq . 00:22:43.600 15:23:42 -- nvmf/common.sh@545 -- # IFS=, 00:22:43.600 15:23:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme1", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme2", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme3", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme4", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme5", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme6", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme7", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme8", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme9", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 },{ 00:22:43.600 "params": { 00:22:43.600 "name": "Nvme10", 00:22:43.600 "trtype": "tcp", 00:22:43.600 "traddr": "10.0.0.2", 00:22:43.600 "adrfam": "ipv4", 00:22:43.600 "trsvcid": "4420", 00:22:43.600 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:43.600 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:43.600 "hdgst": false, 00:22:43.600 "ddgst": false 00:22:43.600 }, 00:22:43.600 "method": "bdev_nvme_attach_controller" 00:22:43.600 }' 00:22:43.600 [2024-11-19 15:23:42.090571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:43.601 [2024-11-19 15:23:42.090645] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2831287 ] 00:22:43.601 EAL: No free 2048 kB hugepages reported on node 1 00:22:43.601 [2024-11-19 15:23:42.156340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:43.859 [2024-11-19 15:23:42.264444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:45.756 Running I/O for 10 seconds... 00:22:46.322 15:23:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.322 15:23:44 -- common/autotest_common.sh@862 -- # return 0 00:22:46.322 15:23:44 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:46.322 15:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.322 15:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:46.322 15:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.322 15:23:44 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:46.322 15:23:44 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:46.322 15:23:44 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:46.322 15:23:44 -- target/shutdown.sh@57 -- # local ret=1 00:22:46.322 15:23:44 -- target/shutdown.sh@58 -- # local i 00:22:46.322 15:23:44 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:46.322 15:23:44 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:46.322 15:23:44 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:46.322 15:23:44 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:46.322 15:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.322 15:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:46.322 15:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.322 15:23:44 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:46.322 15:23:44 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:46.322 15:23:44 -- target/shutdown.sh@64 -- # ret=0 00:22:46.322 15:23:44 -- target/shutdown.sh@65 -- # break 00:22:46.322 15:23:44 -- target/shutdown.sh@69 -- # return 0 00:22:46.322 15:23:44 -- target/shutdown.sh@109 -- # killprocess 2831287 00:22:46.322 15:23:44 -- common/autotest_common.sh@936 -- # '[' -z 2831287 ']' 00:22:46.322 15:23:44 -- common/autotest_common.sh@940 -- # kill -0 2831287 00:22:46.322 15:23:44 -- common/autotest_common.sh@941 -- # uname 00:22:46.322 15:23:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:46.322 15:23:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2831287 00:22:46.322 15:23:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:46.322 15:23:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:46.322 15:23:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2831287' 00:22:46.322 killing process with pid 2831287 00:22:46.322 15:23:44 -- common/autotest_common.sh@955 -- # kill 2831287 00:22:46.322 15:23:44 -- common/autotest_common.sh@960 -- # wait 2831287 00:22:46.322 Received shutdown signal, test time was about 0.878921 seconds 00:22:46.322 00:22:46.322 Latency(us) 00:22:46.322 [2024-11-19T14:23:44.885Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.322 Nvme1n1 : 0.87 406.86 25.43 0.00 0.00 154327.33 16796.63 121945.51 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.322 Nvme2n1 : 0.87 406.27 25.39 0.00 0.00 153265.35 16893.72 121168.78 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.322 Nvme3n1 : 0.84 374.15 23.38 0.00 0.00 163679.57 26020.22 128159.29 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.322 Nvme4n1 : 0.88 405.66 25.35 0.00 0.00 150792.97 16893.72 131266.18 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.322 Nvme5n1 : 0.88 404.30 25.27 0.00 0.00 149975.22 16214.09 135149.80 00:22:46.322 [2024-11-19T14:23:44.885Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.322 Verification LBA range: start 0x0 length 0x400 00:22:46.323 Nvme6n1 : 0.85 372.47 23.28 0.00 0.00 159831.71 26991.12 122722.23 00:22:46.323 [2024-11-19T14:23:44.886Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.323 Verification LBA range: start 0x0 length 0x400 00:22:46.323 Nvme7n1 : 0.85 370.97 23.19 0.00 0.00 159038.34 26602.76 124275.67 00:22:46.323 [2024-11-19T14:23:44.886Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.323 Verification LBA range: start 0x0 length 0x400 00:22:46.323 Nvme8n1 : 0.86 368.78 23.05 0.00 0.00 158341.53 6310.87 128159.29 00:22:46.323 [2024-11-19T14:23:44.886Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.323 Verification LBA range: start 0x0 length 0x400 00:22:46.323 Nvme9n1 : 0.87 363.39 22.71 0.00 0.00 158937.86 27962.03 130489.46 00:22:46.323 [2024-11-19T14:23:44.886Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:46.323 Verification LBA range: start 0x0 length 0x400 00:22:46.323 Nvme10n1 : 0.87 363.86 22.74 0.00 0.00 157782.64 26214.40 128159.29 00:22:46.323 [2024-11-19T14:23:44.886Z] =================================================================================================================== 00:22:46.323 [2024-11-19T14:23:44.886Z] Total : 3836.70 239.79 0.00 0.00 156380.57 6310.87 135149.80 00:22:46.581 15:23:45 -- target/shutdown.sh@112 -- # sleep 1 00:22:47.513 15:23:46 -- target/shutdown.sh@113 -- # kill -0 2831088 00:22:47.513 15:23:46 -- target/shutdown.sh@115 -- # stoptarget 00:22:47.513 15:23:46 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:47.513 15:23:46 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:47.513 15:23:46 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:47.513 15:23:46 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:47.513 15:23:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:47.513 15:23:46 -- nvmf/common.sh@116 -- # sync 00:22:47.513 15:23:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:47.513 15:23:46 -- nvmf/common.sh@119 -- # set +e 00:22:47.513 15:23:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:47.513 15:23:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:47.513 rmmod nvme_tcp 00:22:47.513 rmmod nvme_fabrics 00:22:47.513 rmmod nvme_keyring 00:22:47.513 15:23:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:47.513 15:23:46 -- nvmf/common.sh@123 -- # set -e 00:22:47.513 15:23:46 -- nvmf/common.sh@124 -- # return 0 00:22:47.513 15:23:46 -- nvmf/common.sh@477 -- # '[' -n 2831088 ']' 00:22:47.513 15:23:46 -- nvmf/common.sh@478 -- # killprocess 2831088 00:22:47.513 15:23:46 -- common/autotest_common.sh@936 -- # '[' -z 2831088 ']' 00:22:47.513 15:23:46 -- common/autotest_common.sh@940 -- # kill -0 2831088 00:22:47.513 15:23:46 -- common/autotest_common.sh@941 -- # uname 00:22:47.513 15:23:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:47.513 15:23:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2831088 00:22:47.847 15:23:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:47.847 15:23:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:47.847 15:23:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2831088' 00:22:47.847 killing process with pid 2831088 00:22:47.847 15:23:46 -- common/autotest_common.sh@955 -- # kill 2831088 00:22:47.847 15:23:46 -- common/autotest_common.sh@960 -- # wait 2831088 00:22:48.106 15:23:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:48.106 15:23:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:48.106 15:23:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:48.106 15:23:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:48.106 15:23:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:48.106 15:23:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:48.106 15:23:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:48.106 15:23:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:50.639 15:23:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:50.639 00:22:50.639 real 0m8.336s 00:22:50.639 user 0m26.283s 00:22:50.639 sys 0m1.562s 00:22:50.639 15:23:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:50.639 15:23:48 -- common/autotest_common.sh@10 -- # set +x 00:22:50.639 ************************************ 00:22:50.639 END TEST nvmf_shutdown_tc2 00:22:50.639 ************************************ 00:22:50.639 15:23:48 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:50.639 15:23:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:50.639 15:23:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:50.639 15:23:48 -- common/autotest_common.sh@10 -- # set +x 00:22:50.639 ************************************ 00:22:50.639 START TEST nvmf_shutdown_tc3 00:22:50.639 ************************************ 00:22:50.639 15:23:48 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:50.639 15:23:48 -- target/shutdown.sh@120 -- # starttarget 00:22:50.639 15:23:48 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:50.639 15:23:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:50.639 15:23:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:50.639 15:23:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:50.639 15:23:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:50.639 15:23:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:50.639 15:23:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.639 15:23:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.639 15:23:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:50.639 15:23:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:50.639 15:23:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:50.639 15:23:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:50.639 15:23:48 -- common/autotest_common.sh@10 -- # set +x 00:22:50.639 15:23:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:50.639 15:23:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:50.639 15:23:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:50.639 15:23:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:50.639 15:23:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:50.639 15:23:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:50.639 15:23:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:50.640 15:23:48 -- nvmf/common.sh@294 -- # net_devs=() 00:22:50.640 15:23:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:50.640 15:23:48 -- nvmf/common.sh@295 -- # e810=() 00:22:50.640 15:23:48 -- nvmf/common.sh@295 -- # local -ga e810 00:22:50.640 15:23:48 -- nvmf/common.sh@296 -- # x722=() 00:22:50.640 15:23:48 -- nvmf/common.sh@296 -- # local -ga x722 00:22:50.640 15:23:48 -- nvmf/common.sh@297 -- # mlx=() 00:22:50.640 15:23:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:50.640 15:23:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:50.640 15:23:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.640 15:23:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:50.640 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:50.640 15:23:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.640 15:23:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:50.640 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:50.640 15:23:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.640 15:23:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.640 15:23:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.640 15:23:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:50.640 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:50.640 15:23:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.640 15:23:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.640 15:23:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.640 15:23:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:50.640 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:50.640 15:23:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:50.640 15:23:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:50.640 15:23:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:50.640 15:23:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:50.640 15:23:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:50.640 15:23:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:50.640 15:23:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:50.640 15:23:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:50.640 15:23:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:50.640 15:23:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:50.640 15:23:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:50.640 15:23:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:50.640 15:23:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:50.640 15:23:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:50.640 15:23:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:50.640 15:23:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:50.640 15:23:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:50.640 15:23:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:50.640 15:23:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:50.640 15:23:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:50.640 15:23:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:50.640 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:50.640 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.310 ms 00:22:50.640 00:22:50.640 --- 10.0.0.2 ping statistics --- 00:22:50.640 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.640 rtt min/avg/max/mdev = 0.310/0.310/0.310/0.000 ms 00:22:50.640 15:23:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:50.640 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:50.640 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:22:50.640 00:22:50.640 --- 10.0.0.1 ping statistics --- 00:22:50.640 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.640 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:22:50.640 15:23:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:50.640 15:23:48 -- nvmf/common.sh@410 -- # return 0 00:22:50.640 15:23:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:50.640 15:23:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:50.640 15:23:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:50.640 15:23:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:50.640 15:23:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:50.640 15:23:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:50.640 15:23:48 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:50.640 15:23:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:50.640 15:23:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:50.640 15:23:48 -- common/autotest_common.sh@10 -- # set +x 00:22:50.640 15:23:48 -- nvmf/common.sh@469 -- # nvmfpid=2832250 00:22:50.640 15:23:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:50.640 15:23:48 -- nvmf/common.sh@470 -- # waitforlisten 2832250 00:22:50.640 15:23:48 -- common/autotest_common.sh@829 -- # '[' -z 2832250 ']' 00:22:50.640 15:23:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:50.640 15:23:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:50.640 15:23:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:50.640 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:50.640 15:23:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:50.640 15:23:48 -- common/autotest_common.sh@10 -- # set +x 00:22:50.640 [2024-11-19 15:23:48.889818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:50.640 [2024-11-19 15:23:48.889892] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:50.640 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.640 [2024-11-19 15:23:48.959295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:50.640 [2024-11-19 15:23:49.074491] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:50.640 [2024-11-19 15:23:49.074673] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:50.640 [2024-11-19 15:23:49.074712] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:50.640 [2024-11-19 15:23:49.074736] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:50.640 [2024-11-19 15:23:49.074856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:50.640 [2024-11-19 15:23:49.074954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:50.640 [2024-11-19 15:23:49.075090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:50.640 [2024-11-19 15:23:49.075098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:51.573 15:23:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:51.573 15:23:49 -- common/autotest_common.sh@862 -- # return 0 00:22:51.573 15:23:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:51.573 15:23:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:51.573 15:23:49 -- common/autotest_common.sh@10 -- # set +x 00:22:51.573 15:23:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:51.573 15:23:49 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:51.573 15:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.573 15:23:49 -- common/autotest_common.sh@10 -- # set +x 00:22:51.573 [2024-11-19 15:23:49.866157] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:51.573 15:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.573 15:23:49 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:51.573 15:23:49 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:51.573 15:23:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:51.573 15:23:49 -- common/autotest_common.sh@10 -- # set +x 00:22:51.573 15:23:49 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:51.573 15:23:49 -- target/shutdown.sh@28 -- # cat 00:22:51.573 15:23:49 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:51.573 15:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.573 15:23:49 -- common/autotest_common.sh@10 -- # set +x 00:22:51.573 Malloc1 00:22:51.573 [2024-11-19 15:23:49.941314] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:51.573 Malloc2 00:22:51.573 Malloc3 00:22:51.573 Malloc4 00:22:51.573 Malloc5 00:22:51.831 Malloc6 00:22:51.831 Malloc7 00:22:51.831 Malloc8 00:22:51.831 Malloc9 00:22:51.831 Malloc10 00:22:51.831 15:23:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.831 15:23:50 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:51.831 15:23:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:51.831 15:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:52.090 15:23:50 -- target/shutdown.sh@124 -- # perfpid=2832523 00:22:52.090 15:23:50 -- target/shutdown.sh@125 -- # waitforlisten 2832523 /var/tmp/bdevperf.sock 00:22:52.090 15:23:50 -- common/autotest_common.sh@829 -- # '[' -z 2832523 ']' 00:22:52.090 15:23:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:52.090 15:23:50 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:52.090 15:23:50 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:52.090 15:23:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:52.090 15:23:50 -- nvmf/common.sh@520 -- # config=() 00:22:52.090 15:23:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:52.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:52.090 15:23:50 -- nvmf/common.sh@520 -- # local subsystem config 00:22:52.090 15:23:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- common/autotest_common.sh@10 -- # set +x 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.090 } 00:22:52.090 EOF 00:22:52.090 )") 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.090 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.090 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.090 { 00:22:52.090 "params": { 00:22:52.090 "name": "Nvme$subsystem", 00:22:52.090 "trtype": "$TEST_TRANSPORT", 00:22:52.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.090 "adrfam": "ipv4", 00:22:52.090 "trsvcid": "$NVMF_PORT", 00:22:52.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.090 "hdgst": ${hdgst:-false}, 00:22:52.090 "ddgst": ${ddgst:-false} 00:22:52.090 }, 00:22:52.090 "method": "bdev_nvme_attach_controller" 00:22:52.091 } 00:22:52.091 EOF 00:22:52.091 )") 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.091 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.091 { 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme$subsystem", 00:22:52.091 "trtype": "$TEST_TRANSPORT", 00:22:52.091 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "$NVMF_PORT", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.091 "hdgst": ${hdgst:-false}, 00:22:52.091 "ddgst": ${ddgst:-false} 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 } 00:22:52.091 EOF 00:22:52.091 )") 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.091 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.091 { 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme$subsystem", 00:22:52.091 "trtype": "$TEST_TRANSPORT", 00:22:52.091 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "$NVMF_PORT", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.091 "hdgst": ${hdgst:-false}, 00:22:52.091 "ddgst": ${ddgst:-false} 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 } 00:22:52.091 EOF 00:22:52.091 )") 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.091 15:23:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:52.091 { 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme$subsystem", 00:22:52.091 "trtype": "$TEST_TRANSPORT", 00:22:52.091 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "$NVMF_PORT", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:52.091 "hdgst": ${hdgst:-false}, 00:22:52.091 "ddgst": ${ddgst:-false} 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 } 00:22:52.091 EOF 00:22:52.091 )") 00:22:52.091 15:23:50 -- nvmf/common.sh@542 -- # cat 00:22:52.091 15:23:50 -- nvmf/common.sh@544 -- # jq . 00:22:52.091 15:23:50 -- nvmf/common.sh@545 -- # IFS=, 00:22:52.091 15:23:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme1", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme2", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme3", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme4", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme5", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme6", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme7", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme8", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme9", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 },{ 00:22:52.091 "params": { 00:22:52.091 "name": "Nvme10", 00:22:52.091 "trtype": "tcp", 00:22:52.091 "traddr": "10.0.0.2", 00:22:52.091 "adrfam": "ipv4", 00:22:52.091 "trsvcid": "4420", 00:22:52.091 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:52.091 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:52.091 "hdgst": false, 00:22:52.091 "ddgst": false 00:22:52.091 }, 00:22:52.091 "method": "bdev_nvme_attach_controller" 00:22:52.091 }' 00:22:52.091 [2024-11-19 15:23:50.458797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.091 [2024-11-19 15:23:50.458874] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2832523 ] 00:22:52.091 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.091 [2024-11-19 15:23:50.522832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:52.091 [2024-11-19 15:23:50.631055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:53.990 Running I/O for 10 seconds... 00:22:54.571 15:23:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:54.571 15:23:52 -- common/autotest_common.sh@862 -- # return 0 00:22:54.571 15:23:52 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:54.571 15:23:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.571 15:23:52 -- common/autotest_common.sh@10 -- # set +x 00:22:54.571 15:23:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.571 15:23:52 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:54.571 15:23:52 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:54.571 15:23:52 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:54.571 15:23:52 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:54.571 15:23:52 -- target/shutdown.sh@57 -- # local ret=1 00:22:54.571 15:23:52 -- target/shutdown.sh@58 -- # local i 00:22:54.571 15:23:52 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:54.571 15:23:52 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:54.571 15:23:52 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:54.571 15:23:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.571 15:23:52 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:54.571 15:23:52 -- common/autotest_common.sh@10 -- # set +x 00:22:54.571 15:23:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.571 15:23:52 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:54.571 15:23:52 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:54.571 15:23:52 -- target/shutdown.sh@64 -- # ret=0 00:22:54.571 15:23:52 -- target/shutdown.sh@65 -- # break 00:22:54.571 15:23:52 -- target/shutdown.sh@69 -- # return 0 00:22:54.571 15:23:52 -- target/shutdown.sh@134 -- # killprocess 2832250 00:22:54.571 15:23:52 -- common/autotest_common.sh@936 -- # '[' -z 2832250 ']' 00:22:54.571 15:23:52 -- common/autotest_common.sh@940 -- # kill -0 2832250 00:22:54.571 15:23:52 -- common/autotest_common.sh@941 -- # uname 00:22:54.571 15:23:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:54.571 15:23:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2832250 00:22:54.571 15:23:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:54.571 15:23:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:54.571 15:23:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2832250' 00:22:54.571 killing process with pid 2832250 00:22:54.571 15:23:53 -- common/autotest_common.sh@955 -- # kill 2832250 00:22:54.571 15:23:53 -- common/autotest_common.sh@960 -- # wait 2832250 00:22:54.571 [2024-11-19 15:23:53.034348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38cb0 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.034477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38cb0 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.034503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38cb0 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.034517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38cb0 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.034529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38cb0 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.571 [2024-11-19 15:23:53.035835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.035993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.036155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36790 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.037520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f36c40 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.038999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.572 [2024-11-19 15:23:53.039254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.039550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37560 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.040987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.573 [2024-11-19 15:23:53.041365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.041506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37a10 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.042991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.574 [2024-11-19 15:23:53.043531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.043610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f37ec0 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.044983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.045997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.046155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38350 is same with the state(5) to be set 00:22:54.575 [2024-11-19 15:23:53.047003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.576 [2024-11-19 15:23:53.047761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.047773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.047784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.047797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f38800 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.054975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19f0c70 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.055226] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19f1150 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.055400] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055490] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a01600 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.055562] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183dcd0 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.055742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055811] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055839] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19dc0a0 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.055913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.055962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.055987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056014] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1893590 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.056088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056176] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.577 [2024-11-19 15:23:53.056190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.577 [2024-11-19 15:23:53.056203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183af70 is same with the state(5) to be set 00:22:54.577 [2024-11-19 15:23:53.056246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185d1b0 is same with the state(5) to be set 00:22:54.578 [2024-11-19 15:23:53.056415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056479] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19eba60 is same with the state(5) to be set 00:22:54.578 [2024-11-19 15:23:53.056608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056670] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056716] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:54.578 [2024-11-19 15:23:53.056730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1888490 is same with the state(5) to be set 00:22:54.578 [2024-11-19 15:23:53.056825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.056847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.056889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.056921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.056952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.056968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.056991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.578 [2024-11-19 15:23:53.057464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.578 [2024-11-19 15:23:53.057478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.057966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.057980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.579 [2024-11-19 15:23:53.058563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.579 [2024-11-19 15:23:53.058578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.058836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.058850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a7f260 is same with the state(5) to be set 00:22:54.580 [2024-11-19 15:23:53.058932] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a7f260 was disconnected and freed. reset controller. 00:22:54.580 [2024-11-19 15:23:53.059167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.580 [2024-11-19 15:23:53.059928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.580 [2024-11-19 15:23:53.059943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.059957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.059973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.059994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.581 [2024-11-19 15:23:53.060876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.581 [2024-11-19 15:23:53.060891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.060905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.060921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.060935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.060950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.060964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.060990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.061189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.061271] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19c71a0 was disconnected and freed. reset controller. 00:22:54.582 [2024-11-19 15:23:53.070298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.070980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.070995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.071010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.071025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.071047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.071064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.071079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.071094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.071108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.582 [2024-11-19 15:23:53.071124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.582 [2024-11-19 15:23:53.071138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.071978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.071994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.583 [2024-11-19 15:23:53.072205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.583 [2024-11-19 15:23:53.072220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.072249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.072278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.072318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.072346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.072376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.072391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a91580 is same with the state(5) to be set 00:22:54.584 [2024-11-19 15:23:53.073191] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a91580 was disconnected and freed. reset controller. 00:22:54.584 [2024-11-19 15:23:53.073289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f0c70 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f1150 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a01600 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183dcd0 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19dc0a0 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1893590 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183af70 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185d1b0 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19eba60 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.073532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1888490 (9): Bad file descriptor 00:22:54.584 [2024-11-19 15:23:53.075976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.584 [2024-11-19 15:23:53.076707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.584 [2024-11-19 15:23:53.076723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.076983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.076998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.585 [2024-11-19 15:23:53.077751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.585 [2024-11-19 15:23:53.077765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.077976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.077992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.078006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.078025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19c86f0 is same with the state(5) to be set 00:22:54.586 [2024-11-19 15:23:53.078113] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19c86f0 was disconnected and freed. reset controller. 00:22:54.586 [2024-11-19 15:23:53.079607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:54.586 [2024-11-19 15:23:53.081204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:54.586 [2024-11-19 15:23:53.081382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.081486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.081512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183af70 with addr=10.0.0.2, port=4420 00:22:54.586 [2024-11-19 15:23:53.081529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183af70 is same with the state(5) to be set 00:22:54.586 [2024-11-19 15:23:53.081894] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.082256] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.082326] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.082400] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.082465] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.082833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:54.586 [2024-11-19 15:23:53.082862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:54.586 [2024-11-19 15:23:53.082977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.083106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.083133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185d1b0 with addr=10.0.0.2, port=4420 00:22:54.586 [2024-11-19 15:23:53.083150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185d1b0 is same with the state(5) to be set 00:22:54.586 [2024-11-19 15:23:53.083174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183af70 (9): Bad file descriptor 00:22:54.586 [2024-11-19 15:23:53.083627] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:54.586 [2024-11-19 15:23:53.083762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.083859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.083884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1893590 with addr=10.0.0.2, port=4420 00:22:54.586 [2024-11-19 15:23:53.083901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1893590 is same with the state(5) to be set 00:22:54.586 [2024-11-19 15:23:53.083981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.084079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.586 [2024-11-19 15:23:53.084105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183dcd0 with addr=10.0.0.2, port=4420 00:22:54.586 [2024-11-19 15:23:53.084121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183dcd0 is same with the state(5) to be set 00:22:54.586 [2024-11-19 15:23:53.084140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185d1b0 (9): Bad file descriptor 00:22:54.586 [2024-11-19 15:23:53.084159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:54.586 [2024-11-19 15:23:53.084173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:54.586 [2024-11-19 15:23:53.084201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:54.586 [2024-11-19 15:23:53.084374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.586 [2024-11-19 15:23:53.084427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1893590 (9): Bad file descriptor 00:22:54.586 [2024-11-19 15:23:53.084451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183dcd0 (9): Bad file descriptor 00:22:54.586 [2024-11-19 15:23:53.084469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:54.586 [2024-11-19 15:23:53.084482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:54.586 [2024-11-19 15:23:53.084497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:54.586 [2024-11-19 15:23:53.084561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.084584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.084612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.084629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.084646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.084661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.084676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.586 [2024-11-19 15:23:53.084699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.586 [2024-11-19 15:23:53.084718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.084981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.084996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.587 [2024-11-19 15:23:53.085830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.587 [2024-11-19 15:23:53.085844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.085860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.085874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.085889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.085903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.085918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.085941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.085956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.085971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.085987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.086559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.086574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x182b550 is same with the state(5) to be set 00:22:54.588 [2024-11-19 15:23:53.087850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.087874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.087895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.087911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.087928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.087942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.087958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.087972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.087988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.088002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.088018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.588 [2024-11-19 15:23:53.088032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.588 [2024-11-19 15:23:53.088048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.088985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.088999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.589 [2024-11-19 15:23:53.089162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.589 [2024-11-19 15:23:53.089176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.089831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.089846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8a950 is same with the state(5) to be set 00:22:54.590 [2024-11-19 15:23:53.091091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.590 [2024-11-19 15:23:53.091368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.590 [2024-11-19 15:23:53.091384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.091975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.091991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.591 [2024-11-19 15:23:53.092371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.591 [2024-11-19 15:23:53.092387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.092979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.092994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.093008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.093024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.093038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.093054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.093069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.093084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.093098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.093113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8be00 is same with the state(5) to be set 00:22:54.592 [2024-11-19 15:23:53.094316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.094339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.094359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.094375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.094392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.592 [2024-11-19 15:23:53.094407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.592 [2024-11-19 15:23:53.094423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.094980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.094995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.593 [2024-11-19 15:23:53.095528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.593 [2024-11-19 15:23:53.095542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.095979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.095994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.096329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.096344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8d3e0 is same with the state(5) to be set 00:22:54.594 [2024-11-19 15:23:53.097557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.594 [2024-11-19 15:23:53.097755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.594 [2024-11-19 15:23:53.097771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.097967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.097987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.595 [2024-11-19 15:23:53.098808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.595 [2024-11-19 15:23:53.098824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.098859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.098889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.098919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.098950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.098980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.098993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.099575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.099589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8e9c0 is same with the state(5) to be set 00:22:54.596 [2024-11-19 15:23:53.100812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.100835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.100856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.100872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.100889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.100903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.100919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.100934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.100951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.100965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.100990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.101004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.101021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.101035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.101051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.101066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.101081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.596 [2024-11-19 15:23:53.101095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.596 [2024-11-19 15:23:53.101111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.101971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.597 [2024-11-19 15:23:53.101986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.597 [2024-11-19 15:23:53.102001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:54.598 [2024-11-19 15:23:53.102847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:54.598 [2024-11-19 15:23:53.102861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8ffa0 is same with the state(5) to be set 00:22:54.598 [2024-11-19 15:23:53.104398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.598 [2024-11-19 15:23:53.104427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:54.598 [2024-11-19 15:23:53.104449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:54.598 [2024-11-19 15:23:53.104469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:54.598 [2024-11-19 15:23:53.104535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:54.598 [2024-11-19 15:23:53.104552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:54.598 [2024-11-19 15:23:53.104569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:54.598 [2024-11-19 15:23:53.104592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:54.598 [2024-11-19 15:23:53.104606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:54.598 [2024-11-19 15:23:53.104620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:54.598 [2024-11-19 15:23:53.104700] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.598 [2024-11-19 15:23:53.104725] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.598 [2024-11-19 15:23:53.104745] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.598 [2024-11-19 15:23:53.104770] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.598 [2024-11-19 15:23:53.104789] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.598 [2024-11-19 15:23:53.104893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:54.598 [2024-11-19 15:23:53.104917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:54.858 task offset: 34816 on job bdev=Nvme1n1 fails 00:22:54.858 00:22:54.858 Latency(us) 00:22:54.858 [2024-11-19T14:23:53.421Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:54.858 [2024-11-19T14:23:53.421Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.858 [2024-11-19T14:23:53.421Z] Job: Nvme1n1 ended in about 0.70 seconds with error 00:22:54.858 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme1n1 : 0.70 360.95 22.56 92.04 0.00 140260.14 35535.08 117285.17 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme2n1 ended in about 0.71 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme2n1 : 0.71 293.63 18.35 90.35 0.00 163736.75 8009.96 169325.61 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme3n1 ended in about 0.70 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme3n1 : 0.70 360.33 22.52 91.88 0.00 137413.08 28156.21 133596.35 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme4n1 ended in about 0.70 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme4n1 : 0.70 357.78 22.36 91.23 0.00 136930.40 10485.76 121945.51 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme5n1 ended in about 0.71 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme5n1 : 0.71 292.30 18.27 89.94 0.00 159252.48 94760.20 139033.41 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme6n1 ended in about 0.71 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme6n1 : 0.71 290.97 18.19 89.53 0.00 158251.59 85439.53 132819.63 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme7n1 ended in about 0.72 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme7n1 : 0.72 289.67 18.10 89.13 0.00 157286.40 87769.69 134373.07 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme8n1 ended in about 0.72 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme8n1 : 0.72 288.36 18.02 88.73 0.00 156208.41 88546.42 125052.40 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme9n1 ended in about 0.72 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme9n1 : 0.72 287.07 17.94 88.33 0.00 155215.38 93206.76 122722.23 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:54.859 [2024-11-19T14:23:53.422Z] Job: Nvme10n1 ended in about 0.70 seconds with error 00:22:54.859 Verification LBA range: start 0x0 length 0x400 00:22:54.859 Nvme10n1 : 0.70 297.03 18.56 91.40 0.00 147707.65 23884.23 160781.65 00:22:54.859 [2024-11-19T14:23:53.422Z] =================================================================================================================== 00:22:54.859 [2024-11-19T14:23:53.422Z] Total : 3118.09 194.88 902.53 0.00 150636.47 8009.96 169325.61 00:22:54.859 [2024-11-19 15:23:53.131655] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:54.859 [2024-11-19 15:23:53.131772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:54.859 [2024-11-19 15:23:53.131806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.859 [2024-11-19 15:23:53.131823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.859 [2024-11-19 15:23:53.132097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a01600 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.132249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a01600 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.132336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19f1150 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.132484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19f1150 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.132571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.132713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19dc0a0 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.132730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19dc0a0 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.134443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:54.859 [2024-11-19 15:23:53.134617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.134734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.134761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19eba60 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.134778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19eba60 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.134868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.134969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.135001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19f0c70 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.135017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19f0c70 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.135114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.135193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.135218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1888490 with addr=10.0.0.2, port=4420 00:22:54.859 [2024-11-19 15:23:53.135234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1888490 is same with the state(5) to be set 00:22:54.859 [2024-11-19 15:23:53.135259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a01600 (9): Bad file descriptor 00:22:54.859 [2024-11-19 15:23:53.135283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f1150 (9): Bad file descriptor 00:22:54.859 [2024-11-19 15:23:53.135301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19dc0a0 (9): Bad file descriptor 00:22:54.859 [2024-11-19 15:23:53.135352] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.859 [2024-11-19 15:23:53.135398] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.859 [2024-11-19 15:23:53.135425] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.859 [2024-11-19 15:23:53.135445] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:54.859 [2024-11-19 15:23:53.135522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:54.859 [2024-11-19 15:23:53.135652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.859 [2024-11-19 15:23:53.135746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.135772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183af70 with addr=10.0.0.2, port=4420 00:22:54.860 [2024-11-19 15:23:53.135789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183af70 is same with the state(5) to be set 00:22:54.860 [2024-11-19 15:23:53.135807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19eba60 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.135826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f0c70 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.135846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1888490 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.135863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.135877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.135898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:54.860 [2024-11-19 15:23:53.135918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.135934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.135948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:54.860 [2024-11-19 15:23:53.135964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.135977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.135991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:54.860 [2024-11-19 15:23:53.136078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:54.860 [2024-11-19 15:23:53.136102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:54.860 [2024-11-19 15:23:53.136119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.136330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.136355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185d1b0 with addr=10.0.0.2, port=4420 00:22:54.860 [2024-11-19 15:23:53.136372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185d1b0 is same with the state(5) to be set 00:22:54.860 [2024-11-19 15:23:53.136390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183af70 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.136407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.136421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.136434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:54.860 [2024-11-19 15:23:53.136452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.136466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.136479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:54.860 [2024-11-19 15:23:53.136494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.136508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.136521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:54.860 [2024-11-19 15:23:53.136562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.136671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.136759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.136784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183dcd0 with addr=10.0.0.2, port=4420 00:22:54.860 [2024-11-19 15:23:53.136805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x183dcd0 is same with the state(5) to be set 00:22:54.860 [2024-11-19 15:23:53.136879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.136996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:54.860 [2024-11-19 15:23:53.137022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1893590 with addr=10.0.0.2, port=4420 00:22:54.860 [2024-11-19 15:23:53.137038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1893590 is same with the state(5) to be set 00:22:54.860 [2024-11-19 15:23:53.137057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185d1b0 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.137073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.137087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.137100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:54.860 [2024-11-19 15:23:53.137140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.137162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183dcd0 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.137181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1893590 (9): Bad file descriptor 00:22:54.860 [2024-11-19 15:23:53.137197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.137209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.137223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:54.860 [2024-11-19 15:23:53.137261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.137280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.137293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.137306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:54.860 [2024-11-19 15:23:53.137322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:54.860 [2024-11-19 15:23:53.137336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:54.860 [2024-11-19 15:23:53.137349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:54.860 [2024-11-19 15:23:53.137385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:54.860 [2024-11-19 15:23:53.137402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:55.119 15:23:53 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:55.119 15:23:53 -- target/shutdown.sh@138 -- # sleep 1 00:22:56.055 15:23:54 -- target/shutdown.sh@141 -- # kill -9 2832523 00:22:56.055 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2832523) - No such process 00:22:56.055 15:23:54 -- target/shutdown.sh@141 -- # true 00:22:56.055 15:23:54 -- target/shutdown.sh@143 -- # stoptarget 00:22:56.055 15:23:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:56.055 15:23:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:56.055 15:23:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:56.055 15:23:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:56.055 15:23:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:56.055 15:23:54 -- nvmf/common.sh@116 -- # sync 00:22:56.055 15:23:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:56.055 15:23:54 -- nvmf/common.sh@119 -- # set +e 00:22:56.055 15:23:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:56.055 15:23:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:56.314 rmmod nvme_tcp 00:22:56.314 rmmod nvme_fabrics 00:22:56.314 rmmod nvme_keyring 00:22:56.314 15:23:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:56.314 15:23:54 -- nvmf/common.sh@123 -- # set -e 00:22:56.314 15:23:54 -- nvmf/common.sh@124 -- # return 0 00:22:56.314 15:23:54 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:56.314 15:23:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:56.314 15:23:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:56.314 15:23:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:56.314 15:23:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:56.314 15:23:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:56.314 15:23:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:56.314 15:23:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:56.314 15:23:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:58.219 15:23:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:58.219 00:22:58.219 real 0m8.025s 00:22:58.219 user 0m20.787s 00:22:58.219 sys 0m1.492s 00:22:58.219 15:23:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:58.219 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 ************************************ 00:22:58.219 END TEST nvmf_shutdown_tc3 00:22:58.219 ************************************ 00:22:58.219 15:23:56 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:58.219 00:22:58.219 real 0m28.975s 00:22:58.219 user 1m23.071s 00:22:58.219 sys 0m6.540s 00:22:58.219 15:23:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:58.219 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 ************************************ 00:22:58.219 END TEST nvmf_shutdown 00:22:58.219 ************************************ 00:22:58.219 15:23:56 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:58.219 15:23:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.219 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 15:23:56 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:58.219 15:23:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:58.219 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 15:23:56 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:58.219 15:23:56 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:58.219 15:23:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:58.219 15:23:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:58.219 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 ************************************ 00:22:58.219 START TEST nvmf_multicontroller 00:22:58.219 ************************************ 00:22:58.219 15:23:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:58.478 * Looking for test storage... 00:22:58.478 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:58.478 15:23:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:58.478 15:23:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:58.478 15:23:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:58.478 15:23:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:58.478 15:23:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:58.478 15:23:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:58.478 15:23:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:58.478 15:23:56 -- scripts/common.sh@335 -- # IFS=.-: 00:22:58.478 15:23:56 -- scripts/common.sh@335 -- # read -ra ver1 00:22:58.478 15:23:56 -- scripts/common.sh@336 -- # IFS=.-: 00:22:58.478 15:23:56 -- scripts/common.sh@336 -- # read -ra ver2 00:22:58.478 15:23:56 -- scripts/common.sh@337 -- # local 'op=<' 00:22:58.478 15:23:56 -- scripts/common.sh@339 -- # ver1_l=2 00:22:58.478 15:23:56 -- scripts/common.sh@340 -- # ver2_l=1 00:22:58.478 15:23:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:58.478 15:23:56 -- scripts/common.sh@343 -- # case "$op" in 00:22:58.478 15:23:56 -- scripts/common.sh@344 -- # : 1 00:22:58.478 15:23:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:58.478 15:23:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:58.478 15:23:56 -- scripts/common.sh@364 -- # decimal 1 00:22:58.478 15:23:56 -- scripts/common.sh@352 -- # local d=1 00:22:58.478 15:23:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:58.478 15:23:56 -- scripts/common.sh@354 -- # echo 1 00:22:58.478 15:23:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:58.478 15:23:56 -- scripts/common.sh@365 -- # decimal 2 00:22:58.478 15:23:56 -- scripts/common.sh@352 -- # local d=2 00:22:58.478 15:23:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:58.478 15:23:56 -- scripts/common.sh@354 -- # echo 2 00:22:58.478 15:23:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:58.478 15:23:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:58.478 15:23:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:58.478 15:23:56 -- scripts/common.sh@367 -- # return 0 00:22:58.478 15:23:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:58.478 15:23:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:58.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.478 --rc genhtml_branch_coverage=1 00:22:58.478 --rc genhtml_function_coverage=1 00:22:58.478 --rc genhtml_legend=1 00:22:58.478 --rc geninfo_all_blocks=1 00:22:58.478 --rc geninfo_unexecuted_blocks=1 00:22:58.478 00:22:58.478 ' 00:22:58.478 15:23:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:58.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.478 --rc genhtml_branch_coverage=1 00:22:58.478 --rc genhtml_function_coverage=1 00:22:58.478 --rc genhtml_legend=1 00:22:58.478 --rc geninfo_all_blocks=1 00:22:58.478 --rc geninfo_unexecuted_blocks=1 00:22:58.478 00:22:58.478 ' 00:22:58.478 15:23:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:58.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.478 --rc genhtml_branch_coverage=1 00:22:58.478 --rc genhtml_function_coverage=1 00:22:58.478 --rc genhtml_legend=1 00:22:58.478 --rc geninfo_all_blocks=1 00:22:58.478 --rc geninfo_unexecuted_blocks=1 00:22:58.478 00:22:58.478 ' 00:22:58.478 15:23:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:58.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:58.478 --rc genhtml_branch_coverage=1 00:22:58.478 --rc genhtml_function_coverage=1 00:22:58.478 --rc genhtml_legend=1 00:22:58.478 --rc geninfo_all_blocks=1 00:22:58.478 --rc geninfo_unexecuted_blocks=1 00:22:58.478 00:22:58.478 ' 00:22:58.478 15:23:56 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:58.478 15:23:56 -- nvmf/common.sh@7 -- # uname -s 00:22:58.478 15:23:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:58.478 15:23:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:58.478 15:23:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:58.478 15:23:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:58.478 15:23:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:58.478 15:23:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:58.478 15:23:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:58.478 15:23:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:58.478 15:23:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:58.478 15:23:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:58.478 15:23:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:58.478 15:23:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:58.478 15:23:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:58.478 15:23:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:58.478 15:23:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:58.478 15:23:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:58.478 15:23:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:58.478 15:23:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:58.478 15:23:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:58.478 15:23:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.478 15:23:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.478 15:23:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.478 15:23:56 -- paths/export.sh@5 -- # export PATH 00:22:58.478 15:23:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:58.478 15:23:56 -- nvmf/common.sh@46 -- # : 0 00:22:58.478 15:23:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:58.478 15:23:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:58.478 15:23:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:58.478 15:23:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:58.478 15:23:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:58.478 15:23:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:58.478 15:23:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:58.478 15:23:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:58.478 15:23:56 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:58.479 15:23:56 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:58.479 15:23:56 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:58.479 15:23:56 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:58.479 15:23:56 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:58.479 15:23:56 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:58.479 15:23:56 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:58.479 15:23:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:58.479 15:23:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:58.479 15:23:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:58.479 15:23:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:58.479 15:23:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:58.479 15:23:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.479 15:23:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.479 15:23:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:58.479 15:23:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:58.479 15:23:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:58.479 15:23:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:58.479 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.381 15:23:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:00.381 15:23:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:00.381 15:23:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:00.381 15:23:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:00.381 15:23:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:00.381 15:23:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:00.381 15:23:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:00.381 15:23:58 -- nvmf/common.sh@294 -- # net_devs=() 00:23:00.381 15:23:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:00.381 15:23:58 -- nvmf/common.sh@295 -- # e810=() 00:23:00.381 15:23:58 -- nvmf/common.sh@295 -- # local -ga e810 00:23:00.381 15:23:58 -- nvmf/common.sh@296 -- # x722=() 00:23:00.381 15:23:58 -- nvmf/common.sh@296 -- # local -ga x722 00:23:00.381 15:23:58 -- nvmf/common.sh@297 -- # mlx=() 00:23:00.381 15:23:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:00.381 15:23:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:00.381 15:23:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:00.381 15:23:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:00.381 15:23:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:00.381 15:23:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.381 15:23:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:00.381 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:00.381 15:23:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:00.381 15:23:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:00.381 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:00.381 15:23:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:00.381 15:23:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:00.381 15:23:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:00.382 15:23:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.382 15:23:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.382 15:23:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.382 15:23:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.382 15:23:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:00.382 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:00.382 15:23:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.382 15:23:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:00.382 15:23:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.382 15:23:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:00.382 15:23:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.382 15:23:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:00.382 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:00.382 15:23:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.382 15:23:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:00.382 15:23:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:00.382 15:23:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:00.382 15:23:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:00.382 15:23:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:00.382 15:23:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:00.382 15:23:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:00.382 15:23:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:00.382 15:23:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:00.382 15:23:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:00.382 15:23:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:00.382 15:23:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:00.382 15:23:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:00.382 15:23:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:00.382 15:23:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:00.382 15:23:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:00.382 15:23:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:00.382 15:23:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:00.642 15:23:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:00.642 15:23:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:00.642 15:23:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:00.642 15:23:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:00.642 15:23:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:00.642 15:23:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:00.642 15:23:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:00.642 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:00.642 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:23:00.642 00:23:00.642 --- 10.0.0.2 ping statistics --- 00:23:00.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.642 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:23:00.642 15:23:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:00.642 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:00.642 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:23:00.642 00:23:00.642 --- 10.0.0.1 ping statistics --- 00:23:00.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:00.642 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:23:00.642 15:23:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:00.642 15:23:59 -- nvmf/common.sh@410 -- # return 0 00:23:00.642 15:23:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:00.642 15:23:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:00.642 15:23:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:00.642 15:23:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:00.642 15:23:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:00.642 15:23:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:00.642 15:23:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:00.642 15:23:59 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:00.642 15:23:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:00.642 15:23:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:00.642 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:23:00.642 15:23:59 -- nvmf/common.sh@469 -- # nvmfpid=2835077 00:23:00.642 15:23:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:00.642 15:23:59 -- nvmf/common.sh@470 -- # waitforlisten 2835077 00:23:00.642 15:23:59 -- common/autotest_common.sh@829 -- # '[' -z 2835077 ']' 00:23:00.642 15:23:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:00.642 15:23:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:00.642 15:23:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:00.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:00.642 15:23:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:00.642 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:23:00.901 [2024-11-19 15:23:59.220453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:00.901 [2024-11-19 15:23:59.220550] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:00.901 EAL: No free 2048 kB hugepages reported on node 1 00:23:00.901 [2024-11-19 15:23:59.289722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:00.901 [2024-11-19 15:23:59.403803] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:00.901 [2024-11-19 15:23:59.403993] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:00.901 [2024-11-19 15:23:59.404013] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:00.901 [2024-11-19 15:23:59.404029] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:00.901 [2024-11-19 15:23:59.404137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:00.901 [2024-11-19 15:23:59.404233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:00.901 [2024-11-19 15:23:59.404236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:01.836 15:24:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:01.836 15:24:00 -- common/autotest_common.sh@862 -- # return 0 00:23:01.836 15:24:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:01.836 15:24:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:01.836 15:24:00 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 [2024-11-19 15:24:00.209249] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 Malloc0 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 [2024-11-19 15:24:00.277160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 [2024-11-19 15:24:00.285043] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 Malloc1 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:01.836 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:01.836 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.836 15:24:00 -- host/multicontroller.sh@44 -- # bdevperf_pid=2835269 00:23:01.836 15:24:00 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:01.836 15:24:00 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:01.836 15:24:00 -- host/multicontroller.sh@47 -- # waitforlisten 2835269 /var/tmp/bdevperf.sock 00:23:01.836 15:24:00 -- common/autotest_common.sh@829 -- # '[' -z 2835269 ']' 00:23:01.836 15:24:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:01.836 15:24:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:01.836 15:24:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:01.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:01.836 15:24:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:01.836 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:23:03.208 15:24:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.208 15:24:01 -- common/autotest_common.sh@862 -- # return 0 00:23:03.208 15:24:01 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:03.208 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.208 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.208 NVMe0n1 00:23:03.208 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.208 15:24:01 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:03.208 15:24:01 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:03.208 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.208 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.208 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.208 1 00:23:03.208 15:24:01 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.208 15:24:01 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.208 15:24:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.208 15:24:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.208 15:24:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:03.208 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.208 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.208 request: 00:23:03.208 { 00:23:03.208 "name": "NVMe0", 00:23:03.208 "trtype": "tcp", 00:23:03.208 "traddr": "10.0.0.2", 00:23:03.208 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:03.208 "hostaddr": "10.0.0.2", 00:23:03.208 "hostsvcid": "60000", 00:23:03.208 "adrfam": "ipv4", 00:23:03.208 "trsvcid": "4420", 00:23:03.208 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.208 "method": "bdev_nvme_attach_controller", 00:23:03.208 "req_id": 1 00:23:03.208 } 00:23:03.208 Got JSON-RPC error response 00:23:03.208 response: 00:23:03.208 { 00:23:03.208 "code": -114, 00:23:03.208 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.208 } 00:23:03.208 15:24:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.208 15:24:01 -- common/autotest_common.sh@653 -- # es=1 00:23:03.208 15:24:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.208 15:24:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.208 15:24:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.208 15:24:01 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.208 15:24:01 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.208 15:24:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.208 15:24:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.208 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.208 15:24:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:03.208 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.208 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.208 request: 00:23:03.209 { 00:23:03.209 "name": "NVMe0", 00:23:03.209 "trtype": "tcp", 00:23:03.209 "traddr": "10.0.0.2", 00:23:03.209 "hostaddr": "10.0.0.2", 00:23:03.209 "hostsvcid": "60000", 00:23:03.209 "adrfam": "ipv4", 00:23:03.209 "trsvcid": "4420", 00:23:03.209 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:03.209 "method": "bdev_nvme_attach_controller", 00:23:03.209 "req_id": 1 00:23:03.209 } 00:23:03.209 Got JSON-RPC error response 00:23:03.209 response: 00:23:03.209 { 00:23:03.209 "code": -114, 00:23:03.209 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.209 } 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@653 -- # es=1 00:23:03.209 15:24:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.209 15:24:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.209 15:24:01 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.209 15:24:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.209 15:24:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 request: 00:23:03.209 { 00:23:03.209 "name": "NVMe0", 00:23:03.209 "trtype": "tcp", 00:23:03.209 "traddr": "10.0.0.2", 00:23:03.209 "hostaddr": "10.0.0.2", 00:23:03.209 "hostsvcid": "60000", 00:23:03.209 "adrfam": "ipv4", 00:23:03.209 "trsvcid": "4420", 00:23:03.209 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.209 "multipath": "disable", 00:23:03.209 "method": "bdev_nvme_attach_controller", 00:23:03.209 "req_id": 1 00:23:03.209 } 00:23:03.209 Got JSON-RPC error response 00:23:03.209 response: 00:23:03.209 { 00:23:03.209 "code": -114, 00:23:03.209 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:03.209 } 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@653 -- # es=1 00:23:03.209 15:24:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.209 15:24:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.209 15:24:01 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.209 15:24:01 -- common/autotest_common.sh@650 -- # local es=0 00:23:03.209 15:24:01 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.209 15:24:01 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:03.209 15:24:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:03.209 15:24:01 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 request: 00:23:03.209 { 00:23:03.209 "name": "NVMe0", 00:23:03.209 "trtype": "tcp", 00:23:03.209 "traddr": "10.0.0.2", 00:23:03.209 "hostaddr": "10.0.0.2", 00:23:03.209 "hostsvcid": "60000", 00:23:03.209 "adrfam": "ipv4", 00:23:03.209 "trsvcid": "4420", 00:23:03.209 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.209 "multipath": "failover", 00:23:03.209 "method": "bdev_nvme_attach_controller", 00:23:03.209 "req_id": 1 00:23:03.209 } 00:23:03.209 Got JSON-RPC error response 00:23:03.209 response: 00:23:03.209 { 00:23:03.209 "code": -114, 00:23:03.209 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:03.209 } 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@653 -- # es=1 00:23:03.209 15:24:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:03.209 15:24:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:03.209 15:24:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:03.209 15:24:01 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.209 15:24:01 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.209 15:24:01 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.209 15:24:01 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:03.209 15:24:01 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:03.209 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.209 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:23:03.209 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.209 15:24:01 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:03.209 15:24:01 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:04.623 0 00:23:04.623 15:24:02 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:04.623 15:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.623 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:23:04.623 15:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.623 15:24:02 -- host/multicontroller.sh@100 -- # killprocess 2835269 00:23:04.623 15:24:02 -- common/autotest_common.sh@936 -- # '[' -z 2835269 ']' 00:23:04.623 15:24:02 -- common/autotest_common.sh@940 -- # kill -0 2835269 00:23:04.623 15:24:02 -- common/autotest_common.sh@941 -- # uname 00:23:04.623 15:24:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.623 15:24:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2835269 00:23:04.623 15:24:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:04.623 15:24:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:04.623 15:24:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2835269' 00:23:04.623 killing process with pid 2835269 00:23:04.623 15:24:02 -- common/autotest_common.sh@955 -- # kill 2835269 00:23:04.623 15:24:02 -- common/autotest_common.sh@960 -- # wait 2835269 00:23:04.623 15:24:03 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:04.623 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.623 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:23:04.623 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.623 15:24:03 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:04.623 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.623 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:23:04.623 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.623 15:24:03 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:04.623 15:24:03 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:04.623 15:24:03 -- common/autotest_common.sh@1607 -- # read -r file 00:23:04.623 15:24:03 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:04.623 15:24:03 -- common/autotest_common.sh@1606 -- # sort -u 00:23:04.623 15:24:03 -- common/autotest_common.sh@1608 -- # cat 00:23:04.623 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:04.623 [2024-11-19 15:24:00.381320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:04.623 [2024-11-19 15:24:00.381422] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2835269 ] 00:23:04.623 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.623 [2024-11-19 15:24:00.444012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:04.623 [2024-11-19 15:24:00.552617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:04.623 [2024-11-19 15:24:01.676035] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name a31481a3-29c6-4323-afaa-589920e2bc52 already exists 00:23:04.623 [2024-11-19 15:24:01.676074] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:a31481a3-29c6-4323-afaa-589920e2bc52 alias for bdev NVMe1n1 00:23:04.623 [2024-11-19 15:24:01.676103] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:04.623 Running I/O for 1 seconds... 00:23:04.623 00:23:04.623 Latency(us) 00:23:04.623 [2024-11-19T14:24:03.186Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:04.623 [2024-11-19T14:24:03.186Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:04.623 NVMe0n1 : 1.00 19896.13 77.72 0.00 0.00 6423.52 3131.16 11505.21 00:23:04.623 [2024-11-19T14:24:03.186Z] =================================================================================================================== 00:23:04.623 [2024-11-19T14:24:03.186Z] Total : 19896.13 77.72 0.00 0.00 6423.52 3131.16 11505.21 00:23:04.623 Received shutdown signal, test time was about 1.000000 seconds 00:23:04.623 00:23:04.623 Latency(us) 00:23:04.623 [2024-11-19T14:24:03.186Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:04.623 [2024-11-19T14:24:03.186Z] =================================================================================================================== 00:23:04.623 [2024-11-19T14:24:03.186Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:04.623 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:04.623 15:24:03 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:04.623 15:24:03 -- common/autotest_common.sh@1607 -- # read -r file 00:23:04.623 15:24:03 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:04.623 15:24:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:04.623 15:24:03 -- nvmf/common.sh@116 -- # sync 00:23:04.623 15:24:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:04.623 15:24:03 -- nvmf/common.sh@119 -- # set +e 00:23:04.623 15:24:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:04.623 15:24:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:04.623 rmmod nvme_tcp 00:23:04.925 rmmod nvme_fabrics 00:23:04.925 rmmod nvme_keyring 00:23:04.925 15:24:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:04.925 15:24:03 -- nvmf/common.sh@123 -- # set -e 00:23:04.925 15:24:03 -- nvmf/common.sh@124 -- # return 0 00:23:04.925 15:24:03 -- nvmf/common.sh@477 -- # '[' -n 2835077 ']' 00:23:04.925 15:24:03 -- nvmf/common.sh@478 -- # killprocess 2835077 00:23:04.925 15:24:03 -- common/autotest_common.sh@936 -- # '[' -z 2835077 ']' 00:23:04.925 15:24:03 -- common/autotest_common.sh@940 -- # kill -0 2835077 00:23:04.925 15:24:03 -- common/autotest_common.sh@941 -- # uname 00:23:04.925 15:24:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.925 15:24:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2835077 00:23:04.925 15:24:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:04.925 15:24:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:04.925 15:24:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2835077' 00:23:04.925 killing process with pid 2835077 00:23:04.925 15:24:03 -- common/autotest_common.sh@955 -- # kill 2835077 00:23:04.925 15:24:03 -- common/autotest_common.sh@960 -- # wait 2835077 00:23:05.184 15:24:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:05.184 15:24:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:05.184 15:24:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:05.184 15:24:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:05.184 15:24:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:05.184 15:24:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.184 15:24:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.184 15:24:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.089 15:24:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:07.089 00:23:07.089 real 0m8.836s 00:23:07.089 user 0m16.362s 00:23:07.089 sys 0m2.340s 00:23:07.089 15:24:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.089 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:07.089 ************************************ 00:23:07.089 END TEST nvmf_multicontroller 00:23:07.089 ************************************ 00:23:07.089 15:24:05 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:07.089 15:24:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.089 15:24:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.089 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:07.089 ************************************ 00:23:07.089 START TEST nvmf_aer 00:23:07.089 ************************************ 00:23:07.089 15:24:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:07.347 * Looking for test storage... 00:23:07.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:07.347 15:24:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:07.347 15:24:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:07.347 15:24:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:07.347 15:24:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:07.348 15:24:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:07.348 15:24:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:07.348 15:24:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:07.348 15:24:05 -- scripts/common.sh@335 -- # IFS=.-: 00:23:07.348 15:24:05 -- scripts/common.sh@335 -- # read -ra ver1 00:23:07.348 15:24:05 -- scripts/common.sh@336 -- # IFS=.-: 00:23:07.348 15:24:05 -- scripts/common.sh@336 -- # read -ra ver2 00:23:07.348 15:24:05 -- scripts/common.sh@337 -- # local 'op=<' 00:23:07.348 15:24:05 -- scripts/common.sh@339 -- # ver1_l=2 00:23:07.348 15:24:05 -- scripts/common.sh@340 -- # ver2_l=1 00:23:07.348 15:24:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:07.348 15:24:05 -- scripts/common.sh@343 -- # case "$op" in 00:23:07.348 15:24:05 -- scripts/common.sh@344 -- # : 1 00:23:07.348 15:24:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:07.348 15:24:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:07.348 15:24:05 -- scripts/common.sh@364 -- # decimal 1 00:23:07.348 15:24:05 -- scripts/common.sh@352 -- # local d=1 00:23:07.348 15:24:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:07.348 15:24:05 -- scripts/common.sh@354 -- # echo 1 00:23:07.348 15:24:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:07.348 15:24:05 -- scripts/common.sh@365 -- # decimal 2 00:23:07.348 15:24:05 -- scripts/common.sh@352 -- # local d=2 00:23:07.348 15:24:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:07.348 15:24:05 -- scripts/common.sh@354 -- # echo 2 00:23:07.348 15:24:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:07.348 15:24:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:07.348 15:24:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:07.348 15:24:05 -- scripts/common.sh@367 -- # return 0 00:23:07.348 15:24:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:07.348 15:24:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:07.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.348 --rc genhtml_branch_coverage=1 00:23:07.348 --rc genhtml_function_coverage=1 00:23:07.348 --rc genhtml_legend=1 00:23:07.348 --rc geninfo_all_blocks=1 00:23:07.348 --rc geninfo_unexecuted_blocks=1 00:23:07.348 00:23:07.348 ' 00:23:07.348 15:24:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:07.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.348 --rc genhtml_branch_coverage=1 00:23:07.348 --rc genhtml_function_coverage=1 00:23:07.348 --rc genhtml_legend=1 00:23:07.348 --rc geninfo_all_blocks=1 00:23:07.348 --rc geninfo_unexecuted_blocks=1 00:23:07.348 00:23:07.348 ' 00:23:07.348 15:24:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:07.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.348 --rc genhtml_branch_coverage=1 00:23:07.348 --rc genhtml_function_coverage=1 00:23:07.348 --rc genhtml_legend=1 00:23:07.348 --rc geninfo_all_blocks=1 00:23:07.348 --rc geninfo_unexecuted_blocks=1 00:23:07.348 00:23:07.348 ' 00:23:07.348 15:24:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:07.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.348 --rc genhtml_branch_coverage=1 00:23:07.348 --rc genhtml_function_coverage=1 00:23:07.348 --rc genhtml_legend=1 00:23:07.348 --rc geninfo_all_blocks=1 00:23:07.348 --rc geninfo_unexecuted_blocks=1 00:23:07.348 00:23:07.348 ' 00:23:07.348 15:24:05 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:07.348 15:24:05 -- nvmf/common.sh@7 -- # uname -s 00:23:07.348 15:24:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:07.348 15:24:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:07.348 15:24:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:07.348 15:24:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:07.348 15:24:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:07.348 15:24:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:07.348 15:24:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:07.348 15:24:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:07.348 15:24:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:07.348 15:24:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:07.348 15:24:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.348 15:24:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.348 15:24:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:07.348 15:24:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:07.348 15:24:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:07.348 15:24:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:07.348 15:24:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:07.348 15:24:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:07.348 15:24:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:07.348 15:24:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.348 15:24:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.348 15:24:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.348 15:24:05 -- paths/export.sh@5 -- # export PATH 00:23:07.348 15:24:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.348 15:24:05 -- nvmf/common.sh@46 -- # : 0 00:23:07.348 15:24:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:07.348 15:24:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:07.348 15:24:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:07.348 15:24:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:07.348 15:24:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:07.348 15:24:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:07.348 15:24:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:07.348 15:24:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:07.348 15:24:05 -- host/aer.sh@11 -- # nvmftestinit 00:23:07.348 15:24:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:07.348 15:24:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:07.348 15:24:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:07.348 15:24:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:07.348 15:24:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:07.348 15:24:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.348 15:24:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.348 15:24:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.348 15:24:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:07.348 15:24:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:07.348 15:24:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:07.348 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:09.878 15:24:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.878 15:24:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.878 15:24:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.878 15:24:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.878 15:24:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.878 15:24:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.878 15:24:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.878 15:24:07 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.879 15:24:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.879 15:24:07 -- nvmf/common.sh@295 -- # e810=() 00:23:09.879 15:24:07 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.879 15:24:07 -- nvmf/common.sh@296 -- # x722=() 00:23:09.879 15:24:07 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.879 15:24:07 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.879 15:24:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.879 15:24:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.879 15:24:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.879 15:24:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.879 15:24:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.879 15:24:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:09.879 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:09.879 15:24:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.879 15:24:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:09.879 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:09.879 15:24:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.879 15:24:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.879 15:24:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.879 15:24:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:09.879 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:09.879 15:24:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.879 15:24:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.879 15:24:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.879 15:24:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.879 15:24:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:09.879 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:09.879 15:24:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.879 15:24:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:09.879 15:24:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:09.879 15:24:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:09.879 15:24:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:09.879 15:24:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:09.879 15:24:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.879 15:24:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:09.879 15:24:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:09.879 15:24:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:09.879 15:24:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:09.879 15:24:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:09.879 15:24:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:09.879 15:24:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:09.879 15:24:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:09.879 15:24:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:09.879 15:24:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:09.879 15:24:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:09.879 15:24:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:09.879 15:24:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:09.879 15:24:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:09.879 15:24:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:09.879 15:24:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:09.879 15:24:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:09.879 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:09.879 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:23:09.879 00:23:09.879 --- 10.0.0.2 ping statistics --- 00:23:09.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.879 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:23:09.879 15:24:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:09.879 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:09.879 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:23:09.879 00:23:09.879 --- 10.0.0.1 ping statistics --- 00:23:09.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.879 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:23:09.879 15:24:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:09.879 15:24:08 -- nvmf/common.sh@410 -- # return 0 00:23:09.879 15:24:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:09.879 15:24:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:09.879 15:24:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:09.879 15:24:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:09.879 15:24:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:09.879 15:24:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:09.879 15:24:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:09.879 15:24:08 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:09.879 15:24:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:09.879 15:24:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:09.879 15:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:09.879 15:24:08 -- nvmf/common.sh@469 -- # nvmfpid=2837966 00:23:09.879 15:24:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:09.879 15:24:08 -- nvmf/common.sh@470 -- # waitforlisten 2837966 00:23:09.879 15:24:08 -- common/autotest_common.sh@829 -- # '[' -z 2837966 ']' 00:23:09.879 15:24:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:09.879 15:24:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:09.879 15:24:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:09.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:09.879 15:24:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:09.879 15:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:09.879 [2024-11-19 15:24:08.152951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:09.879 [2024-11-19 15:24:08.153058] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:09.879 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.879 [2024-11-19 15:24:08.223530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.879 [2024-11-19 15:24:08.339598] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:09.879 [2024-11-19 15:24:08.339766] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.879 [2024-11-19 15:24:08.339785] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.879 [2024-11-19 15:24:08.339799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.879 [2024-11-19 15:24:08.339878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:09.879 [2024-11-19 15:24:08.339956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:09.879 [2024-11-19 15:24:08.340001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:09.879 [2024-11-19 15:24:08.340004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.815 15:24:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:10.815 15:24:09 -- common/autotest_common.sh@862 -- # return 0 00:23:10.815 15:24:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:10.815 15:24:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 15:24:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:10.815 15:24:09 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 [2024-11-19 15:24:09.147232] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 Malloc0 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 [2024-11-19 15:24:09.198526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:10.815 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.815 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:10.815 [2024-11-19 15:24:09.206259] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:10.815 [ 00:23:10.815 { 00:23:10.815 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:10.815 "subtype": "Discovery", 00:23:10.815 "listen_addresses": [], 00:23:10.815 "allow_any_host": true, 00:23:10.815 "hosts": [] 00:23:10.815 }, 00:23:10.815 { 00:23:10.815 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:10.815 "subtype": "NVMe", 00:23:10.815 "listen_addresses": [ 00:23:10.815 { 00:23:10.815 "transport": "TCP", 00:23:10.815 "trtype": "TCP", 00:23:10.815 "adrfam": "IPv4", 00:23:10.815 "traddr": "10.0.0.2", 00:23:10.815 "trsvcid": "4420" 00:23:10.815 } 00:23:10.815 ], 00:23:10.815 "allow_any_host": true, 00:23:10.815 "hosts": [], 00:23:10.815 "serial_number": "SPDK00000000000001", 00:23:10.815 "model_number": "SPDK bdev Controller", 00:23:10.815 "max_namespaces": 2, 00:23:10.815 "min_cntlid": 1, 00:23:10.815 "max_cntlid": 65519, 00:23:10.815 "namespaces": [ 00:23:10.815 { 00:23:10.815 "nsid": 1, 00:23:10.815 "bdev_name": "Malloc0", 00:23:10.815 "name": "Malloc0", 00:23:10.815 "nguid": "AE70B3F22D7D4D7C8800B5100DE86145", 00:23:10.815 "uuid": "ae70b3f2-2d7d-4d7c-8800-b5100de86145" 00:23:10.815 } 00:23:10.815 ] 00:23:10.815 } 00:23:10.815 ] 00:23:10.815 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.815 15:24:09 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:10.815 15:24:09 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:10.815 15:24:09 -- host/aer.sh@33 -- # aerpid=2838278 00:23:10.815 15:24:09 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:10.815 15:24:09 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:10.815 15:24:09 -- common/autotest_common.sh@1254 -- # local i=0 00:23:10.815 15:24:09 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:10.815 15:24:09 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:10.815 15:24:09 -- common/autotest_common.sh@1257 -- # i=1 00:23:10.815 15:24:09 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:10.815 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.815 15:24:09 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:10.815 15:24:09 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:10.815 15:24:09 -- common/autotest_common.sh@1257 -- # i=2 00:23:10.815 15:24:09 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:11.074 15:24:09 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:11.074 15:24:09 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:23:11.074 15:24:09 -- common/autotest_common.sh@1257 -- # i=3 00:23:11.074 15:24:09 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:11.074 15:24:09 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:11.074 15:24:09 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:11.074 15:24:09 -- common/autotest_common.sh@1265 -- # return 0 00:23:11.074 15:24:09 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:11.074 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.074 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.074 Malloc1 00:23:11.074 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.074 15:24:09 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:11.074 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.074 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.074 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.074 15:24:09 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:11.074 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.074 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.074 Asynchronous Event Request test 00:23:11.074 Attaching to 10.0.0.2 00:23:11.074 Attached to 10.0.0.2 00:23:11.074 Registering asynchronous event callbacks... 00:23:11.074 Starting namespace attribute notice tests for all controllers... 00:23:11.074 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:11.074 aer_cb - Changed Namespace 00:23:11.074 Cleaning up... 00:23:11.074 [ 00:23:11.074 { 00:23:11.074 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:11.074 "subtype": "Discovery", 00:23:11.074 "listen_addresses": [], 00:23:11.074 "allow_any_host": true, 00:23:11.074 "hosts": [] 00:23:11.074 }, 00:23:11.074 { 00:23:11.074 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:11.074 "subtype": "NVMe", 00:23:11.074 "listen_addresses": [ 00:23:11.074 { 00:23:11.074 "transport": "TCP", 00:23:11.074 "trtype": "TCP", 00:23:11.074 "adrfam": "IPv4", 00:23:11.074 "traddr": "10.0.0.2", 00:23:11.074 "trsvcid": "4420" 00:23:11.074 } 00:23:11.074 ], 00:23:11.074 "allow_any_host": true, 00:23:11.074 "hosts": [], 00:23:11.074 "serial_number": "SPDK00000000000001", 00:23:11.074 "model_number": "SPDK bdev Controller", 00:23:11.074 "max_namespaces": 2, 00:23:11.074 "min_cntlid": 1, 00:23:11.074 "max_cntlid": 65519, 00:23:11.074 "namespaces": [ 00:23:11.074 { 00:23:11.074 "nsid": 1, 00:23:11.074 "bdev_name": "Malloc0", 00:23:11.074 "name": "Malloc0", 00:23:11.074 "nguid": "AE70B3F22D7D4D7C8800B5100DE86145", 00:23:11.074 "uuid": "ae70b3f2-2d7d-4d7c-8800-b5100de86145" 00:23:11.074 }, 00:23:11.074 { 00:23:11.074 "nsid": 2, 00:23:11.074 "bdev_name": "Malloc1", 00:23:11.074 "name": "Malloc1", 00:23:11.074 "nguid": "28DD5634D59E414C8D8F557B7A1BA546", 00:23:11.074 "uuid": "28dd5634-d59e-414c-8d8f-557b7a1ba546" 00:23:11.074 } 00:23:11.074 ] 00:23:11.074 } 00:23:11.074 ] 00:23:11.074 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.074 15:24:09 -- host/aer.sh@43 -- # wait 2838278 00:23:11.074 15:24:09 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:11.074 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.074 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.332 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.332 15:24:09 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:11.332 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.332 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.332 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.332 15:24:09 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:11.332 15:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.332 15:24:09 -- common/autotest_common.sh@10 -- # set +x 00:23:11.332 15:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.332 15:24:09 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:11.332 15:24:09 -- host/aer.sh@51 -- # nvmftestfini 00:23:11.332 15:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:11.332 15:24:09 -- nvmf/common.sh@116 -- # sync 00:23:11.332 15:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:11.332 15:24:09 -- nvmf/common.sh@119 -- # set +e 00:23:11.332 15:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:11.332 15:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:11.332 rmmod nvme_tcp 00:23:11.332 rmmod nvme_fabrics 00:23:11.332 rmmod nvme_keyring 00:23:11.332 15:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:11.332 15:24:09 -- nvmf/common.sh@123 -- # set -e 00:23:11.332 15:24:09 -- nvmf/common.sh@124 -- # return 0 00:23:11.332 15:24:09 -- nvmf/common.sh@477 -- # '[' -n 2837966 ']' 00:23:11.332 15:24:09 -- nvmf/common.sh@478 -- # killprocess 2837966 00:23:11.332 15:24:09 -- common/autotest_common.sh@936 -- # '[' -z 2837966 ']' 00:23:11.332 15:24:09 -- common/autotest_common.sh@940 -- # kill -0 2837966 00:23:11.332 15:24:09 -- common/autotest_common.sh@941 -- # uname 00:23:11.332 15:24:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:11.332 15:24:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2837966 00:23:11.332 15:24:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:11.332 15:24:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:11.332 15:24:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2837966' 00:23:11.332 killing process with pid 2837966 00:23:11.332 15:24:09 -- common/autotest_common.sh@955 -- # kill 2837966 00:23:11.333 [2024-11-19 15:24:09.777027] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:11.333 15:24:09 -- common/autotest_common.sh@960 -- # wait 2837966 00:23:11.591 15:24:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:11.591 15:24:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:11.591 15:24:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:11.591 15:24:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:11.591 15:24:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:11.591 15:24:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.591 15:24:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.591 15:24:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.124 15:24:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:14.124 00:23:14.124 real 0m6.471s 00:23:14.124 user 0m7.635s 00:23:14.124 sys 0m2.063s 00:23:14.124 15:24:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:14.124 15:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:14.124 ************************************ 00:23:14.124 END TEST nvmf_aer 00:23:14.124 ************************************ 00:23:14.124 15:24:12 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:14.124 15:24:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:14.124 15:24:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:14.124 15:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:14.124 ************************************ 00:23:14.124 START TEST nvmf_async_init 00:23:14.124 ************************************ 00:23:14.124 15:24:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:14.124 * Looking for test storage... 00:23:14.124 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:14.124 15:24:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:14.124 15:24:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:14.124 15:24:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:14.124 15:24:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:14.124 15:24:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:14.124 15:24:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:14.124 15:24:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:14.124 15:24:12 -- scripts/common.sh@335 -- # IFS=.-: 00:23:14.124 15:24:12 -- scripts/common.sh@335 -- # read -ra ver1 00:23:14.124 15:24:12 -- scripts/common.sh@336 -- # IFS=.-: 00:23:14.124 15:24:12 -- scripts/common.sh@336 -- # read -ra ver2 00:23:14.124 15:24:12 -- scripts/common.sh@337 -- # local 'op=<' 00:23:14.124 15:24:12 -- scripts/common.sh@339 -- # ver1_l=2 00:23:14.124 15:24:12 -- scripts/common.sh@340 -- # ver2_l=1 00:23:14.124 15:24:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:14.124 15:24:12 -- scripts/common.sh@343 -- # case "$op" in 00:23:14.124 15:24:12 -- scripts/common.sh@344 -- # : 1 00:23:14.124 15:24:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:14.124 15:24:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:14.124 15:24:12 -- scripts/common.sh@364 -- # decimal 1 00:23:14.124 15:24:12 -- scripts/common.sh@352 -- # local d=1 00:23:14.124 15:24:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:14.124 15:24:12 -- scripts/common.sh@354 -- # echo 1 00:23:14.124 15:24:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:14.124 15:24:12 -- scripts/common.sh@365 -- # decimal 2 00:23:14.124 15:24:12 -- scripts/common.sh@352 -- # local d=2 00:23:14.124 15:24:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:14.124 15:24:12 -- scripts/common.sh@354 -- # echo 2 00:23:14.124 15:24:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:14.124 15:24:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:14.124 15:24:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:14.124 15:24:12 -- scripts/common.sh@367 -- # return 0 00:23:14.124 15:24:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:14.124 15:24:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:14.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.124 --rc genhtml_branch_coverage=1 00:23:14.124 --rc genhtml_function_coverage=1 00:23:14.124 --rc genhtml_legend=1 00:23:14.124 --rc geninfo_all_blocks=1 00:23:14.124 --rc geninfo_unexecuted_blocks=1 00:23:14.124 00:23:14.124 ' 00:23:14.124 15:24:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:14.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.124 --rc genhtml_branch_coverage=1 00:23:14.124 --rc genhtml_function_coverage=1 00:23:14.124 --rc genhtml_legend=1 00:23:14.124 --rc geninfo_all_blocks=1 00:23:14.124 --rc geninfo_unexecuted_blocks=1 00:23:14.124 00:23:14.124 ' 00:23:14.124 15:24:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:14.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.124 --rc genhtml_branch_coverage=1 00:23:14.124 --rc genhtml_function_coverage=1 00:23:14.125 --rc genhtml_legend=1 00:23:14.125 --rc geninfo_all_blocks=1 00:23:14.125 --rc geninfo_unexecuted_blocks=1 00:23:14.125 00:23:14.125 ' 00:23:14.125 15:24:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:14.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.125 --rc genhtml_branch_coverage=1 00:23:14.125 --rc genhtml_function_coverage=1 00:23:14.125 --rc genhtml_legend=1 00:23:14.125 --rc geninfo_all_blocks=1 00:23:14.125 --rc geninfo_unexecuted_blocks=1 00:23:14.125 00:23:14.125 ' 00:23:14.125 15:24:12 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:14.125 15:24:12 -- nvmf/common.sh@7 -- # uname -s 00:23:14.125 15:24:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:14.125 15:24:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:14.125 15:24:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:14.125 15:24:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:14.125 15:24:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:14.125 15:24:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:14.125 15:24:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:14.125 15:24:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:14.125 15:24:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:14.125 15:24:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:14.125 15:24:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.125 15:24:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.125 15:24:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:14.125 15:24:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:14.125 15:24:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:14.125 15:24:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:14.125 15:24:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:14.125 15:24:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:14.125 15:24:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:14.125 15:24:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.125 15:24:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.125 15:24:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.125 15:24:12 -- paths/export.sh@5 -- # export PATH 00:23:14.125 15:24:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.125 15:24:12 -- nvmf/common.sh@46 -- # : 0 00:23:14.125 15:24:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:14.125 15:24:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:14.125 15:24:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:14.125 15:24:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:14.125 15:24:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:14.125 15:24:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:14.125 15:24:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:14.125 15:24:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:14.125 15:24:12 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:14.125 15:24:12 -- host/async_init.sh@14 -- # null_block_size=512 00:23:14.125 15:24:12 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:14.125 15:24:12 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:14.125 15:24:12 -- host/async_init.sh@20 -- # uuidgen 00:23:14.125 15:24:12 -- host/async_init.sh@20 -- # tr -d - 00:23:14.125 15:24:12 -- host/async_init.sh@20 -- # nguid=e27e175976454bfb8bfd5ad66b2fa2bf 00:23:14.125 15:24:12 -- host/async_init.sh@22 -- # nvmftestinit 00:23:14.125 15:24:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:14.125 15:24:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:14.125 15:24:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:14.125 15:24:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:14.125 15:24:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:14.125 15:24:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.125 15:24:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.125 15:24:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.125 15:24:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:14.125 15:24:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:14.125 15:24:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:14.125 15:24:12 -- common/autotest_common.sh@10 -- # set +x 00:23:16.029 15:24:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:16.029 15:24:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:16.029 15:24:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:16.029 15:24:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:16.029 15:24:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:16.029 15:24:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:16.029 15:24:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:16.029 15:24:14 -- nvmf/common.sh@294 -- # net_devs=() 00:23:16.029 15:24:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:16.029 15:24:14 -- nvmf/common.sh@295 -- # e810=() 00:23:16.029 15:24:14 -- nvmf/common.sh@295 -- # local -ga e810 00:23:16.029 15:24:14 -- nvmf/common.sh@296 -- # x722=() 00:23:16.029 15:24:14 -- nvmf/common.sh@296 -- # local -ga x722 00:23:16.029 15:24:14 -- nvmf/common.sh@297 -- # mlx=() 00:23:16.029 15:24:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:16.029 15:24:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:16.029 15:24:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.029 15:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:16.029 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:16.029 15:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.029 15:24:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:16.029 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:16.029 15:24:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.029 15:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.029 15:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.029 15:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:16.029 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:16.029 15:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.029 15:24:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.029 15:24:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.029 15:24:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:16.029 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:16.029 15:24:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:16.029 15:24:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:16.029 15:24:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:16.029 15:24:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:16.029 15:24:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:16.029 15:24:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:16.029 15:24:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:16.029 15:24:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:16.029 15:24:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:16.029 15:24:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:16.029 15:24:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:16.029 15:24:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:16.029 15:24:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:16.029 15:24:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:16.029 15:24:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:16.029 15:24:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:16.029 15:24:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:16.029 15:24:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:16.029 15:24:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:16.029 15:24:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:16.029 15:24:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:16.029 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:16.029 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:23:16.029 00:23:16.029 --- 10.0.0.2 ping statistics --- 00:23:16.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.029 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:23:16.029 15:24:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:16.029 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:16.029 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:23:16.029 00:23:16.029 --- 10.0.0.1 ping statistics --- 00:23:16.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.029 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:23:16.029 15:24:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:16.029 15:24:14 -- nvmf/common.sh@410 -- # return 0 00:23:16.029 15:24:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:16.029 15:24:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:16.029 15:24:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:16.029 15:24:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:16.029 15:24:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:16.029 15:24:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:16.029 15:24:14 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:16.029 15:24:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:16.029 15:24:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:16.029 15:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:16.029 15:24:14 -- nvmf/common.sh@469 -- # nvmfpid=2840356 00:23:16.029 15:24:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:16.029 15:24:14 -- nvmf/common.sh@470 -- # waitforlisten 2840356 00:23:16.029 15:24:14 -- common/autotest_common.sh@829 -- # '[' -z 2840356 ']' 00:23:16.029 15:24:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:16.029 15:24:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:16.029 15:24:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:16.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:16.029 15:24:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:16.029 15:24:14 -- common/autotest_common.sh@10 -- # set +x 00:23:16.029 [2024-11-19 15:24:14.469372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:16.029 [2024-11-19 15:24:14.469452] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:16.029 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.029 [2024-11-19 15:24:14.538719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:16.288 [2024-11-19 15:24:14.652614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:16.288 [2024-11-19 15:24:14.652805] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:16.288 [2024-11-19 15:24:14.652827] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:16.288 [2024-11-19 15:24:14.652844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:16.288 [2024-11-19 15:24:14.652876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:17.222 15:24:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:17.222 15:24:15 -- common/autotest_common.sh@862 -- # return 0 00:23:17.222 15:24:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:17.222 15:24:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 15:24:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:17.222 15:24:15 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 [2024-11-19 15:24:15.476206] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 null0 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g e27e175976454bfb8bfd5ad66b2fa2bf 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 [2024-11-19 15:24:15.516434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 nvme0n1 00:23:17.222 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.222 15:24:15 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:17.222 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.222 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.222 [ 00:23:17.222 { 00:23:17.222 "name": "nvme0n1", 00:23:17.222 "aliases": [ 00:23:17.222 "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf" 00:23:17.222 ], 00:23:17.222 "product_name": "NVMe disk", 00:23:17.222 "block_size": 512, 00:23:17.222 "num_blocks": 2097152, 00:23:17.222 "uuid": "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf", 00:23:17.222 "assigned_rate_limits": { 00:23:17.222 "rw_ios_per_sec": 0, 00:23:17.222 "rw_mbytes_per_sec": 0, 00:23:17.222 "r_mbytes_per_sec": 0, 00:23:17.222 "w_mbytes_per_sec": 0 00:23:17.222 }, 00:23:17.222 "claimed": false, 00:23:17.222 "zoned": false, 00:23:17.222 "supported_io_types": { 00:23:17.222 "read": true, 00:23:17.222 "write": true, 00:23:17.222 "unmap": false, 00:23:17.222 "write_zeroes": true, 00:23:17.223 "flush": true, 00:23:17.223 "reset": true, 00:23:17.223 "compare": true, 00:23:17.223 "compare_and_write": true, 00:23:17.223 "abort": true, 00:23:17.223 "nvme_admin": true, 00:23:17.223 "nvme_io": true 00:23:17.223 }, 00:23:17.223 "driver_specific": { 00:23:17.223 "nvme": [ 00:23:17.223 { 00:23:17.223 "trid": { 00:23:17.223 "trtype": "TCP", 00:23:17.223 "adrfam": "IPv4", 00:23:17.223 "traddr": "10.0.0.2", 00:23:17.223 "trsvcid": "4420", 00:23:17.223 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:17.223 }, 00:23:17.223 "ctrlr_data": { 00:23:17.223 "cntlid": 1, 00:23:17.223 "vendor_id": "0x8086", 00:23:17.223 "model_number": "SPDK bdev Controller", 00:23:17.223 "serial_number": "00000000000000000000", 00:23:17.223 "firmware_revision": "24.01.1", 00:23:17.223 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:17.223 "oacs": { 00:23:17.223 "security": 0, 00:23:17.223 "format": 0, 00:23:17.223 "firmware": 0, 00:23:17.223 "ns_manage": 0 00:23:17.223 }, 00:23:17.223 "multi_ctrlr": true, 00:23:17.223 "ana_reporting": false 00:23:17.223 }, 00:23:17.223 "vs": { 00:23:17.223 "nvme_version": "1.3" 00:23:17.223 }, 00:23:17.223 "ns_data": { 00:23:17.223 "id": 1, 00:23:17.223 "can_share": true 00:23:17.223 } 00:23:17.223 } 00:23:17.223 ], 00:23:17.223 "mp_policy": "active_passive" 00:23:17.223 } 00:23:17.223 } 00:23:17.223 ] 00:23:17.223 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.223 15:24:15 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:17.223 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.223 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.223 [2024-11-19 15:24:15.765042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:17.223 [2024-11-19 15:24:15.765138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1289ba0 (9): Bad file descriptor 00:23:17.482 [2024-11-19 15:24:15.896840] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 [ 00:23:17.482 { 00:23:17.482 "name": "nvme0n1", 00:23:17.482 "aliases": [ 00:23:17.482 "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf" 00:23:17.482 ], 00:23:17.482 "product_name": "NVMe disk", 00:23:17.482 "block_size": 512, 00:23:17.482 "num_blocks": 2097152, 00:23:17.482 "uuid": "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf", 00:23:17.482 "assigned_rate_limits": { 00:23:17.482 "rw_ios_per_sec": 0, 00:23:17.482 "rw_mbytes_per_sec": 0, 00:23:17.482 "r_mbytes_per_sec": 0, 00:23:17.482 "w_mbytes_per_sec": 0 00:23:17.482 }, 00:23:17.482 "claimed": false, 00:23:17.482 "zoned": false, 00:23:17.482 "supported_io_types": { 00:23:17.482 "read": true, 00:23:17.482 "write": true, 00:23:17.482 "unmap": false, 00:23:17.482 "write_zeroes": true, 00:23:17.482 "flush": true, 00:23:17.482 "reset": true, 00:23:17.482 "compare": true, 00:23:17.482 "compare_and_write": true, 00:23:17.482 "abort": true, 00:23:17.482 "nvme_admin": true, 00:23:17.482 "nvme_io": true 00:23:17.482 }, 00:23:17.482 "driver_specific": { 00:23:17.482 "nvme": [ 00:23:17.482 { 00:23:17.482 "trid": { 00:23:17.482 "trtype": "TCP", 00:23:17.482 "adrfam": "IPv4", 00:23:17.482 "traddr": "10.0.0.2", 00:23:17.482 "trsvcid": "4420", 00:23:17.482 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:17.482 }, 00:23:17.482 "ctrlr_data": { 00:23:17.482 "cntlid": 2, 00:23:17.482 "vendor_id": "0x8086", 00:23:17.482 "model_number": "SPDK bdev Controller", 00:23:17.482 "serial_number": "00000000000000000000", 00:23:17.482 "firmware_revision": "24.01.1", 00:23:17.482 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:17.482 "oacs": { 00:23:17.482 "security": 0, 00:23:17.482 "format": 0, 00:23:17.482 "firmware": 0, 00:23:17.482 "ns_manage": 0 00:23:17.482 }, 00:23:17.482 "multi_ctrlr": true, 00:23:17.482 "ana_reporting": false 00:23:17.482 }, 00:23:17.482 "vs": { 00:23:17.482 "nvme_version": "1.3" 00:23:17.482 }, 00:23:17.482 "ns_data": { 00:23:17.482 "id": 1, 00:23:17.482 "can_share": true 00:23:17.482 } 00:23:17.482 } 00:23:17.482 ], 00:23:17.482 "mp_policy": "active_passive" 00:23:17.482 } 00:23:17.482 } 00:23:17.482 ] 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@53 -- # mktemp 00:23:17.482 15:24:15 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.rXenZkb0I8 00:23:17.482 15:24:15 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:17.482 15:24:15 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.rXenZkb0I8 00:23:17.482 15:24:15 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 [2024-11-19 15:24:15.941632] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:17.482 [2024-11-19 15:24:15.941787] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.rXenZkb0I8 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 15:24:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.482 15:24:15 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.rXenZkb0I8 00:23:17.482 15:24:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.482 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:23:17.482 [2024-11-19 15:24:15.957682] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:17.482 nvme0n1 00:23:17.483 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.483 15:24:16 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:17.483 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.483 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:17.483 [ 00:23:17.483 { 00:23:17.483 "name": "nvme0n1", 00:23:17.483 "aliases": [ 00:23:17.483 "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf" 00:23:17.483 ], 00:23:17.483 "product_name": "NVMe disk", 00:23:17.483 "block_size": 512, 00:23:17.483 "num_blocks": 2097152, 00:23:17.483 "uuid": "e27e1759-7645-4bfb-8bfd-5ad66b2fa2bf", 00:23:17.483 "assigned_rate_limits": { 00:23:17.483 "rw_ios_per_sec": 0, 00:23:17.483 "rw_mbytes_per_sec": 0, 00:23:17.483 "r_mbytes_per_sec": 0, 00:23:17.483 "w_mbytes_per_sec": 0 00:23:17.483 }, 00:23:17.483 "claimed": false, 00:23:17.483 "zoned": false, 00:23:17.483 "supported_io_types": { 00:23:17.483 "read": true, 00:23:17.483 "write": true, 00:23:17.483 "unmap": false, 00:23:17.483 "write_zeroes": true, 00:23:17.483 "flush": true, 00:23:17.483 "reset": true, 00:23:17.483 "compare": true, 00:23:17.483 "compare_and_write": true, 00:23:17.483 "abort": true, 00:23:17.483 "nvme_admin": true, 00:23:17.483 "nvme_io": true 00:23:17.483 }, 00:23:17.483 "driver_specific": { 00:23:17.483 "nvme": [ 00:23:17.483 { 00:23:17.483 "trid": { 00:23:17.483 "trtype": "TCP", 00:23:17.483 "adrfam": "IPv4", 00:23:17.483 "traddr": "10.0.0.2", 00:23:17.483 "trsvcid": "4421", 00:23:17.483 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:17.483 }, 00:23:17.483 "ctrlr_data": { 00:23:17.483 "cntlid": 3, 00:23:17.483 "vendor_id": "0x8086", 00:23:17.483 "model_number": "SPDK bdev Controller", 00:23:17.483 "serial_number": "00000000000000000000", 00:23:17.483 "firmware_revision": "24.01.1", 00:23:17.483 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:17.483 "oacs": { 00:23:17.483 "security": 0, 00:23:17.483 "format": 0, 00:23:17.483 "firmware": 0, 00:23:17.483 "ns_manage": 0 00:23:17.483 }, 00:23:17.483 "multi_ctrlr": true, 00:23:17.483 "ana_reporting": false 00:23:17.483 }, 00:23:17.483 "vs": { 00:23:17.483 "nvme_version": "1.3" 00:23:17.483 }, 00:23:17.483 "ns_data": { 00:23:17.483 "id": 1, 00:23:17.483 "can_share": true 00:23:17.483 } 00:23:17.483 } 00:23:17.483 ], 00:23:17.483 "mp_policy": "active_passive" 00:23:17.483 } 00:23:17.483 } 00:23:17.483 ] 00:23:17.483 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.483 15:24:16 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:17.483 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:17.483 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:17.742 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:17.742 15:24:16 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.rXenZkb0I8 00:23:17.742 15:24:16 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:17.742 15:24:16 -- host/async_init.sh@78 -- # nvmftestfini 00:23:17.742 15:24:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:17.742 15:24:16 -- nvmf/common.sh@116 -- # sync 00:23:17.742 15:24:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:17.742 15:24:16 -- nvmf/common.sh@119 -- # set +e 00:23:17.742 15:24:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:17.742 15:24:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:17.742 rmmod nvme_tcp 00:23:17.742 rmmod nvme_fabrics 00:23:17.742 rmmod nvme_keyring 00:23:17.742 15:24:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:17.742 15:24:16 -- nvmf/common.sh@123 -- # set -e 00:23:17.742 15:24:16 -- nvmf/common.sh@124 -- # return 0 00:23:17.742 15:24:16 -- nvmf/common.sh@477 -- # '[' -n 2840356 ']' 00:23:17.742 15:24:16 -- nvmf/common.sh@478 -- # killprocess 2840356 00:23:17.742 15:24:16 -- common/autotest_common.sh@936 -- # '[' -z 2840356 ']' 00:23:17.742 15:24:16 -- common/autotest_common.sh@940 -- # kill -0 2840356 00:23:17.742 15:24:16 -- common/autotest_common.sh@941 -- # uname 00:23:17.742 15:24:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:17.742 15:24:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2840356 00:23:17.742 15:24:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:17.742 15:24:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:17.742 15:24:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2840356' 00:23:17.742 killing process with pid 2840356 00:23:17.742 15:24:16 -- common/autotest_common.sh@955 -- # kill 2840356 00:23:17.742 15:24:16 -- common/autotest_common.sh@960 -- # wait 2840356 00:23:18.001 15:24:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:18.001 15:24:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:18.001 15:24:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:18.001 15:24:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:18.001 15:24:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:18.001 15:24:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:18.001 15:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:18.001 15:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:19.902 15:24:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:19.902 00:23:19.902 real 0m6.314s 00:23:19.902 user 0m3.127s 00:23:19.902 sys 0m1.840s 00:23:19.902 15:24:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:19.902 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:19.902 ************************************ 00:23:19.902 END TEST nvmf_async_init 00:23:19.902 ************************************ 00:23:20.161 15:24:18 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:20.161 15:24:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:20.161 15:24:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:20.161 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:20.161 ************************************ 00:23:20.161 START TEST dma 00:23:20.161 ************************************ 00:23:20.161 15:24:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:20.161 * Looking for test storage... 00:23:20.161 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:20.161 15:24:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:20.161 15:24:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:20.161 15:24:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:20.161 15:24:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:20.161 15:24:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:20.161 15:24:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:20.161 15:24:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:20.161 15:24:18 -- scripts/common.sh@335 -- # IFS=.-: 00:23:20.161 15:24:18 -- scripts/common.sh@335 -- # read -ra ver1 00:23:20.161 15:24:18 -- scripts/common.sh@336 -- # IFS=.-: 00:23:20.161 15:24:18 -- scripts/common.sh@336 -- # read -ra ver2 00:23:20.161 15:24:18 -- scripts/common.sh@337 -- # local 'op=<' 00:23:20.161 15:24:18 -- scripts/common.sh@339 -- # ver1_l=2 00:23:20.161 15:24:18 -- scripts/common.sh@340 -- # ver2_l=1 00:23:20.161 15:24:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:20.161 15:24:18 -- scripts/common.sh@343 -- # case "$op" in 00:23:20.161 15:24:18 -- scripts/common.sh@344 -- # : 1 00:23:20.161 15:24:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:20.161 15:24:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:20.161 15:24:18 -- scripts/common.sh@364 -- # decimal 1 00:23:20.161 15:24:18 -- scripts/common.sh@352 -- # local d=1 00:23:20.161 15:24:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:20.161 15:24:18 -- scripts/common.sh@354 -- # echo 1 00:23:20.161 15:24:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:20.161 15:24:18 -- scripts/common.sh@365 -- # decimal 2 00:23:20.161 15:24:18 -- scripts/common.sh@352 -- # local d=2 00:23:20.161 15:24:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:20.161 15:24:18 -- scripts/common.sh@354 -- # echo 2 00:23:20.161 15:24:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:20.161 15:24:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:20.161 15:24:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:20.161 15:24:18 -- scripts/common.sh@367 -- # return 0 00:23:20.161 15:24:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:20.161 15:24:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:20.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.161 --rc genhtml_branch_coverage=1 00:23:20.161 --rc genhtml_function_coverage=1 00:23:20.161 --rc genhtml_legend=1 00:23:20.161 --rc geninfo_all_blocks=1 00:23:20.161 --rc geninfo_unexecuted_blocks=1 00:23:20.161 00:23:20.161 ' 00:23:20.161 15:24:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:20.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.161 --rc genhtml_branch_coverage=1 00:23:20.162 --rc genhtml_function_coverage=1 00:23:20.162 --rc genhtml_legend=1 00:23:20.162 --rc geninfo_all_blocks=1 00:23:20.162 --rc geninfo_unexecuted_blocks=1 00:23:20.162 00:23:20.162 ' 00:23:20.162 15:24:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:20.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.162 --rc genhtml_branch_coverage=1 00:23:20.162 --rc genhtml_function_coverage=1 00:23:20.162 --rc genhtml_legend=1 00:23:20.162 --rc geninfo_all_blocks=1 00:23:20.162 --rc geninfo_unexecuted_blocks=1 00:23:20.162 00:23:20.162 ' 00:23:20.162 15:24:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:20.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.162 --rc genhtml_branch_coverage=1 00:23:20.162 --rc genhtml_function_coverage=1 00:23:20.162 --rc genhtml_legend=1 00:23:20.162 --rc geninfo_all_blocks=1 00:23:20.162 --rc geninfo_unexecuted_blocks=1 00:23:20.162 00:23:20.162 ' 00:23:20.162 15:24:18 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:20.162 15:24:18 -- nvmf/common.sh@7 -- # uname -s 00:23:20.162 15:24:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:20.162 15:24:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:20.162 15:24:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:20.162 15:24:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:20.162 15:24:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:20.162 15:24:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:20.162 15:24:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:20.162 15:24:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:20.162 15:24:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:20.162 15:24:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:20.162 15:24:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:20.162 15:24:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:20.162 15:24:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:20.162 15:24:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:20.162 15:24:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:20.162 15:24:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:20.162 15:24:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:20.162 15:24:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:20.162 15:24:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:20.162 15:24:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.162 15:24:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.162 15:24:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.162 15:24:18 -- paths/export.sh@5 -- # export PATH 00:23:20.162 15:24:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.162 15:24:18 -- nvmf/common.sh@46 -- # : 0 00:23:20.162 15:24:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:20.162 15:24:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:20.162 15:24:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:20.162 15:24:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:20.162 15:24:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:20.162 15:24:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:20.162 15:24:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:20.162 15:24:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:20.162 15:24:18 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:20.162 15:24:18 -- host/dma.sh@13 -- # exit 0 00:23:20.162 00:23:20.162 real 0m0.149s 00:23:20.162 user 0m0.096s 00:23:20.162 sys 0m0.062s 00:23:20.162 15:24:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:20.162 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:20.162 ************************************ 00:23:20.162 END TEST dma 00:23:20.162 ************************************ 00:23:20.162 15:24:18 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:20.162 15:24:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:20.162 15:24:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:20.162 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:20.162 ************************************ 00:23:20.162 START TEST nvmf_identify 00:23:20.162 ************************************ 00:23:20.162 15:24:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:20.162 * Looking for test storage... 00:23:20.162 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:20.162 15:24:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:20.162 15:24:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:20.162 15:24:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:20.422 15:24:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:20.422 15:24:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:20.422 15:24:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:20.422 15:24:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:20.422 15:24:18 -- scripts/common.sh@335 -- # IFS=.-: 00:23:20.422 15:24:18 -- scripts/common.sh@335 -- # read -ra ver1 00:23:20.422 15:24:18 -- scripts/common.sh@336 -- # IFS=.-: 00:23:20.422 15:24:18 -- scripts/common.sh@336 -- # read -ra ver2 00:23:20.422 15:24:18 -- scripts/common.sh@337 -- # local 'op=<' 00:23:20.422 15:24:18 -- scripts/common.sh@339 -- # ver1_l=2 00:23:20.422 15:24:18 -- scripts/common.sh@340 -- # ver2_l=1 00:23:20.422 15:24:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:20.422 15:24:18 -- scripts/common.sh@343 -- # case "$op" in 00:23:20.422 15:24:18 -- scripts/common.sh@344 -- # : 1 00:23:20.422 15:24:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:20.422 15:24:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:20.422 15:24:18 -- scripts/common.sh@364 -- # decimal 1 00:23:20.422 15:24:18 -- scripts/common.sh@352 -- # local d=1 00:23:20.422 15:24:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:20.422 15:24:18 -- scripts/common.sh@354 -- # echo 1 00:23:20.422 15:24:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:20.422 15:24:18 -- scripts/common.sh@365 -- # decimal 2 00:23:20.422 15:24:18 -- scripts/common.sh@352 -- # local d=2 00:23:20.422 15:24:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:20.422 15:24:18 -- scripts/common.sh@354 -- # echo 2 00:23:20.422 15:24:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:20.422 15:24:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:20.422 15:24:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:20.422 15:24:18 -- scripts/common.sh@367 -- # return 0 00:23:20.422 15:24:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:20.422 15:24:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:20.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.422 --rc genhtml_branch_coverage=1 00:23:20.422 --rc genhtml_function_coverage=1 00:23:20.422 --rc genhtml_legend=1 00:23:20.422 --rc geninfo_all_blocks=1 00:23:20.422 --rc geninfo_unexecuted_blocks=1 00:23:20.422 00:23:20.422 ' 00:23:20.422 15:24:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:20.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.422 --rc genhtml_branch_coverage=1 00:23:20.422 --rc genhtml_function_coverage=1 00:23:20.422 --rc genhtml_legend=1 00:23:20.422 --rc geninfo_all_blocks=1 00:23:20.422 --rc geninfo_unexecuted_blocks=1 00:23:20.422 00:23:20.422 ' 00:23:20.422 15:24:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:20.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.422 --rc genhtml_branch_coverage=1 00:23:20.422 --rc genhtml_function_coverage=1 00:23:20.422 --rc genhtml_legend=1 00:23:20.422 --rc geninfo_all_blocks=1 00:23:20.422 --rc geninfo_unexecuted_blocks=1 00:23:20.422 00:23:20.422 ' 00:23:20.422 15:24:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:20.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:20.422 --rc genhtml_branch_coverage=1 00:23:20.422 --rc genhtml_function_coverage=1 00:23:20.422 --rc genhtml_legend=1 00:23:20.422 --rc geninfo_all_blocks=1 00:23:20.422 --rc geninfo_unexecuted_blocks=1 00:23:20.422 00:23:20.422 ' 00:23:20.422 15:24:18 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:20.422 15:24:18 -- nvmf/common.sh@7 -- # uname -s 00:23:20.422 15:24:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:20.422 15:24:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:20.422 15:24:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:20.422 15:24:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:20.422 15:24:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:20.422 15:24:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:20.422 15:24:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:20.422 15:24:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:20.422 15:24:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:20.422 15:24:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:20.422 15:24:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:20.422 15:24:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:20.422 15:24:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:20.422 15:24:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:20.422 15:24:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:20.422 15:24:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:20.422 15:24:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:20.422 15:24:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:20.422 15:24:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:20.422 15:24:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.422 15:24:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.422 15:24:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.422 15:24:18 -- paths/export.sh@5 -- # export PATH 00:23:20.422 15:24:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:20.422 15:24:18 -- nvmf/common.sh@46 -- # : 0 00:23:20.422 15:24:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:20.422 15:24:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:20.422 15:24:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:20.422 15:24:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:20.423 15:24:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:20.423 15:24:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:20.423 15:24:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:20.423 15:24:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:20.423 15:24:18 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:20.423 15:24:18 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:20.423 15:24:18 -- host/identify.sh@14 -- # nvmftestinit 00:23:20.423 15:24:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:20.423 15:24:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:20.423 15:24:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:20.423 15:24:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:20.423 15:24:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:20.423 15:24:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:20.423 15:24:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:20.423 15:24:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:20.423 15:24:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:20.423 15:24:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:20.423 15:24:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:20.423 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:23:22.325 15:24:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:22.325 15:24:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:22.325 15:24:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:22.325 15:24:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:22.325 15:24:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:22.325 15:24:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:22.325 15:24:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:22.325 15:24:20 -- nvmf/common.sh@294 -- # net_devs=() 00:23:22.325 15:24:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:22.325 15:24:20 -- nvmf/common.sh@295 -- # e810=() 00:23:22.325 15:24:20 -- nvmf/common.sh@295 -- # local -ga e810 00:23:22.325 15:24:20 -- nvmf/common.sh@296 -- # x722=() 00:23:22.325 15:24:20 -- nvmf/common.sh@296 -- # local -ga x722 00:23:22.325 15:24:20 -- nvmf/common.sh@297 -- # mlx=() 00:23:22.325 15:24:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:22.325 15:24:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:22.325 15:24:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:22.325 15:24:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:22.325 15:24:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:22.325 15:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:22.325 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:22.325 15:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:22.325 15:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:22.325 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:22.325 15:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:22.325 15:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:22.325 15:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:22.325 15:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:22.325 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:22.325 15:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:22.325 15:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:22.325 15:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:22.325 15:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:22.325 15:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:22.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:22.325 15:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:22.325 15:24:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:22.325 15:24:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:22.325 15:24:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:22.325 15:24:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:22.325 15:24:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:22.325 15:24:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:22.325 15:24:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:22.325 15:24:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:22.325 15:24:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:22.325 15:24:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:22.325 15:24:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:22.325 15:24:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:22.325 15:24:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:22.325 15:24:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:22.326 15:24:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:22.326 15:24:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:22.326 15:24:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:22.326 15:24:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:22.326 15:24:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:22.326 15:24:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:22.326 15:24:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:22.326 15:24:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:22.326 15:24:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:22.326 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:22.326 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:23:22.326 00:23:22.326 --- 10.0.0.2 ping statistics --- 00:23:22.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:22.326 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:23:22.326 15:24:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:22.326 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:22.326 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:23:22.326 00:23:22.326 --- 10.0.0.1 ping statistics --- 00:23:22.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:22.326 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:23:22.326 15:24:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:22.326 15:24:20 -- nvmf/common.sh@410 -- # return 0 00:23:22.326 15:24:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:22.326 15:24:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:22.326 15:24:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:22.326 15:24:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:22.326 15:24:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:22.326 15:24:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:22.326 15:24:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:22.326 15:24:20 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:22.326 15:24:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:22.326 15:24:20 -- common/autotest_common.sh@10 -- # set +x 00:23:22.326 15:24:20 -- host/identify.sh@19 -- # nvmfpid=2842648 00:23:22.326 15:24:20 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:22.326 15:24:20 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:22.326 15:24:20 -- host/identify.sh@23 -- # waitforlisten 2842648 00:23:22.326 15:24:20 -- common/autotest_common.sh@829 -- # '[' -z 2842648 ']' 00:23:22.326 15:24:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:22.326 15:24:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:22.326 15:24:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:22.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:22.326 15:24:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:22.326 15:24:20 -- common/autotest_common.sh@10 -- # set +x 00:23:22.584 [2024-11-19 15:24:20.910603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:22.584 [2024-11-19 15:24:20.910677] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:22.584 EAL: No free 2048 kB hugepages reported on node 1 00:23:22.584 [2024-11-19 15:24:20.980416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:22.584 [2024-11-19 15:24:21.097777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:22.584 [2024-11-19 15:24:21.097928] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:22.584 [2024-11-19 15:24:21.097945] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:22.584 [2024-11-19 15:24:21.097958] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:22.584 [2024-11-19 15:24:21.099731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:22.584 [2024-11-19 15:24:21.099766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:22.584 [2024-11-19 15:24:21.099829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:22.584 [2024-11-19 15:24:21.099831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:23.518 15:24:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:23.518 15:24:21 -- common/autotest_common.sh@862 -- # return 0 00:23:23.518 15:24:21 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:23.518 15:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:21 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 [2024-11-19 15:24:21.964464] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:23.518 15:24:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:21 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:23.518 15:24:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:23.518 15:24:21 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 15:24:21 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:23.518 15:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:21 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 Malloc0 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:23.518 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:23.518 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:23.518 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 [2024-11-19 15:24:22.041209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:23.518 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:23.518 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.518 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:23.518 [2024-11-19 15:24:22.056930] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:23.518 [ 00:23:23.518 { 00:23:23.518 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:23.518 "subtype": "Discovery", 00:23:23.518 "listen_addresses": [ 00:23:23.518 { 00:23:23.518 "transport": "TCP", 00:23:23.518 "trtype": "TCP", 00:23:23.518 "adrfam": "IPv4", 00:23:23.518 "traddr": "10.0.0.2", 00:23:23.518 "trsvcid": "4420" 00:23:23.518 } 00:23:23.518 ], 00:23:23.518 "allow_any_host": true, 00:23:23.518 "hosts": [] 00:23:23.518 }, 00:23:23.518 { 00:23:23.518 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:23.518 "subtype": "NVMe", 00:23:23.518 "listen_addresses": [ 00:23:23.518 { 00:23:23.518 "transport": "TCP", 00:23:23.518 "trtype": "TCP", 00:23:23.518 "adrfam": "IPv4", 00:23:23.518 "traddr": "10.0.0.2", 00:23:23.518 "trsvcid": "4420" 00:23:23.518 } 00:23:23.518 ], 00:23:23.518 "allow_any_host": true, 00:23:23.518 "hosts": [], 00:23:23.518 "serial_number": "SPDK00000000000001", 00:23:23.518 "model_number": "SPDK bdev Controller", 00:23:23.518 "max_namespaces": 32, 00:23:23.518 "min_cntlid": 1, 00:23:23.518 "max_cntlid": 65519, 00:23:23.518 "namespaces": [ 00:23:23.518 { 00:23:23.518 "nsid": 1, 00:23:23.518 "bdev_name": "Malloc0", 00:23:23.518 "name": "Malloc0", 00:23:23.518 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:23.518 "eui64": "ABCDEF0123456789", 00:23:23.518 "uuid": "5d0b0e69-3bdf-483b-8e29-c270eab7334f" 00:23:23.518 } 00:23:23.518 ] 00:23:23.518 } 00:23:23.518 ] 00:23:23.518 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.518 15:24:22 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:23.778 [2024-11-19 15:24:22.084064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:23.778 [2024-11-19 15:24:22.084106] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2842804 ] 00:23:23.778 EAL: No free 2048 kB hugepages reported on node 1 00:23:23.778 [2024-11-19 15:24:22.115372] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:23.778 [2024-11-19 15:24:22.115433] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:23.778 [2024-11-19 15:24:22.115443] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:23.778 [2024-11-19 15:24:22.115458] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:23.778 [2024-11-19 15:24:22.115470] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:23.778 [2024-11-19 15:24:22.118732] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:23.778 [2024-11-19 15:24:22.118793] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x8ffe10 0 00:23:23.778 [2024-11-19 15:24:22.126707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:23.778 [2024-11-19 15:24:22.126728] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:23.778 [2024-11-19 15:24:22.126736] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:23.778 [2024-11-19 15:24:22.126742] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:23.778 [2024-11-19 15:24:22.126791] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.778 [2024-11-19 15:24:22.126804] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.778 [2024-11-19 15:24:22.126811] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.778 [2024-11-19 15:24:22.126840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:23.778 [2024-11-19 15:24:22.126866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.778 [2024-11-19 15:24:22.134716] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.778 [2024-11-19 15:24:22.134738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.778 [2024-11-19 15:24:22.134746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.778 [2024-11-19 15:24:22.134753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.778 [2024-11-19 15:24:22.134768] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:23.778 [2024-11-19 15:24:22.134778] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:23.779 [2024-11-19 15:24:22.134786] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:23.779 [2024-11-19 15:24:22.134804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.134811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.134818] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.134828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.134851] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.135007] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.135022] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.135029] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135035] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.135044] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:23.779 [2024-11-19 15:24:22.135057] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:23.779 [2024-11-19 15:24:22.135069] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135076] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135082] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.135093] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.135114] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.135205] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.135220] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.135226] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135233] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.135242] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:23.779 [2024-11-19 15:24:22.135255] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.135267] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135280] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.135290] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.135310] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.135408] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.135426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.135434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135440] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.135449] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.135465] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135473] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135480] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.135490] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.135510] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.135607] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.135622] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.135628] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135635] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.135643] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:23.779 [2024-11-19 15:24:22.135651] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.135663] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.135773] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:23.779 [2024-11-19 15:24:22.135783] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.135797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135804] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.135810] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.135821] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.135842] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.135980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.135994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.136001] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136007] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.136015] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:23.779 [2024-11-19 15:24:22.136031] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136040] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136046] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.136057] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.136077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.136184] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.136197] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.136203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136209] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.136217] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:23.779 [2024-11-19 15:24:22.136225] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:23.779 [2024-11-19 15:24:22.136237] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:23.779 [2024-11-19 15:24:22.136251] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:23.779 [2024-11-19 15:24:22.136265] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136273] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136279] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.136289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.779 [2024-11-19 15:24:22.136310] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.779 [2024-11-19 15:24:22.136452] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:23.779 [2024-11-19 15:24:22.136468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:23.779 [2024-11-19 15:24:22.136475] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136481] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8ffe10): datao=0, datal=4096, cccid=0 00:23:23.779 [2024-11-19 15:24:22.136489] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x97fb30) on tqpair(0x8ffe10): expected_datao=0, payload_size=4096 00:23:23.779 [2024-11-19 15:24:22.136501] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136509] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136546] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.779 [2024-11-19 15:24:22.136560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.779 [2024-11-19 15:24:22.136566] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.779 [2024-11-19 15:24:22.136584] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:23.779 [2024-11-19 15:24:22.136593] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:23.779 [2024-11-19 15:24:22.136600] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:23.779 [2024-11-19 15:24:22.136609] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:23.779 [2024-11-19 15:24:22.136616] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:23.779 [2024-11-19 15:24:22.136623] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:23.779 [2024-11-19 15:24:22.136642] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:23.779 [2024-11-19 15:24:22.136655] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.779 [2024-11-19 15:24:22.136673] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.779 [2024-11-19 15:24:22.136684] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:23.780 [2024-11-19 15:24:22.136714] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.780 [2024-11-19 15:24:22.136850] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.136865] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.136872] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136878] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97fb30) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.136889] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136896] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136903] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.136912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:23.780 [2024-11-19 15:24:22.136923] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136929] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.136943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:23.780 [2024-11-19 15:24:22.136953] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136959] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136965] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.136973] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:23.780 [2024-11-19 15:24:22.136983] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136989] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.136995] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.137004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:23.780 [2024-11-19 15:24:22.137012] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:23.780 [2024-11-19 15:24:22.137031] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:23.780 [2024-11-19 15:24:22.137043] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137050] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137056] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.137066] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.780 [2024-11-19 15:24:22.137088] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fb30, cid 0, qid 0 00:23:23.780 [2024-11-19 15:24:22.137099] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fc90, cid 1, qid 0 00:23:23.780 [2024-11-19 15:24:22.137107] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97fdf0, cid 2, qid 0 00:23:23.780 [2024-11-19 15:24:22.137118] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.780 [2024-11-19 15:24:22.137126] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9800b0, cid 4, qid 0 00:23:23.780 [2024-11-19 15:24:22.137267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.137282] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.137288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137294] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9800b0) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.137303] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:23.780 [2024-11-19 15:24:22.137312] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:23.780 [2024-11-19 15:24:22.137328] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137344] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.137354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.780 [2024-11-19 15:24:22.137375] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9800b0, cid 4, qid 0 00:23:23.780 [2024-11-19 15:24:22.137517] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:23.780 [2024-11-19 15:24:22.137532] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:23.780 [2024-11-19 15:24:22.137539] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137545] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8ffe10): datao=0, datal=4096, cccid=4 00:23:23.780 [2024-11-19 15:24:22.137552] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9800b0) on tqpair(0x8ffe10): expected_datao=0, payload_size=4096 00:23:23.780 [2024-11-19 15:24:22.137563] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137570] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137597] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.137610] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.137616] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137622] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9800b0) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.137640] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:23.780 [2024-11-19 15:24:22.137675] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137685] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.137710] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.780 [2024-11-19 15:24:22.137721] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137728] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.137743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:23.780 [2024-11-19 15:24:22.137769] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9800b0, cid 4, qid 0 00:23:23.780 [2024-11-19 15:24:22.137781] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x980210, cid 5, qid 0 00:23:23.780 [2024-11-19 15:24:22.137971] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:23.780 [2024-11-19 15:24:22.137986] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:23.780 [2024-11-19 15:24:22.137992] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.137999] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8ffe10): datao=0, datal=1024, cccid=4 00:23:23.780 [2024-11-19 15:24:22.138006] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9800b0) on tqpair(0x8ffe10): expected_datao=0, payload_size=1024 00:23:23.780 [2024-11-19 15:24:22.138016] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.138023] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.138031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.138040] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.138046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.138052] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x980210) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.182701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.182718] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.182725] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.182731] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9800b0) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.182748] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.182756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.182762] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.182772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.780 [2024-11-19 15:24:22.182816] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9800b0, cid 4, qid 0 00:23:23.780 [2024-11-19 15:24:22.182997] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:23.780 [2024-11-19 15:24:22.183013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:23.780 [2024-11-19 15:24:22.183019] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.183025] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8ffe10): datao=0, datal=3072, cccid=4 00:23:23.780 [2024-11-19 15:24:22.183033] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9800b0) on tqpair(0x8ffe10): expected_datao=0, payload_size=3072 00:23:23.780 [2024-11-19 15:24:22.183060] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.183070] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.223812] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.780 [2024-11-19 15:24:22.223830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.780 [2024-11-19 15:24:22.223837] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.223844] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9800b0) on tqpair=0x8ffe10 00:23:23.780 [2024-11-19 15:24:22.223860] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.223868] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.780 [2024-11-19 15:24:22.223875] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8ffe10) 00:23:23.780 [2024-11-19 15:24:22.223886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.780 [2024-11-19 15:24:22.223915] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9800b0, cid 4, qid 0 00:23:23.780 [2024-11-19 15:24:22.224018] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:23.781 [2024-11-19 15:24:22.224038] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:23.781 [2024-11-19 15:24:22.224045] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:23.781 [2024-11-19 15:24:22.224051] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8ffe10): datao=0, datal=8, cccid=4 00:23:23.781 [2024-11-19 15:24:22.224058] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9800b0) on tqpair(0x8ffe10): expected_datao=0, payload_size=8 00:23:23.781 [2024-11-19 15:24:22.224069] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:23.781 [2024-11-19 15:24:22.224076] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:23.781 [2024-11-19 15:24:22.264796] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.781 [2024-11-19 15:24:22.264814] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.781 [2024-11-19 15:24:22.264821] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.781 [2024-11-19 15:24:22.264828] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9800b0) on tqpair=0x8ffe10 00:23:23.781 ===================================================== 00:23:23.781 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:23.781 ===================================================== 00:23:23.781 Controller Capabilities/Features 00:23:23.781 ================================ 00:23:23.781 Vendor ID: 0000 00:23:23.781 Subsystem Vendor ID: 0000 00:23:23.781 Serial Number: .................... 00:23:23.781 Model Number: ........................................ 00:23:23.781 Firmware Version: 24.01.1 00:23:23.781 Recommended Arb Burst: 0 00:23:23.781 IEEE OUI Identifier: 00 00 00 00:23:23.781 Multi-path I/O 00:23:23.781 May have multiple subsystem ports: No 00:23:23.781 May have multiple controllers: No 00:23:23.781 Associated with SR-IOV VF: No 00:23:23.781 Max Data Transfer Size: 131072 00:23:23.781 Max Number of Namespaces: 0 00:23:23.781 Max Number of I/O Queues: 1024 00:23:23.781 NVMe Specification Version (VS): 1.3 00:23:23.781 NVMe Specification Version (Identify): 1.3 00:23:23.781 Maximum Queue Entries: 128 00:23:23.781 Contiguous Queues Required: Yes 00:23:23.781 Arbitration Mechanisms Supported 00:23:23.781 Weighted Round Robin: Not Supported 00:23:23.781 Vendor Specific: Not Supported 00:23:23.781 Reset Timeout: 15000 ms 00:23:23.781 Doorbell Stride: 4 bytes 00:23:23.781 NVM Subsystem Reset: Not Supported 00:23:23.781 Command Sets Supported 00:23:23.781 NVM Command Set: Supported 00:23:23.781 Boot Partition: Not Supported 00:23:23.781 Memory Page Size Minimum: 4096 bytes 00:23:23.781 Memory Page Size Maximum: 4096 bytes 00:23:23.781 Persistent Memory Region: Not Supported 00:23:23.781 Optional Asynchronous Events Supported 00:23:23.781 Namespace Attribute Notices: Not Supported 00:23:23.781 Firmware Activation Notices: Not Supported 00:23:23.781 ANA Change Notices: Not Supported 00:23:23.781 PLE Aggregate Log Change Notices: Not Supported 00:23:23.781 LBA Status Info Alert Notices: Not Supported 00:23:23.781 EGE Aggregate Log Change Notices: Not Supported 00:23:23.781 Normal NVM Subsystem Shutdown event: Not Supported 00:23:23.781 Zone Descriptor Change Notices: Not Supported 00:23:23.781 Discovery Log Change Notices: Supported 00:23:23.781 Controller Attributes 00:23:23.781 128-bit Host Identifier: Not Supported 00:23:23.781 Non-Operational Permissive Mode: Not Supported 00:23:23.781 NVM Sets: Not Supported 00:23:23.781 Read Recovery Levels: Not Supported 00:23:23.781 Endurance Groups: Not Supported 00:23:23.781 Predictable Latency Mode: Not Supported 00:23:23.781 Traffic Based Keep ALive: Not Supported 00:23:23.781 Namespace Granularity: Not Supported 00:23:23.781 SQ Associations: Not Supported 00:23:23.781 UUID List: Not Supported 00:23:23.781 Multi-Domain Subsystem: Not Supported 00:23:23.781 Fixed Capacity Management: Not Supported 00:23:23.781 Variable Capacity Management: Not Supported 00:23:23.781 Delete Endurance Group: Not Supported 00:23:23.781 Delete NVM Set: Not Supported 00:23:23.781 Extended LBA Formats Supported: Not Supported 00:23:23.781 Flexible Data Placement Supported: Not Supported 00:23:23.781 00:23:23.781 Controller Memory Buffer Support 00:23:23.781 ================================ 00:23:23.781 Supported: No 00:23:23.781 00:23:23.781 Persistent Memory Region Support 00:23:23.781 ================================ 00:23:23.781 Supported: No 00:23:23.781 00:23:23.781 Admin Command Set Attributes 00:23:23.781 ============================ 00:23:23.781 Security Send/Receive: Not Supported 00:23:23.781 Format NVM: Not Supported 00:23:23.781 Firmware Activate/Download: Not Supported 00:23:23.781 Namespace Management: Not Supported 00:23:23.781 Device Self-Test: Not Supported 00:23:23.781 Directives: Not Supported 00:23:23.781 NVMe-MI: Not Supported 00:23:23.781 Virtualization Management: Not Supported 00:23:23.781 Doorbell Buffer Config: Not Supported 00:23:23.781 Get LBA Status Capability: Not Supported 00:23:23.781 Command & Feature Lockdown Capability: Not Supported 00:23:23.781 Abort Command Limit: 1 00:23:23.781 Async Event Request Limit: 4 00:23:23.781 Number of Firmware Slots: N/A 00:23:23.781 Firmware Slot 1 Read-Only: N/A 00:23:23.781 Firmware Activation Without Reset: N/A 00:23:23.781 Multiple Update Detection Support: N/A 00:23:23.781 Firmware Update Granularity: No Information Provided 00:23:23.781 Per-Namespace SMART Log: No 00:23:23.781 Asymmetric Namespace Access Log Page: Not Supported 00:23:23.781 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:23.781 Command Effects Log Page: Not Supported 00:23:23.781 Get Log Page Extended Data: Supported 00:23:23.781 Telemetry Log Pages: Not Supported 00:23:23.781 Persistent Event Log Pages: Not Supported 00:23:23.781 Supported Log Pages Log Page: May Support 00:23:23.781 Commands Supported & Effects Log Page: Not Supported 00:23:23.781 Feature Identifiers & Effects Log Page:May Support 00:23:23.781 NVMe-MI Commands & Effects Log Page: May Support 00:23:23.781 Data Area 4 for Telemetry Log: Not Supported 00:23:23.781 Error Log Page Entries Supported: 128 00:23:23.781 Keep Alive: Not Supported 00:23:23.781 00:23:23.781 NVM Command Set Attributes 00:23:23.781 ========================== 00:23:23.781 Submission Queue Entry Size 00:23:23.781 Max: 1 00:23:23.781 Min: 1 00:23:23.781 Completion Queue Entry Size 00:23:23.781 Max: 1 00:23:23.781 Min: 1 00:23:23.781 Number of Namespaces: 0 00:23:23.781 Compare Command: Not Supported 00:23:23.781 Write Uncorrectable Command: Not Supported 00:23:23.781 Dataset Management Command: Not Supported 00:23:23.781 Write Zeroes Command: Not Supported 00:23:23.781 Set Features Save Field: Not Supported 00:23:23.781 Reservations: Not Supported 00:23:23.781 Timestamp: Not Supported 00:23:23.781 Copy: Not Supported 00:23:23.781 Volatile Write Cache: Not Present 00:23:23.781 Atomic Write Unit (Normal): 1 00:23:23.781 Atomic Write Unit (PFail): 1 00:23:23.781 Atomic Compare & Write Unit: 1 00:23:23.781 Fused Compare & Write: Supported 00:23:23.781 Scatter-Gather List 00:23:23.781 SGL Command Set: Supported 00:23:23.781 SGL Keyed: Supported 00:23:23.781 SGL Bit Bucket Descriptor: Not Supported 00:23:23.781 SGL Metadata Pointer: Not Supported 00:23:23.781 Oversized SGL: Not Supported 00:23:23.781 SGL Metadata Address: Not Supported 00:23:23.781 SGL Offset: Supported 00:23:23.781 Transport SGL Data Block: Not Supported 00:23:23.781 Replay Protected Memory Block: Not Supported 00:23:23.781 00:23:23.781 Firmware Slot Information 00:23:23.781 ========================= 00:23:23.781 Active slot: 0 00:23:23.781 00:23:23.781 00:23:23.781 Error Log 00:23:23.781 ========= 00:23:23.781 00:23:23.781 Active Namespaces 00:23:23.781 ================= 00:23:23.781 Discovery Log Page 00:23:23.781 ================== 00:23:23.781 Generation Counter: 2 00:23:23.781 Number of Records: 2 00:23:23.781 Record Format: 0 00:23:23.781 00:23:23.781 Discovery Log Entry 0 00:23:23.781 ---------------------- 00:23:23.781 Transport Type: 3 (TCP) 00:23:23.781 Address Family: 1 (IPv4) 00:23:23.781 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:23.781 Entry Flags: 00:23:23.781 Duplicate Returned Information: 1 00:23:23.781 Explicit Persistent Connection Support for Discovery: 1 00:23:23.781 Transport Requirements: 00:23:23.781 Secure Channel: Not Required 00:23:23.781 Port ID: 0 (0x0000) 00:23:23.781 Controller ID: 65535 (0xffff) 00:23:23.781 Admin Max SQ Size: 128 00:23:23.781 Transport Service Identifier: 4420 00:23:23.781 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:23.781 Transport Address: 10.0.0.2 00:23:23.781 Discovery Log Entry 1 00:23:23.781 ---------------------- 00:23:23.781 Transport Type: 3 (TCP) 00:23:23.781 Address Family: 1 (IPv4) 00:23:23.782 Subsystem Type: 2 (NVM Subsystem) 00:23:23.782 Entry Flags: 00:23:23.782 Duplicate Returned Information: 0 00:23:23.782 Explicit Persistent Connection Support for Discovery: 0 00:23:23.782 Transport Requirements: 00:23:23.782 Secure Channel: Not Required 00:23:23.782 Port ID: 0 (0x0000) 00:23:23.782 Controller ID: 65535 (0xffff) 00:23:23.782 Admin Max SQ Size: 128 00:23:23.782 Transport Service Identifier: 4420 00:23:23.782 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:23.782 Transport Address: 10.0.0.2 [2024-11-19 15:24:22.264940] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:23.782 [2024-11-19 15:24:22.264964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:23.782 [2024-11-19 15:24:22.264986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:23.782 [2024-11-19 15:24:22.264995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:23.782 [2024-11-19 15:24:22.265004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:23.782 [2024-11-19 15:24:22.265017] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265024] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265030] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.782 [2024-11-19 15:24:22.265041] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.782 [2024-11-19 15:24:22.265066] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.782 [2024-11-19 15:24:22.265182] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.782 [2024-11-19 15:24:22.265197] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.782 [2024-11-19 15:24:22.265203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265209] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97ff50) on tqpair=0x8ffe10 00:23:23.782 [2024-11-19 15:24:22.265221] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265228] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265235] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.782 [2024-11-19 15:24:22.265245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.782 [2024-11-19 15:24:22.265271] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.782 [2024-11-19 15:24:22.265384] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.782 [2024-11-19 15:24:22.265399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.782 [2024-11-19 15:24:22.265405] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97ff50) on tqpair=0x8ffe10 00:23:23.782 [2024-11-19 15:24:22.265419] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:23.782 [2024-11-19 15:24:22.265427] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:23.782 [2024-11-19 15:24:22.265447] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265456] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265463] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.782 [2024-11-19 15:24:22.265473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.782 [2024-11-19 15:24:22.265493] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.782 [2024-11-19 15:24:22.265576] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.782 [2024-11-19 15:24:22.265590] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.782 [2024-11-19 15:24:22.265597] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265603] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97ff50) on tqpair=0x8ffe10 00:23:23.782 [2024-11-19 15:24:22.265619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265628] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.265635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.782 [2024-11-19 15:24:22.265645] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.782 [2024-11-19 15:24:22.265666] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.782 [2024-11-19 15:24:22.269718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.782 [2024-11-19 15:24:22.269735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.782 [2024-11-19 15:24:22.269741] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.269748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97ff50) on tqpair=0x8ffe10 00:23:23.782 [2024-11-19 15:24:22.269764] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.269773] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.269779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8ffe10) 00:23:23.782 [2024-11-19 15:24:22.269789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:23.782 [2024-11-19 15:24:22.269810] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x97ff50, cid 3, qid 0 00:23:23.782 [2024-11-19 15:24:22.269943] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:23.782 [2024-11-19 15:24:22.269958] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:23.782 [2024-11-19 15:24:22.269964] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.269971] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x97ff50) on tqpair=0x8ffe10 00:23:23.782 [2024-11-19 15:24:22.269984] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:23:23.782 00:23:23.782 15:24:22 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:23.782 [2024-11-19 15:24:22.300095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:23.782 [2024-11-19 15:24:22.300134] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2842810 ] 00:23:23.782 EAL: No free 2048 kB hugepages reported on node 1 00:23:23.782 [2024-11-19 15:24:22.331355] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:23.782 [2024-11-19 15:24:22.331404] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:23.782 [2024-11-19 15:24:22.331414] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:23.782 [2024-11-19 15:24:22.331428] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:23.782 [2024-11-19 15:24:22.331439] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:23.782 [2024-11-19 15:24:22.331608] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:23.782 [2024-11-19 15:24:22.331655] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x21d4e10 0 00:23:23.782 [2024-11-19 15:24:22.337715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:23.782 [2024-11-19 15:24:22.337736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:23.782 [2024-11-19 15:24:22.337745] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:23.782 [2024-11-19 15:24:22.337751] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:23.782 [2024-11-19 15:24:22.337794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.337806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:23.782 [2024-11-19 15:24:22.337813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:23.782 [2024-11-19 15:24:22.337826] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:23.782 [2024-11-19 15:24:22.337853] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.044 [2024-11-19 15:24:22.341702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.044 [2024-11-19 15:24:22.341721] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.044 [2024-11-19 15:24:22.341728] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.044 [2024-11-19 15:24:22.341750] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.044 [2024-11-19 15:24:22.341773] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:24.044 [2024-11-19 15:24:22.341785] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:24.044 [2024-11-19 15:24:22.341795] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:24.044 [2024-11-19 15:24:22.341811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.044 [2024-11-19 15:24:22.341823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.044 [2024-11-19 15:24:22.341830] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.044 [2024-11-19 15:24:22.341841] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.044 [2024-11-19 15:24:22.341866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.044 [2024-11-19 15:24:22.342004] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.044 [2024-11-19 15:24:22.342020] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.044 [2024-11-19 15:24:22.342026] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342036] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.342046] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:24.045 [2024-11-19 15:24:22.342058] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:24.045 [2024-11-19 15:24:22.342071] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342093] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.342104] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.342126] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.342212] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.342227] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.342233] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342240] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.342252] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:24.045 [2024-11-19 15:24:22.342266] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342278] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342285] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342291] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.342305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.342326] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.342417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.342431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.342438] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342447] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.342457] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342473] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.342501] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.342522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.342606] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.342621] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.342627] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342634] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.342642] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:24.045 [2024-11-19 15:24:22.342653] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342666] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342776] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:24.045 [2024-11-19 15:24:22.342786] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342803] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342817] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.342828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.342849] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.342936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.342951] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.342957] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.342964] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.342973] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:24.045 [2024-11-19 15:24:22.342992] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343007] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.343018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.343039] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.343177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.343191] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.343198] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343204] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.343213] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:24.045 [2024-11-19 15:24:22.343221] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:24.045 [2024-11-19 15:24:22.343236] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:24.045 [2024-11-19 15:24:22.343251] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:24.045 [2024-11-19 15:24:22.343264] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343272] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343278] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.343289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.045 [2024-11-19 15:24:22.343325] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.343474] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.045 [2024-11-19 15:24:22.343490] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.045 [2024-11-19 15:24:22.343516] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343523] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=4096, cccid=0 00:23:24.045 [2024-11-19 15:24:22.343531] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2254b30) on tqpair(0x21d4e10): expected_datao=0, payload_size=4096 00:23:24.045 [2024-11-19 15:24:22.343554] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.343564] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.383868] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.383888] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.383896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.383903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.383916] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:24.045 [2024-11-19 15:24:22.383924] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:24.045 [2024-11-19 15:24:22.383931] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:24.045 [2024-11-19 15:24:22.383938] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:24.045 [2024-11-19 15:24:22.383945] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:24.045 [2024-11-19 15:24:22.383953] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:24.045 [2024-11-19 15:24:22.383981] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:24.045 [2024-11-19 15:24:22.383995] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.384003] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.384009] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.384021] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.045 [2024-11-19 15:24:22.384044] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.045 [2024-11-19 15:24:22.384134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.045 [2024-11-19 15:24:22.384148] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.045 [2024-11-19 15:24:22.384155] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.384161] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254b30) on tqpair=0x21d4e10 00:23:24.045 [2024-11-19 15:24:22.384173] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.384180] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.045 [2024-11-19 15:24:22.384186] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d4e10) 00:23:24.045 [2024-11-19 15:24:22.384196] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.046 [2024-11-19 15:24:22.384207] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384213] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384219] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.384228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.046 [2024-11-19 15:24:22.384238] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384251] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.384259] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.046 [2024-11-19 15:24:22.384273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384281] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384287] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.384296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.046 [2024-11-19 15:24:22.384305] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.384340] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.384353] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384360] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.384376] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.046 [2024-11-19 15:24:22.384412] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254b30, cid 0, qid 0 00:23:24.046 [2024-11-19 15:24:22.384423] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254c90, cid 1, qid 0 00:23:24.046 [2024-11-19 15:24:22.384430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254df0, cid 2, qid 0 00:23:24.046 [2024-11-19 15:24:22.384437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.046 [2024-11-19 15:24:22.384459] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.046 [2024-11-19 15:24:22.384628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.046 [2024-11-19 15:24:22.384642] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.046 [2024-11-19 15:24:22.384649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.384655] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.046 [2024-11-19 15:24:22.384664] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:24.046 [2024-11-19 15:24:22.384683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.388710] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.388729] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.388741] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.388748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.388754] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.388765] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.046 [2024-11-19 15:24:22.388787] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.046 [2024-11-19 15:24:22.388941] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.046 [2024-11-19 15:24:22.388956] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.046 [2024-11-19 15:24:22.388962] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.388969] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.046 [2024-11-19 15:24:22.389040] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.389115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.046 [2024-11-19 15:24:22.389137] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.046 [2024-11-19 15:24:22.389264] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.046 [2024-11-19 15:24:22.389279] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.046 [2024-11-19 15:24:22.389286] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389292] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=4096, cccid=4 00:23:24.046 [2024-11-19 15:24:22.389300] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22550b0) on tqpair(0x21d4e10): expected_datao=0, payload_size=4096 00:23:24.046 [2024-11-19 15:24:22.389329] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389339] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389352] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.046 [2024-11-19 15:24:22.389362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.046 [2024-11-19 15:24:22.389368] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389375] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.046 [2024-11-19 15:24:22.389396] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:24.046 [2024-11-19 15:24:22.389417] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389436] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389451] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389458] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389464] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.389475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.046 [2024-11-19 15:24:22.389496] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.046 [2024-11-19 15:24:22.389618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.046 [2024-11-19 15:24:22.389634] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.046 [2024-11-19 15:24:22.389640] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389647] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=4096, cccid=4 00:23:24.046 [2024-11-19 15:24:22.389654] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22550b0) on tqpair(0x21d4e10): expected_datao=0, payload_size=4096 00:23:24.046 [2024-11-19 15:24:22.389681] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389700] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389713] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.046 [2024-11-19 15:24:22.389723] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.046 [2024-11-19 15:24:22.389733] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389740] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.046 [2024-11-19 15:24:22.389763] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389784] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.389799] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.046 [2024-11-19 15:24:22.389823] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.046 [2024-11-19 15:24:22.389845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.046 [2024-11-19 15:24:22.389942] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.046 [2024-11-19 15:24:22.389957] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.046 [2024-11-19 15:24:22.389967] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389974] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=4096, cccid=4 00:23:24.046 [2024-11-19 15:24:22.389981] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22550b0) on tqpair(0x21d4e10): expected_datao=0, payload_size=4096 00:23:24.046 [2024-11-19 15:24:22.389992] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.389999] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.390034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.046 [2024-11-19 15:24:22.390048] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.046 [2024-11-19 15:24:22.390054] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.046 [2024-11-19 15:24:22.390060] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.046 [2024-11-19 15:24:22.390074] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.390091] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:24.046 [2024-11-19 15:24:22.390106] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:24.047 [2024-11-19 15:24:22.390117] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:24.047 [2024-11-19 15:24:22.390125] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:24.047 [2024-11-19 15:24:22.390134] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:24.047 [2024-11-19 15:24:22.390141] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:24.047 [2024-11-19 15:24:22.390150] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:24.047 [2024-11-19 15:24:22.390168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390177] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.390198] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.390210] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390217] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390223] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.390232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.047 [2024-11-19 15:24:22.390282] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.047 [2024-11-19 15:24:22.390294] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255210, cid 5, qid 0 00:23:24.047 [2024-11-19 15:24:22.390483] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.390497] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.390504] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390510] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.047 [2024-11-19 15:24:22.390521] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.390530] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.390536] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390542] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255210) on tqpair=0x21d4e10 00:23:24.047 [2024-11-19 15:24:22.390561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390570] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390577] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.390587] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.390607] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255210, cid 5, qid 0 00:23:24.047 [2024-11-19 15:24:22.390758] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.390774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.390780] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390787] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255210) on tqpair=0x21d4e10 00:23:24.047 [2024-11-19 15:24:22.390807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390815] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.390832] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.390856] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255210, cid 5, qid 0 00:23:24.047 [2024-11-19 15:24:22.390943] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.390958] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.390964] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390971] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255210) on tqpair=0x21d4e10 00:23:24.047 [2024-11-19 15:24:22.390987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.390998] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391005] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.391015] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.391040] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255210, cid 5, qid 0 00:23:24.047 [2024-11-19 15:24:22.391126] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.391140] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.391146] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391153] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255210) on tqpair=0x21d4e10 00:23:24.047 [2024-11-19 15:24:22.391176] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391186] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.391202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.391218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391226] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391232] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.391241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.391253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391260] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391266] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.391275] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.391287] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391294] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391300] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x21d4e10) 00:23:24.047 [2024-11-19 15:24:22.391325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.047 [2024-11-19 15:24:22.391348] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255210, cid 5, qid 0 00:23:24.047 [2024-11-19 15:24:22.391358] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22550b0, cid 4, qid 0 00:23:24.047 [2024-11-19 15:24:22.391365] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2255370, cid 6, qid 0 00:23:24.047 [2024-11-19 15:24:22.391372] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22554d0, cid 7, qid 0 00:23:24.047 [2024-11-19 15:24:22.391586] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.047 [2024-11-19 15:24:22.391601] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.047 [2024-11-19 15:24:22.391608] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391614] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=8192, cccid=5 00:23:24.047 [2024-11-19 15:24:22.391622] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2255210) on tqpair(0x21d4e10): expected_datao=0, payload_size=8192 00:23:24.047 [2024-11-19 15:24:22.391641] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391650] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391662] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.047 [2024-11-19 15:24:22.391672] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.047 [2024-11-19 15:24:22.391705] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391716] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=512, cccid=4 00:23:24.047 [2024-11-19 15:24:22.391724] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22550b0) on tqpair(0x21d4e10): expected_datao=0, payload_size=512 00:23:24.047 [2024-11-19 15:24:22.391735] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391743] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.047 [2024-11-19 15:24:22.391760] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.047 [2024-11-19 15:24:22.391766] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391772] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=512, cccid=6 00:23:24.047 [2024-11-19 15:24:22.391779] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2255370) on tqpair(0x21d4e10): expected_datao=0, payload_size=512 00:23:24.047 [2024-11-19 15:24:22.391789] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391796] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.047 [2024-11-19 15:24:22.391813] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.047 [2024-11-19 15:24:22.391819] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391825] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d4e10): datao=0, datal=4096, cccid=7 00:23:24.047 [2024-11-19 15:24:22.391832] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22554d0) on tqpair(0x21d4e10): expected_datao=0, payload_size=4096 00:23:24.047 [2024-11-19 15:24:22.391843] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391850] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391862] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.047 [2024-11-19 15:24:22.391871] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.047 [2024-11-19 15:24:22.391878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.047 [2024-11-19 15:24:22.391884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255210) on tqpair=0x21d4e10 00:23:24.048 [2024-11-19 15:24:22.391905] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.048 [2024-11-19 15:24:22.391916] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.048 [2024-11-19 15:24:22.391922] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.048 [2024-11-19 15:24:22.391928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22550b0) on tqpair=0x21d4e10 00:23:24.048 [2024-11-19 15:24:22.391943] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.048 [2024-11-19 15:24:22.391969] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.048 [2024-11-19 15:24:22.391975] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.048 [2024-11-19 15:24:22.391981] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2255370) on tqpair=0x21d4e10 00:23:24.048 [2024-11-19 15:24:22.391993] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.048 [2024-11-19 15:24:22.392001] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.048 [2024-11-19 15:24:22.392007] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.048 [2024-11-19 15:24:22.392028] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22554d0) on tqpair=0x21d4e10 00:23:24.048 ===================================================== 00:23:24.048 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.048 ===================================================== 00:23:24.048 Controller Capabilities/Features 00:23:24.048 ================================ 00:23:24.048 Vendor ID: 8086 00:23:24.048 Subsystem Vendor ID: 8086 00:23:24.048 Serial Number: SPDK00000000000001 00:23:24.048 Model Number: SPDK bdev Controller 00:23:24.048 Firmware Version: 24.01.1 00:23:24.048 Recommended Arb Burst: 6 00:23:24.048 IEEE OUI Identifier: e4 d2 5c 00:23:24.048 Multi-path I/O 00:23:24.048 May have multiple subsystem ports: Yes 00:23:24.048 May have multiple controllers: Yes 00:23:24.048 Associated with SR-IOV VF: No 00:23:24.048 Max Data Transfer Size: 131072 00:23:24.048 Max Number of Namespaces: 32 00:23:24.048 Max Number of I/O Queues: 127 00:23:24.048 NVMe Specification Version (VS): 1.3 00:23:24.048 NVMe Specification Version (Identify): 1.3 00:23:24.048 Maximum Queue Entries: 128 00:23:24.048 Contiguous Queues Required: Yes 00:23:24.048 Arbitration Mechanisms Supported 00:23:24.048 Weighted Round Robin: Not Supported 00:23:24.048 Vendor Specific: Not Supported 00:23:24.048 Reset Timeout: 15000 ms 00:23:24.048 Doorbell Stride: 4 bytes 00:23:24.048 NVM Subsystem Reset: Not Supported 00:23:24.048 Command Sets Supported 00:23:24.048 NVM Command Set: Supported 00:23:24.048 Boot Partition: Not Supported 00:23:24.048 Memory Page Size Minimum: 4096 bytes 00:23:24.048 Memory Page Size Maximum: 4096 bytes 00:23:24.048 Persistent Memory Region: Not Supported 00:23:24.048 Optional Asynchronous Events Supported 00:23:24.048 Namespace Attribute Notices: Supported 00:23:24.048 Firmware Activation Notices: Not Supported 00:23:24.048 ANA Change Notices: Not Supported 00:23:24.048 PLE Aggregate Log Change Notices: Not Supported 00:23:24.048 LBA Status Info Alert Notices: Not Supported 00:23:24.048 EGE Aggregate Log Change Notices: Not Supported 00:23:24.048 Normal NVM Subsystem Shutdown event: Not Supported 00:23:24.048 Zone Descriptor Change Notices: Not Supported 00:23:24.048 Discovery Log Change Notices: Not Supported 00:23:24.048 Controller Attributes 00:23:24.048 128-bit Host Identifier: Supported 00:23:24.048 Non-Operational Permissive Mode: Not Supported 00:23:24.048 NVM Sets: Not Supported 00:23:24.048 Read Recovery Levels: Not Supported 00:23:24.048 Endurance Groups: Not Supported 00:23:24.048 Predictable Latency Mode: Not Supported 00:23:24.048 Traffic Based Keep ALive: Not Supported 00:23:24.048 Namespace Granularity: Not Supported 00:23:24.048 SQ Associations: Not Supported 00:23:24.048 UUID List: Not Supported 00:23:24.048 Multi-Domain Subsystem: Not Supported 00:23:24.048 Fixed Capacity Management: Not Supported 00:23:24.048 Variable Capacity Management: Not Supported 00:23:24.048 Delete Endurance Group: Not Supported 00:23:24.048 Delete NVM Set: Not Supported 00:23:24.048 Extended LBA Formats Supported: Not Supported 00:23:24.048 Flexible Data Placement Supported: Not Supported 00:23:24.048 00:23:24.048 Controller Memory Buffer Support 00:23:24.048 ================================ 00:23:24.048 Supported: No 00:23:24.048 00:23:24.048 Persistent Memory Region Support 00:23:24.048 ================================ 00:23:24.048 Supported: No 00:23:24.048 00:23:24.048 Admin Command Set Attributes 00:23:24.048 ============================ 00:23:24.048 Security Send/Receive: Not Supported 00:23:24.048 Format NVM: Not Supported 00:23:24.048 Firmware Activate/Download: Not Supported 00:23:24.048 Namespace Management: Not Supported 00:23:24.048 Device Self-Test: Not Supported 00:23:24.048 Directives: Not Supported 00:23:24.048 NVMe-MI: Not Supported 00:23:24.048 Virtualization Management: Not Supported 00:23:24.048 Doorbell Buffer Config: Not Supported 00:23:24.048 Get LBA Status Capability: Not Supported 00:23:24.048 Command & Feature Lockdown Capability: Not Supported 00:23:24.048 Abort Command Limit: 4 00:23:24.048 Async Event Request Limit: 4 00:23:24.048 Number of Firmware Slots: N/A 00:23:24.048 Firmware Slot 1 Read-Only: N/A 00:23:24.048 Firmware Activation Without Reset: N/A 00:23:24.048 Multiple Update Detection Support: N/A 00:23:24.048 Firmware Update Granularity: No Information Provided 00:23:24.048 Per-Namespace SMART Log: No 00:23:24.048 Asymmetric Namespace Access Log Page: Not Supported 00:23:24.048 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:24.048 Command Effects Log Page: Supported 00:23:24.048 Get Log Page Extended Data: Supported 00:23:24.048 Telemetry Log Pages: Not Supported 00:23:24.048 Persistent Event Log Pages: Not Supported 00:23:24.048 Supported Log Pages Log Page: May Support 00:23:24.048 Commands Supported & Effects Log Page: Not Supported 00:23:24.048 Feature Identifiers & Effects Log Page:May Support 00:23:24.048 NVMe-MI Commands & Effects Log Page: May Support 00:23:24.048 Data Area 4 for Telemetry Log: Not Supported 00:23:24.048 Error Log Page Entries Supported: 128 00:23:24.048 Keep Alive: Supported 00:23:24.048 Keep Alive Granularity: 10000 ms 00:23:24.048 00:23:24.048 NVM Command Set Attributes 00:23:24.048 ========================== 00:23:24.048 Submission Queue Entry Size 00:23:24.048 Max: 64 00:23:24.048 Min: 64 00:23:24.048 Completion Queue Entry Size 00:23:24.048 Max: 16 00:23:24.048 Min: 16 00:23:24.048 Number of Namespaces: 32 00:23:24.048 Compare Command: Supported 00:23:24.048 Write Uncorrectable Command: Not Supported 00:23:24.048 Dataset Management Command: Supported 00:23:24.048 Write Zeroes Command: Supported 00:23:24.048 Set Features Save Field: Not Supported 00:23:24.048 Reservations: Supported 00:23:24.048 Timestamp: Not Supported 00:23:24.048 Copy: Supported 00:23:24.048 Volatile Write Cache: Present 00:23:24.048 Atomic Write Unit (Normal): 1 00:23:24.048 Atomic Write Unit (PFail): 1 00:23:24.048 Atomic Compare & Write Unit: 1 00:23:24.048 Fused Compare & Write: Supported 00:23:24.048 Scatter-Gather List 00:23:24.048 SGL Command Set: Supported 00:23:24.048 SGL Keyed: Supported 00:23:24.048 SGL Bit Bucket Descriptor: Not Supported 00:23:24.048 SGL Metadata Pointer: Not Supported 00:23:24.048 Oversized SGL: Not Supported 00:23:24.048 SGL Metadata Address: Not Supported 00:23:24.048 SGL Offset: Supported 00:23:24.048 Transport SGL Data Block: Not Supported 00:23:24.048 Replay Protected Memory Block: Not Supported 00:23:24.048 00:23:24.048 Firmware Slot Information 00:23:24.048 ========================= 00:23:24.048 Active slot: 1 00:23:24.048 Slot 1 Firmware Revision: 24.01.1 00:23:24.048 00:23:24.048 00:23:24.048 Commands Supported and Effects 00:23:24.048 ============================== 00:23:24.048 Admin Commands 00:23:24.048 -------------- 00:23:24.048 Get Log Page (02h): Supported 00:23:24.048 Identify (06h): Supported 00:23:24.048 Abort (08h): Supported 00:23:24.048 Set Features (09h): Supported 00:23:24.048 Get Features (0Ah): Supported 00:23:24.048 Asynchronous Event Request (0Ch): Supported 00:23:24.048 Keep Alive (18h): Supported 00:23:24.048 I/O Commands 00:23:24.048 ------------ 00:23:24.048 Flush (00h): Supported LBA-Change 00:23:24.048 Write (01h): Supported LBA-Change 00:23:24.048 Read (02h): Supported 00:23:24.048 Compare (05h): Supported 00:23:24.048 Write Zeroes (08h): Supported LBA-Change 00:23:24.048 Dataset Management (09h): Supported LBA-Change 00:23:24.048 Copy (19h): Supported LBA-Change 00:23:24.048 Unknown (79h): Supported LBA-Change 00:23:24.048 Unknown (7Ah): Supported 00:23:24.048 00:23:24.048 Error Log 00:23:24.048 ========= 00:23:24.048 00:23:24.048 Arbitration 00:23:24.048 =========== 00:23:24.048 Arbitration Burst: 1 00:23:24.048 00:23:24.048 Power Management 00:23:24.048 ================ 00:23:24.048 Number of Power States: 1 00:23:24.049 Current Power State: Power State #0 00:23:24.049 Power State #0: 00:23:24.049 Max Power: 0.00 W 00:23:24.049 Non-Operational State: Operational 00:23:24.049 Entry Latency: Not Reported 00:23:24.049 Exit Latency: Not Reported 00:23:24.049 Relative Read Throughput: 0 00:23:24.049 Relative Read Latency: 0 00:23:24.049 Relative Write Throughput: 0 00:23:24.049 Relative Write Latency: 0 00:23:24.049 Idle Power: Not Reported 00:23:24.049 Active Power: Not Reported 00:23:24.049 Non-Operational Permissive Mode: Not Supported 00:23:24.049 00:23:24.049 Health Information 00:23:24.049 ================== 00:23:24.049 Critical Warnings: 00:23:24.049 Available Spare Space: OK 00:23:24.049 Temperature: OK 00:23:24.049 Device Reliability: OK 00:23:24.049 Read Only: No 00:23:24.049 Volatile Memory Backup: OK 00:23:24.049 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:24.049 Temperature Threshold: [2024-11-19 15:24:22.392144] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.392156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.392162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.392175] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.392197] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22554d0, cid 7, qid 0 00:23:24.049 [2024-11-19 15:24:22.392351] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.392365] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.392372] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.392379] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22554d0) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.392420] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:24.049 [2024-11-19 15:24:22.392441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.049 [2024-11-19 15:24:22.392456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.049 [2024-11-19 15:24:22.392465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.049 [2024-11-19 15:24:22.392475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.049 [2024-11-19 15:24:22.392487] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.392494] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.392500] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.392526] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.392548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.396700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.396717] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.396724] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.396730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.396743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.396750] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.396756] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.396766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.396796] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.396955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.396970] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.396976] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.396983] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.396991] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:24.049 [2024-11-19 15:24:22.396999] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:24.049 [2024-11-19 15:24:22.397017] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397026] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397032] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.397047] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.397069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.397150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.397165] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.397171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.397197] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397207] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.397224] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.397247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.397356] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.397370] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.397377] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397383] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.397402] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397412] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.397428] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.397449] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.397537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.397551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.397558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397564] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.397583] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397593] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397599] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.397609] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.049 [2024-11-19 15:24:22.397630] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.049 [2024-11-19 15:24:22.397718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.049 [2024-11-19 15:24:22.397733] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.049 [2024-11-19 15:24:22.397739] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397749] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.049 [2024-11-19 15:24:22.397766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397774] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.049 [2024-11-19 15:24:22.397781] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.049 [2024-11-19 15:24:22.397791] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.397819] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.397901] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.397915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.397922] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.397928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.397945] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.397957] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.397963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.397974] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.397994] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.398080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.398094] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.398101] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398107] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.398126] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398136] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398142] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.398152] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.398173] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.398258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.398272] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.398279] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398285] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.398305] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.398331] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.398354] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.398461] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.398476] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.398483] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398489] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.398509] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398525] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.398535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.398561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.398639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.398654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.398660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398667] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.398686] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398702] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398709] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.398719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.398743] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.398847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.398862] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.398868] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398875] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.398895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398904] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.398910] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.398921] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.398944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.399070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399076] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.399096] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399105] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.399122] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.399145] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399253] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399268] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.399274] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399280] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.399300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399309] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399316] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.399326] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.399349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399431] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.399455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.399478] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399490] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399496] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.399507] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.399527] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399626] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.399633] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399639] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.399658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399668] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399674] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.399684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.399716] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399802] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.399823] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399829] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.399848] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399858] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.399864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.050 [2024-11-19 15:24:22.399874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.050 [2024-11-19 15:24:22.399895] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.050 [2024-11-19 15:24:22.399983] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.050 [2024-11-19 15:24:22.399997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.050 [2024-11-19 15:24:22.400004] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.400010] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.050 [2024-11-19 15:24:22.400029] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.050 [2024-11-19 15:24:22.400039] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.051 [2024-11-19 15:24:22.400056] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.051 [2024-11-19 15:24:22.400076] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.051 [2024-11-19 15:24:22.400157] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.051 [2024-11-19 15:24:22.400175] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.051 [2024-11-19 15:24:22.400183] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400189] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.051 [2024-11-19 15:24:22.400209] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400218] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.051 [2024-11-19 15:24:22.400235] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.051 [2024-11-19 15:24:22.400258] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.051 [2024-11-19 15:24:22.400366] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.051 [2024-11-19 15:24:22.400380] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.051 [2024-11-19 15:24:22.400386] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400393] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.051 [2024-11-19 15:24:22.400412] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400421] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.051 [2024-11-19 15:24:22.400438] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.051 [2024-11-19 15:24:22.400458] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.051 [2024-11-19 15:24:22.400543] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.051 [2024-11-19 15:24:22.400557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.051 [2024-11-19 15:24:22.400564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400570] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.051 [2024-11-19 15:24:22.400589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400599] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.400605] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.051 [2024-11-19 15:24:22.400615] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.051 [2024-11-19 15:24:22.400636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.051 [2024-11-19 15:24:22.404715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.051 [2024-11-19 15:24:22.404732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.051 [2024-11-19 15:24:22.404739] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.404745] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.051 [2024-11-19 15:24:22.404766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.404776] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.404782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d4e10) 00:23:24.051 [2024-11-19 15:24:22.404792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.051 [2024-11-19 15:24:22.404813] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2254f50, cid 3, qid 0 00:23:24.051 [2024-11-19 15:24:22.404936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.051 [2024-11-19 15:24:22.404953] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.051 [2024-11-19 15:24:22.404965] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.051 [2024-11-19 15:24:22.404972] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2254f50) on tqpair=0x21d4e10 00:23:24.051 [2024-11-19 15:24:22.404986] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:23:24.051 0 Kelvin (-273 Celsius) 00:23:24.051 Available Spare: 0% 00:23:24.051 Available Spare Threshold: 0% 00:23:24.051 Life Percentage Used: 0% 00:23:24.051 Data Units Read: 0 00:23:24.051 Data Units Written: 0 00:23:24.051 Host Read Commands: 0 00:23:24.051 Host Write Commands: 0 00:23:24.051 Controller Busy Time: 0 minutes 00:23:24.051 Power Cycles: 0 00:23:24.051 Power On Hours: 0 hours 00:23:24.051 Unsafe Shutdowns: 0 00:23:24.051 Unrecoverable Media Errors: 0 00:23:24.051 Lifetime Error Log Entries: 0 00:23:24.051 Warning Temperature Time: 0 minutes 00:23:24.051 Critical Temperature Time: 0 minutes 00:23:24.051 00:23:24.051 Number of Queues 00:23:24.051 ================ 00:23:24.051 Number of I/O Submission Queues: 127 00:23:24.051 Number of I/O Completion Queues: 127 00:23:24.051 00:23:24.051 Active Namespaces 00:23:24.051 ================= 00:23:24.051 Namespace ID:1 00:23:24.051 Error Recovery Timeout: Unlimited 00:23:24.051 Command Set Identifier: NVM (00h) 00:23:24.051 Deallocate: Supported 00:23:24.051 Deallocated/Unwritten Error: Not Supported 00:23:24.051 Deallocated Read Value: Unknown 00:23:24.051 Deallocate in Write Zeroes: Not Supported 00:23:24.051 Deallocated Guard Field: 0xFFFF 00:23:24.051 Flush: Supported 00:23:24.051 Reservation: Supported 00:23:24.051 Namespace Sharing Capabilities: Multiple Controllers 00:23:24.051 Size (in LBAs): 131072 (0GiB) 00:23:24.051 Capacity (in LBAs): 131072 (0GiB) 00:23:24.051 Utilization (in LBAs): 131072 (0GiB) 00:23:24.051 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:24.051 EUI64: ABCDEF0123456789 00:23:24.051 UUID: 5d0b0e69-3bdf-483b-8e29-c270eab7334f 00:23:24.051 Thin Provisioning: Not Supported 00:23:24.051 Per-NS Atomic Units: Yes 00:23:24.051 Atomic Boundary Size (Normal): 0 00:23:24.051 Atomic Boundary Size (PFail): 0 00:23:24.051 Atomic Boundary Offset: 0 00:23:24.051 Maximum Single Source Range Length: 65535 00:23:24.051 Maximum Copy Length: 65535 00:23:24.051 Maximum Source Range Count: 1 00:23:24.051 NGUID/EUI64 Never Reused: No 00:23:24.051 Namespace Write Protected: No 00:23:24.051 Number of LBA Formats: 1 00:23:24.051 Current LBA Format: LBA Format #00 00:23:24.051 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:24.051 00:23:24.051 15:24:22 -- host/identify.sh@51 -- # sync 00:23:24.051 15:24:22 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:24.051 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.051 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:24.051 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.051 15:24:22 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:24.051 15:24:22 -- host/identify.sh@56 -- # nvmftestfini 00:23:24.051 15:24:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:24.051 15:24:22 -- nvmf/common.sh@116 -- # sync 00:23:24.051 15:24:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:24.051 15:24:22 -- nvmf/common.sh@119 -- # set +e 00:23:24.051 15:24:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:24.051 15:24:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:24.051 rmmod nvme_tcp 00:23:24.051 rmmod nvme_fabrics 00:23:24.051 rmmod nvme_keyring 00:23:24.051 15:24:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:24.051 15:24:22 -- nvmf/common.sh@123 -- # set -e 00:23:24.051 15:24:22 -- nvmf/common.sh@124 -- # return 0 00:23:24.051 15:24:22 -- nvmf/common.sh@477 -- # '[' -n 2842648 ']' 00:23:24.051 15:24:22 -- nvmf/common.sh@478 -- # killprocess 2842648 00:23:24.051 15:24:22 -- common/autotest_common.sh@936 -- # '[' -z 2842648 ']' 00:23:24.051 15:24:22 -- common/autotest_common.sh@940 -- # kill -0 2842648 00:23:24.051 15:24:22 -- common/autotest_common.sh@941 -- # uname 00:23:24.051 15:24:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:24.051 15:24:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2842648 00:23:24.051 15:24:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:24.051 15:24:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:24.051 15:24:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2842648' 00:23:24.051 killing process with pid 2842648 00:23:24.051 15:24:22 -- common/autotest_common.sh@955 -- # kill 2842648 00:23:24.051 [2024-11-19 15:24:22.526286] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:24.051 15:24:22 -- common/autotest_common.sh@960 -- # wait 2842648 00:23:24.311 15:24:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:24.311 15:24:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:24.311 15:24:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:24.311 15:24:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:24.311 15:24:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:24.311 15:24:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:24.311 15:24:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:24.311 15:24:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:26.843 15:24:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:26.843 00:23:26.843 real 0m6.196s 00:23:26.843 user 0m7.663s 00:23:26.843 sys 0m1.895s 00:23:26.843 15:24:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:26.843 15:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:26.843 ************************************ 00:23:26.843 END TEST nvmf_identify 00:23:26.843 ************************************ 00:23:26.843 15:24:24 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:26.843 15:24:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:26.843 15:24:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:26.843 15:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:26.843 ************************************ 00:23:26.843 START TEST nvmf_perf 00:23:26.843 ************************************ 00:23:26.843 15:24:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:26.843 * Looking for test storage... 00:23:26.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:26.843 15:24:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:26.843 15:24:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:26.843 15:24:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:26.843 15:24:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:26.843 15:24:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:26.843 15:24:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:26.843 15:24:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:26.843 15:24:25 -- scripts/common.sh@335 -- # IFS=.-: 00:23:26.843 15:24:25 -- scripts/common.sh@335 -- # read -ra ver1 00:23:26.843 15:24:25 -- scripts/common.sh@336 -- # IFS=.-: 00:23:26.843 15:24:25 -- scripts/common.sh@336 -- # read -ra ver2 00:23:26.843 15:24:25 -- scripts/common.sh@337 -- # local 'op=<' 00:23:26.843 15:24:25 -- scripts/common.sh@339 -- # ver1_l=2 00:23:26.843 15:24:25 -- scripts/common.sh@340 -- # ver2_l=1 00:23:26.843 15:24:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:26.843 15:24:25 -- scripts/common.sh@343 -- # case "$op" in 00:23:26.843 15:24:25 -- scripts/common.sh@344 -- # : 1 00:23:26.843 15:24:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:26.843 15:24:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:26.843 15:24:25 -- scripts/common.sh@364 -- # decimal 1 00:23:26.843 15:24:25 -- scripts/common.sh@352 -- # local d=1 00:23:26.843 15:24:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:26.843 15:24:25 -- scripts/common.sh@354 -- # echo 1 00:23:26.843 15:24:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:26.843 15:24:25 -- scripts/common.sh@365 -- # decimal 2 00:23:26.843 15:24:25 -- scripts/common.sh@352 -- # local d=2 00:23:26.843 15:24:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:26.843 15:24:25 -- scripts/common.sh@354 -- # echo 2 00:23:26.843 15:24:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:26.843 15:24:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:26.843 15:24:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:26.843 15:24:25 -- scripts/common.sh@367 -- # return 0 00:23:26.843 15:24:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:26.843 15:24:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:26.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:26.843 --rc genhtml_branch_coverage=1 00:23:26.843 --rc genhtml_function_coverage=1 00:23:26.843 --rc genhtml_legend=1 00:23:26.843 --rc geninfo_all_blocks=1 00:23:26.843 --rc geninfo_unexecuted_blocks=1 00:23:26.843 00:23:26.843 ' 00:23:26.843 15:24:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:26.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:26.843 --rc genhtml_branch_coverage=1 00:23:26.843 --rc genhtml_function_coverage=1 00:23:26.843 --rc genhtml_legend=1 00:23:26.843 --rc geninfo_all_blocks=1 00:23:26.843 --rc geninfo_unexecuted_blocks=1 00:23:26.843 00:23:26.843 ' 00:23:26.843 15:24:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:26.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:26.843 --rc genhtml_branch_coverage=1 00:23:26.843 --rc genhtml_function_coverage=1 00:23:26.843 --rc genhtml_legend=1 00:23:26.843 --rc geninfo_all_blocks=1 00:23:26.843 --rc geninfo_unexecuted_blocks=1 00:23:26.843 00:23:26.843 ' 00:23:26.843 15:24:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:26.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:26.843 --rc genhtml_branch_coverage=1 00:23:26.843 --rc genhtml_function_coverage=1 00:23:26.843 --rc genhtml_legend=1 00:23:26.843 --rc geninfo_all_blocks=1 00:23:26.843 --rc geninfo_unexecuted_blocks=1 00:23:26.843 00:23:26.843 ' 00:23:26.843 15:24:25 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:26.843 15:24:25 -- nvmf/common.sh@7 -- # uname -s 00:23:26.843 15:24:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:26.843 15:24:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:26.843 15:24:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:26.843 15:24:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:26.843 15:24:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:26.843 15:24:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:26.843 15:24:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:26.843 15:24:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:26.843 15:24:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:26.843 15:24:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:26.843 15:24:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:26.843 15:24:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:26.843 15:24:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:26.843 15:24:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:26.843 15:24:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:26.843 15:24:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:26.843 15:24:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:26.843 15:24:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:26.843 15:24:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:26.844 15:24:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.844 15:24:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.844 15:24:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.844 15:24:25 -- paths/export.sh@5 -- # export PATH 00:23:26.844 15:24:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.844 15:24:25 -- nvmf/common.sh@46 -- # : 0 00:23:26.844 15:24:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:26.844 15:24:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:26.844 15:24:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:26.844 15:24:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:26.844 15:24:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:26.844 15:24:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:26.844 15:24:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:26.844 15:24:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:26.844 15:24:25 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:26.844 15:24:25 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:26.844 15:24:25 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:26.844 15:24:25 -- host/perf.sh@17 -- # nvmftestinit 00:23:26.844 15:24:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:26.844 15:24:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:26.844 15:24:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:26.844 15:24:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:26.844 15:24:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:26.844 15:24:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:26.844 15:24:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:26.844 15:24:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:26.844 15:24:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:26.844 15:24:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:26.844 15:24:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:26.844 15:24:25 -- common/autotest_common.sh@10 -- # set +x 00:23:28.744 15:24:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:28.744 15:24:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:28.744 15:24:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:28.744 15:24:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:28.744 15:24:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:28.744 15:24:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:28.744 15:24:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:28.744 15:24:27 -- nvmf/common.sh@294 -- # net_devs=() 00:23:28.744 15:24:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:28.744 15:24:27 -- nvmf/common.sh@295 -- # e810=() 00:23:28.744 15:24:27 -- nvmf/common.sh@295 -- # local -ga e810 00:23:28.744 15:24:27 -- nvmf/common.sh@296 -- # x722=() 00:23:28.744 15:24:27 -- nvmf/common.sh@296 -- # local -ga x722 00:23:28.744 15:24:27 -- nvmf/common.sh@297 -- # mlx=() 00:23:28.744 15:24:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:28.744 15:24:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:28.744 15:24:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:28.744 15:24:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:28.744 15:24:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:28.744 15:24:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:28.744 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:28.744 15:24:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:28.744 15:24:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:28.744 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:28.744 15:24:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:28.744 15:24:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:28.744 15:24:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:28.744 15:24:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:28.744 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:28.744 15:24:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:28.744 15:24:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:28.744 15:24:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:28.744 15:24:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:28.744 15:24:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:28.744 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:28.744 15:24:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:28.744 15:24:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:28.744 15:24:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:28.744 15:24:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:28.744 15:24:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:28.744 15:24:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:28.744 15:24:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:28.744 15:24:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:28.744 15:24:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:28.744 15:24:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:28.744 15:24:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:28.744 15:24:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:28.744 15:24:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:28.744 15:24:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:28.744 15:24:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:28.744 15:24:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:28.744 15:24:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:28.744 15:24:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:28.744 15:24:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:28.744 15:24:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:28.744 15:24:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:28.745 15:24:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:28.745 15:24:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:28.745 15:24:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:28.745 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:28.745 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:23:28.745 00:23:28.745 --- 10.0.0.2 ping statistics --- 00:23:28.745 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:28.745 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:23:28.745 15:24:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:28.745 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:28.745 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:23:28.745 00:23:28.745 --- 10.0.0.1 ping statistics --- 00:23:28.745 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:28.745 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:23:28.745 15:24:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:28.745 15:24:27 -- nvmf/common.sh@410 -- # return 0 00:23:28.745 15:24:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:28.745 15:24:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:28.745 15:24:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:28.745 15:24:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:28.745 15:24:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:28.745 15:24:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:28.745 15:24:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:28.745 15:24:27 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:28.745 15:24:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:28.745 15:24:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:28.745 15:24:27 -- common/autotest_common.sh@10 -- # set +x 00:23:28.745 15:24:27 -- nvmf/common.sh@469 -- # nvmfpid=2844755 00:23:28.745 15:24:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:28.745 15:24:27 -- nvmf/common.sh@470 -- # waitforlisten 2844755 00:23:28.745 15:24:27 -- common/autotest_common.sh@829 -- # '[' -z 2844755 ']' 00:23:28.745 15:24:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:28.745 15:24:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:28.745 15:24:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:28.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:28.745 15:24:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:28.745 15:24:27 -- common/autotest_common.sh@10 -- # set +x 00:23:28.745 [2024-11-19 15:24:27.260212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:28.745 [2024-11-19 15:24:27.260285] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:28.745 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.003 [2024-11-19 15:24:27.325629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:29.003 [2024-11-19 15:24:27.430565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:29.003 [2024-11-19 15:24:27.430730] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:29.003 [2024-11-19 15:24:27.430748] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:29.003 [2024-11-19 15:24:27.430760] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:29.003 [2024-11-19 15:24:27.430813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:29.003 [2024-11-19 15:24:27.430870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:29.003 [2024-11-19 15:24:27.430935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:29.003 [2024-11-19 15:24:27.430938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:29.936 15:24:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:29.936 15:24:28 -- common/autotest_common.sh@862 -- # return 0 00:23:29.936 15:24:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:29.936 15:24:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:29.936 15:24:28 -- common/autotest_common.sh@10 -- # set +x 00:23:29.936 15:24:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:29.936 15:24:28 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:29.936 15:24:28 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:33.216 15:24:31 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:33.216 15:24:31 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:33.216 15:24:31 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:33.216 15:24:31 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:33.474 15:24:31 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:33.475 15:24:31 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:33.475 15:24:31 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:33.475 15:24:31 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:33.475 15:24:31 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:33.732 [2024-11-19 15:24:32.104796] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:33.732 15:24:32 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:33.990 15:24:32 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:33.990 15:24:32 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:34.248 15:24:32 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:34.248 15:24:32 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:34.506 15:24:32 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:34.763 [2024-11-19 15:24:33.128760] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:34.763 15:24:33 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:35.021 15:24:33 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:35.021 15:24:33 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:35.021 15:24:33 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:35.021 15:24:33 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:36.396 Initializing NVMe Controllers 00:23:36.396 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:36.396 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:36.396 Initialization complete. Launching workers. 00:23:36.396 ======================================================== 00:23:36.396 Latency(us) 00:23:36.396 Device Information : IOPS MiB/s Average min max 00:23:36.396 PCIE (0000:88:00.0) NSID 1 from core 0: 86230.53 336.84 370.72 15.98 7270.94 00:23:36.396 ======================================================== 00:23:36.396 Total : 86230.53 336.84 370.72 15.98 7270.94 00:23:36.396 00:23:36.396 15:24:34 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:36.396 EAL: No free 2048 kB hugepages reported on node 1 00:23:37.769 Initializing NVMe Controllers 00:23:37.769 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:37.769 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:37.769 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:37.769 Initialization complete. Launching workers. 00:23:37.769 ======================================================== 00:23:37.769 Latency(us) 00:23:37.769 Device Information : IOPS MiB/s Average min max 00:23:37.769 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 96.00 0.38 10495.81 168.26 46064.52 00:23:37.769 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 46.00 0.18 22704.61 7956.00 47919.93 00:23:37.769 ======================================================== 00:23:37.769 Total : 142.00 0.55 14450.77 168.26 47919.93 00:23:37.769 00:23:37.769 15:24:36 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:37.769 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.146 Initializing NVMe Controllers 00:23:39.146 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.146 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:39.146 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:39.146 Initialization complete. Launching workers. 00:23:39.146 ======================================================== 00:23:39.146 Latency(us) 00:23:39.146 Device Information : IOPS MiB/s Average min max 00:23:39.146 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8460.69 33.05 3781.95 506.55 10727.15 00:23:39.146 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3970.00 15.51 8060.48 5372.50 15306.74 00:23:39.146 ======================================================== 00:23:39.146 Total : 12430.69 48.56 5148.38 506.55 15306.74 00:23:39.146 00:23:39.146 15:24:37 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:39.146 15:24:37 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:39.146 15:24:37 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.146 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.679 Initializing NVMe Controllers 00:23:41.679 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.679 Controller IO queue size 128, less than required. 00:23:41.679 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.679 Controller IO queue size 128, less than required. 00:23:41.679 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.679 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.679 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.679 Initialization complete. Launching workers. 00:23:41.679 ======================================================== 00:23:41.679 Latency(us) 00:23:41.679 Device Information : IOPS MiB/s Average min max 00:23:41.679 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1609.65 402.41 80820.44 41929.85 112168.90 00:23:41.679 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 602.56 150.64 219924.59 73385.80 334293.83 00:23:41.679 ======================================================== 00:23:41.679 Total : 2212.21 553.05 118709.46 41929.85 334293.83 00:23:41.679 00:23:41.679 15:24:39 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:41.679 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.679 No valid NVMe controllers or AIO or URING devices found 00:23:41.679 Initializing NVMe Controllers 00:23:41.679 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.679 Controller IO queue size 128, less than required. 00:23:41.679 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.679 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:41.679 Controller IO queue size 128, less than required. 00:23:41.679 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.679 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:41.679 WARNING: Some requested NVMe devices were skipped 00:23:41.679 15:24:40 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:41.679 EAL: No free 2048 kB hugepages reported on node 1 00:23:44.208 Initializing NVMe Controllers 00:23:44.208 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:44.208 Controller IO queue size 128, less than required. 00:23:44.208 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.208 Controller IO queue size 128, less than required. 00:23:44.208 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.208 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:44.208 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:44.208 Initialization complete. Launching workers. 00:23:44.208 00:23:44.208 ==================== 00:23:44.208 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:44.208 TCP transport: 00:23:44.208 polls: 9565 00:23:44.208 idle_polls: 6672 00:23:44.208 sock_completions: 2893 00:23:44.208 nvme_completions: 4941 00:23:44.208 submitted_requests: 7600 00:23:44.208 queued_requests: 1 00:23:44.208 00:23:44.208 ==================== 00:23:44.208 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:44.208 TCP transport: 00:23:44.208 polls: 10028 00:23:44.208 idle_polls: 6477 00:23:44.208 sock_completions: 3551 00:23:44.208 nvme_completions: 6109 00:23:44.208 submitted_requests: 9369 00:23:44.208 queued_requests: 1 00:23:44.208 ======================================================== 00:23:44.208 Latency(us) 00:23:44.208 Device Information : IOPS MiB/s Average min max 00:23:44.208 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1296.22 324.06 101640.86 66675.16 172294.13 00:23:44.208 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1587.10 396.77 81251.91 43508.68 114019.03 00:23:44.208 ======================================================== 00:23:44.208 Total : 2883.32 720.83 90417.94 43508.68 172294.13 00:23:44.208 00:23:44.208 15:24:42 -- host/perf.sh@66 -- # sync 00:23:44.208 15:24:42 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:44.467 15:24:42 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:44.467 15:24:42 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:44.467 15:24:42 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:47.746 15:24:46 -- host/perf.sh@72 -- # ls_guid=defc6bdd-a7f1-4238-a273-730a2b9c8a7b 00:23:47.746 15:24:46 -- host/perf.sh@73 -- # get_lvs_free_mb defc6bdd-a7f1-4238-a273-730a2b9c8a7b 00:23:47.746 15:24:46 -- common/autotest_common.sh@1353 -- # local lvs_uuid=defc6bdd-a7f1-4238-a273-730a2b9c8a7b 00:23:47.746 15:24:46 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:47.746 15:24:46 -- common/autotest_common.sh@1355 -- # local fc 00:23:47.746 15:24:46 -- common/autotest_common.sh@1356 -- # local cs 00:23:47.746 15:24:46 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:48.004 15:24:46 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:48.004 { 00:23:48.004 "uuid": "defc6bdd-a7f1-4238-a273-730a2b9c8a7b", 00:23:48.004 "name": "lvs_0", 00:23:48.004 "base_bdev": "Nvme0n1", 00:23:48.004 "total_data_clusters": 238234, 00:23:48.004 "free_clusters": 238234, 00:23:48.004 "block_size": 512, 00:23:48.004 "cluster_size": 4194304 00:23:48.004 } 00:23:48.004 ]' 00:23:48.004 15:24:46 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="defc6bdd-a7f1-4238-a273-730a2b9c8a7b") .free_clusters' 00:23:48.004 15:24:46 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:48.004 15:24:46 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="defc6bdd-a7f1-4238-a273-730a2b9c8a7b") .cluster_size' 00:23:48.004 15:24:46 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:48.004 15:24:46 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:48.004 15:24:46 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:48.004 952936 00:23:48.004 15:24:46 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:48.004 15:24:46 -- host/perf.sh@78 -- # free_mb=20480 00:23:48.004 15:24:46 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u defc6bdd-a7f1-4238-a273-730a2b9c8a7b lbd_0 20480 00:23:48.568 15:24:46 -- host/perf.sh@80 -- # lb_guid=dfb4b6b7-9a3f-4dba-ac89-a56fc8910be3 00:23:48.568 15:24:46 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore dfb4b6b7-9a3f-4dba-ac89-a56fc8910be3 lvs_n_0 00:23:49.500 15:24:47 -- host/perf.sh@83 -- # ls_nested_guid=0d3841b1-2bad-49e7-9fe4-668eea1bac93 00:23:49.500 15:24:47 -- host/perf.sh@84 -- # get_lvs_free_mb 0d3841b1-2bad-49e7-9fe4-668eea1bac93 00:23:49.500 15:24:47 -- common/autotest_common.sh@1353 -- # local lvs_uuid=0d3841b1-2bad-49e7-9fe4-668eea1bac93 00:23:49.500 15:24:47 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:49.500 15:24:47 -- common/autotest_common.sh@1355 -- # local fc 00:23:49.500 15:24:47 -- common/autotest_common.sh@1356 -- # local cs 00:23:49.500 15:24:47 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:49.500 15:24:48 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:49.500 { 00:23:49.500 "uuid": "defc6bdd-a7f1-4238-a273-730a2b9c8a7b", 00:23:49.500 "name": "lvs_0", 00:23:49.500 "base_bdev": "Nvme0n1", 00:23:49.500 "total_data_clusters": 238234, 00:23:49.500 "free_clusters": 233114, 00:23:49.500 "block_size": 512, 00:23:49.500 "cluster_size": 4194304 00:23:49.500 }, 00:23:49.500 { 00:23:49.500 "uuid": "0d3841b1-2bad-49e7-9fe4-668eea1bac93", 00:23:49.500 "name": "lvs_n_0", 00:23:49.500 "base_bdev": "dfb4b6b7-9a3f-4dba-ac89-a56fc8910be3", 00:23:49.500 "total_data_clusters": 5114, 00:23:49.500 "free_clusters": 5114, 00:23:49.500 "block_size": 512, 00:23:49.500 "cluster_size": 4194304 00:23:49.500 } 00:23:49.500 ]' 00:23:49.501 15:24:48 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="0d3841b1-2bad-49e7-9fe4-668eea1bac93") .free_clusters' 00:23:49.758 15:24:48 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:49.758 15:24:48 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="0d3841b1-2bad-49e7-9fe4-668eea1bac93") .cluster_size' 00:23:49.758 15:24:48 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:49.758 15:24:48 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:49.758 15:24:48 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:49.758 20456 00:23:49.758 15:24:48 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:49.758 15:24:48 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0d3841b1-2bad-49e7-9fe4-668eea1bac93 lbd_nest_0 20456 00:23:50.016 15:24:48 -- host/perf.sh@88 -- # lb_nested_guid=4b137585-796c-455e-af25-2328124775be 00:23:50.016 15:24:48 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:50.273 15:24:48 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:50.273 15:24:48 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 4b137585-796c-455e-af25-2328124775be 00:23:50.531 15:24:48 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:50.799 15:24:49 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:50.799 15:24:49 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:50.799 15:24:49 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:50.799 15:24:49 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:50.799 15:24:49 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:50.799 EAL: No free 2048 kB hugepages reported on node 1 00:24:03.003 Initializing NVMe Controllers 00:24:03.003 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:03.003 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:03.003 Initialization complete. Launching workers. 00:24:03.003 ======================================================== 00:24:03.003 Latency(us) 00:24:03.003 Device Information : IOPS MiB/s Average min max 00:24:03.003 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 49.10 0.02 20452.62 180.76 47869.20 00:24:03.003 ======================================================== 00:24:03.003 Total : 49.10 0.02 20452.62 180.76 47869.20 00:24:03.003 00:24:03.003 15:24:59 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:03.003 15:24:59 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:03.003 EAL: No free 2048 kB hugepages reported on node 1 00:24:13.056 Initializing NVMe Controllers 00:24:13.056 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:13.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:13.056 Initialization complete. Launching workers. 00:24:13.056 ======================================================== 00:24:13.056 Latency(us) 00:24:13.056 Device Information : IOPS MiB/s Average min max 00:24:13.057 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 70.99 8.87 14108.54 5041.96 48828.27 00:24:13.057 ======================================================== 00:24:13.057 Total : 70.99 8.87 14108.54 5041.96 48828.27 00:24:13.057 00:24:13.057 15:25:09 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:13.057 15:25:09 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:13.057 15:25:09 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:13.057 EAL: No free 2048 kB hugepages reported on node 1 00:24:23.099 Initializing NVMe Controllers 00:24:23.099 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:23.099 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:23.099 Initialization complete. Launching workers. 00:24:23.099 ======================================================== 00:24:23.099 Latency(us) 00:24:23.099 Device Information : IOPS MiB/s Average min max 00:24:23.099 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7904.65 3.86 4047.87 286.72 11457.89 00:24:23.099 ======================================================== 00:24:23.099 Total : 7904.65 3.86 4047.87 286.72 11457.89 00:24:23.099 00:24:23.099 15:25:20 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:23.099 15:25:20 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:23.099 EAL: No free 2048 kB hugepages reported on node 1 00:24:33.064 Initializing NVMe Controllers 00:24:33.064 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:33.064 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:33.064 Initialization complete. Launching workers. 00:24:33.064 ======================================================== 00:24:33.064 Latency(us) 00:24:33.064 Device Information : IOPS MiB/s Average min max 00:24:33.064 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4028.01 503.50 7944.86 709.59 19121.87 00:24:33.064 ======================================================== 00:24:33.064 Total : 4028.01 503.50 7944.86 709.59 19121.87 00:24:33.064 00:24:33.064 15:25:30 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:33.064 15:25:30 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:33.064 15:25:30 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:33.064 EAL: No free 2048 kB hugepages reported on node 1 00:24:43.030 Initializing NVMe Controllers 00:24:43.030 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:43.030 Controller IO queue size 128, less than required. 00:24:43.030 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:43.030 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:43.030 Initialization complete. Launching workers. 00:24:43.030 ======================================================== 00:24:43.030 Latency(us) 00:24:43.030 Device Information : IOPS MiB/s Average min max 00:24:43.030 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12000.30 5.86 10670.72 1832.24 30490.09 00:24:43.030 ======================================================== 00:24:43.030 Total : 12000.30 5.86 10670.72 1832.24 30490.09 00:24:43.030 00:24:43.030 15:25:40 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:43.031 15:25:40 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:43.031 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.002 Initializing NVMe Controllers 00:24:53.002 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:53.002 Controller IO queue size 128, less than required. 00:24:53.002 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:53.002 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:53.002 Initialization complete. Launching workers. 00:24:53.002 ======================================================== 00:24:53.002 Latency(us) 00:24:53.002 Device Information : IOPS MiB/s Average min max 00:24:53.002 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1166.90 145.86 109904.72 16411.86 239491.62 00:24:53.002 ======================================================== 00:24:53.002 Total : 1166.90 145.86 109904.72 16411.86 239491.62 00:24:53.002 00:24:53.002 15:25:50 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:53.002 15:25:51 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4b137585-796c-455e-af25-2328124775be 00:24:53.567 15:25:52 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:53.825 15:25:52 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete dfb4b6b7-9a3f-4dba-ac89-a56fc8910be3 00:24:54.083 15:25:52 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:54.342 15:25:52 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:54.342 15:25:52 -- host/perf.sh@114 -- # nvmftestfini 00:24:54.342 15:25:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:54.342 15:25:52 -- nvmf/common.sh@116 -- # sync 00:24:54.342 15:25:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:54.342 15:25:52 -- nvmf/common.sh@119 -- # set +e 00:24:54.342 15:25:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:54.342 15:25:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:54.342 rmmod nvme_tcp 00:24:54.342 rmmod nvme_fabrics 00:24:54.342 rmmod nvme_keyring 00:24:54.342 15:25:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:54.342 15:25:52 -- nvmf/common.sh@123 -- # set -e 00:24:54.342 15:25:52 -- nvmf/common.sh@124 -- # return 0 00:24:54.342 15:25:52 -- nvmf/common.sh@477 -- # '[' -n 2844755 ']' 00:24:54.342 15:25:52 -- nvmf/common.sh@478 -- # killprocess 2844755 00:24:54.342 15:25:52 -- common/autotest_common.sh@936 -- # '[' -z 2844755 ']' 00:24:54.342 15:25:52 -- common/autotest_common.sh@940 -- # kill -0 2844755 00:24:54.342 15:25:52 -- common/autotest_common.sh@941 -- # uname 00:24:54.342 15:25:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:54.342 15:25:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2844755 00:24:54.600 15:25:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:54.600 15:25:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:54.600 15:25:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2844755' 00:24:54.600 killing process with pid 2844755 00:24:54.600 15:25:52 -- common/autotest_common.sh@955 -- # kill 2844755 00:24:54.600 15:25:52 -- common/autotest_common.sh@960 -- # wait 2844755 00:24:56.501 15:25:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:56.501 15:25:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:56.501 15:25:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:56.501 15:25:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:56.501 15:25:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:56.501 15:25:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.501 15:25:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.501 15:25:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:58.410 15:25:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:58.410 00:24:58.410 real 1m31.694s 00:24:58.410 user 5m37.402s 00:24:58.410 sys 0m15.999s 00:24:58.410 15:25:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:58.410 15:25:56 -- common/autotest_common.sh@10 -- # set +x 00:24:58.410 ************************************ 00:24:58.410 END TEST nvmf_perf 00:24:58.410 ************************************ 00:24:58.410 15:25:56 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:58.410 15:25:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:58.410 15:25:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:58.411 15:25:56 -- common/autotest_common.sh@10 -- # set +x 00:24:58.411 ************************************ 00:24:58.411 START TEST nvmf_fio_host 00:24:58.411 ************************************ 00:24:58.411 15:25:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:58.411 * Looking for test storage... 00:24:58.411 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:58.411 15:25:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:58.411 15:25:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:58.411 15:25:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:58.411 15:25:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:58.411 15:25:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:58.411 15:25:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:58.411 15:25:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:58.411 15:25:56 -- scripts/common.sh@335 -- # IFS=.-: 00:24:58.411 15:25:56 -- scripts/common.sh@335 -- # read -ra ver1 00:24:58.411 15:25:56 -- scripts/common.sh@336 -- # IFS=.-: 00:24:58.411 15:25:56 -- scripts/common.sh@336 -- # read -ra ver2 00:24:58.411 15:25:56 -- scripts/common.sh@337 -- # local 'op=<' 00:24:58.411 15:25:56 -- scripts/common.sh@339 -- # ver1_l=2 00:24:58.411 15:25:56 -- scripts/common.sh@340 -- # ver2_l=1 00:24:58.411 15:25:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:58.411 15:25:56 -- scripts/common.sh@343 -- # case "$op" in 00:24:58.411 15:25:56 -- scripts/common.sh@344 -- # : 1 00:24:58.411 15:25:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:58.411 15:25:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:58.411 15:25:56 -- scripts/common.sh@364 -- # decimal 1 00:24:58.411 15:25:56 -- scripts/common.sh@352 -- # local d=1 00:24:58.411 15:25:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:58.411 15:25:56 -- scripts/common.sh@354 -- # echo 1 00:24:58.411 15:25:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:58.411 15:25:56 -- scripts/common.sh@365 -- # decimal 2 00:24:58.411 15:25:56 -- scripts/common.sh@352 -- # local d=2 00:24:58.411 15:25:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:58.411 15:25:56 -- scripts/common.sh@354 -- # echo 2 00:24:58.411 15:25:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:58.411 15:25:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:58.411 15:25:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:58.411 15:25:56 -- scripts/common.sh@367 -- # return 0 00:24:58.411 15:25:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:58.411 15:25:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:58.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:58.411 --rc genhtml_branch_coverage=1 00:24:58.411 --rc genhtml_function_coverage=1 00:24:58.411 --rc genhtml_legend=1 00:24:58.411 --rc geninfo_all_blocks=1 00:24:58.411 --rc geninfo_unexecuted_blocks=1 00:24:58.411 00:24:58.411 ' 00:24:58.411 15:25:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:58.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:58.411 --rc genhtml_branch_coverage=1 00:24:58.411 --rc genhtml_function_coverage=1 00:24:58.411 --rc genhtml_legend=1 00:24:58.411 --rc geninfo_all_blocks=1 00:24:58.411 --rc geninfo_unexecuted_blocks=1 00:24:58.411 00:24:58.411 ' 00:24:58.411 15:25:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:58.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:58.411 --rc genhtml_branch_coverage=1 00:24:58.411 --rc genhtml_function_coverage=1 00:24:58.411 --rc genhtml_legend=1 00:24:58.411 --rc geninfo_all_blocks=1 00:24:58.411 --rc geninfo_unexecuted_blocks=1 00:24:58.411 00:24:58.411 ' 00:24:58.411 15:25:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:58.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:58.411 --rc genhtml_branch_coverage=1 00:24:58.411 --rc genhtml_function_coverage=1 00:24:58.411 --rc genhtml_legend=1 00:24:58.411 --rc geninfo_all_blocks=1 00:24:58.411 --rc geninfo_unexecuted_blocks=1 00:24:58.411 00:24:58.411 ' 00:24:58.411 15:25:56 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:58.411 15:25:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:58.411 15:25:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:58.411 15:25:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:58.411 15:25:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.411 15:25:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.411 15:25:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.411 15:25:56 -- paths/export.sh@5 -- # export PATH 00:24:58.411 15:25:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.411 15:25:56 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:58.411 15:25:56 -- nvmf/common.sh@7 -- # uname -s 00:24:58.411 15:25:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:58.411 15:25:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:58.411 15:25:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:58.411 15:25:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:58.411 15:25:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:58.411 15:25:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:58.411 15:25:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:58.411 15:25:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:58.411 15:25:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:58.411 15:25:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:58.411 15:25:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:58.411 15:25:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:58.411 15:25:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:58.411 15:25:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:58.411 15:25:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:58.411 15:25:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:58.411 15:25:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:58.411 15:25:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:58.411 15:25:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:58.412 15:25:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.412 15:25:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.412 15:25:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.412 15:25:56 -- paths/export.sh@5 -- # export PATH 00:24:58.412 15:25:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:58.412 15:25:56 -- nvmf/common.sh@46 -- # : 0 00:24:58.412 15:25:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:58.412 15:25:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:58.412 15:25:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:58.412 15:25:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:58.412 15:25:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:58.412 15:25:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:58.412 15:25:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:58.412 15:25:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:58.412 15:25:56 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:58.412 15:25:56 -- host/fio.sh@14 -- # nvmftestinit 00:24:58.412 15:25:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:58.412 15:25:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:58.412 15:25:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:58.412 15:25:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:58.412 15:25:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:58.412 15:25:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:58.412 15:25:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:58.412 15:25:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:58.412 15:25:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:58.412 15:25:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:58.412 15:25:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:58.412 15:25:56 -- common/autotest_common.sh@10 -- # set +x 00:25:00.318 15:25:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:00.318 15:25:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:00.318 15:25:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:00.318 15:25:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:00.318 15:25:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:00.318 15:25:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:00.318 15:25:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:00.318 15:25:58 -- nvmf/common.sh@294 -- # net_devs=() 00:25:00.318 15:25:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:00.318 15:25:58 -- nvmf/common.sh@295 -- # e810=() 00:25:00.318 15:25:58 -- nvmf/common.sh@295 -- # local -ga e810 00:25:00.318 15:25:58 -- nvmf/common.sh@296 -- # x722=() 00:25:00.318 15:25:58 -- nvmf/common.sh@296 -- # local -ga x722 00:25:00.318 15:25:58 -- nvmf/common.sh@297 -- # mlx=() 00:25:00.318 15:25:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:00.318 15:25:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:00.318 15:25:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:00.318 15:25:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:00.318 15:25:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.318 15:25:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:00.318 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:00.318 15:25:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.318 15:25:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:00.318 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:00.318 15:25:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.318 15:25:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.318 15:25:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.318 15:25:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:00.318 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:00.318 15:25:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.318 15:25:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.318 15:25:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.318 15:25:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.318 15:25:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:00.318 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:00.318 15:25:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.318 15:25:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:00.318 15:25:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:00.318 15:25:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:00.318 15:25:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:00.318 15:25:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:00.318 15:25:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:00.318 15:25:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:00.318 15:25:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:00.318 15:25:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:00.318 15:25:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:00.318 15:25:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:00.318 15:25:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:00.318 15:25:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:00.318 15:25:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:00.318 15:25:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:00.318 15:25:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:00.576 15:25:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:00.576 15:25:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:00.576 15:25:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:00.576 15:25:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:00.576 15:25:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:00.576 15:25:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:00.576 15:25:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:00.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:00.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:25:00.576 00:25:00.576 --- 10.0.0.2 ping statistics --- 00:25:00.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.576 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:25:00.576 15:25:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:00.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:00.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:25:00.576 00:25:00.576 --- 10.0.0.1 ping statistics --- 00:25:00.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.576 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:25:00.576 15:25:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:00.576 15:25:58 -- nvmf/common.sh@410 -- # return 0 00:25:00.576 15:25:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:00.576 15:25:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:00.576 15:25:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:00.576 15:25:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:00.576 15:25:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:00.576 15:25:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:00.576 15:25:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:00.576 15:25:59 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:00.576 15:25:59 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:00.576 15:25:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:00.576 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:25:00.576 15:25:59 -- host/fio.sh@24 -- # nvmfpid=2857201 00:25:00.576 15:25:59 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:00.576 15:25:59 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:00.576 15:25:59 -- host/fio.sh@28 -- # waitforlisten 2857201 00:25:00.576 15:25:59 -- common/autotest_common.sh@829 -- # '[' -z 2857201 ']' 00:25:00.576 15:25:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:00.577 15:25:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:00.577 15:25:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:00.577 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:00.577 15:25:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:00.577 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:25:00.577 [2024-11-19 15:25:59.064540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:00.577 [2024-11-19 15:25:59.064623] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:00.577 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.577 [2024-11-19 15:25:59.135635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:00.839 [2024-11-19 15:25:59.251258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:00.839 [2024-11-19 15:25:59.251428] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:00.839 [2024-11-19 15:25:59.251449] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:00.839 [2024-11-19 15:25:59.251464] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:00.839 [2024-11-19 15:25:59.251552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:00.839 [2024-11-19 15:25:59.251621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:00.839 [2024-11-19 15:25:59.251721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:00.839 [2024-11-19 15:25:59.251725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:01.770 15:26:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:01.770 15:26:00 -- common/autotest_common.sh@862 -- # return 0 00:25:01.770 15:26:00 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:01.770 [2024-11-19 15:26:00.261015] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:01.770 15:26:00 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:01.770 15:26:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:01.770 15:26:00 -- common/autotest_common.sh@10 -- # set +x 00:25:01.770 15:26:00 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:02.028 Malloc1 00:25:02.028 15:26:00 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:02.286 15:26:00 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:02.543 15:26:01 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:02.801 [2024-11-19 15:26:01.300286] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:02.801 15:26:01 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:03.059 15:26:01 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:03.059 15:26:01 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.059 15:26:01 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.059 15:26:01 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:03.059 15:26:01 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:03.059 15:26:01 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:03.059 15:26:01 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.059 15:26:01 -- common/autotest_common.sh@1330 -- # shift 00:25:03.059 15:26:01 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:03.059 15:26:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.059 15:26:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.059 15:26:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.059 15:26:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.059 15:26:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.059 15:26:01 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:03.059 15:26:01 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.317 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:03.317 fio-3.35 00:25:03.317 Starting 1 thread 00:25:03.317 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.848 00:25:05.848 test: (groupid=0, jobs=1): err= 0: pid=2857699: Tue Nov 19 15:26:04 2024 00:25:05.848 read: IOPS=9505, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2006msec) 00:25:05.848 slat (nsec): min=1933, max=121594, avg=2460.15, stdev=1541.86 00:25:05.848 clat (usec): min=2230, max=12947, avg=7427.00, stdev=571.16 00:25:05.848 lat (usec): min=2249, max=12949, avg=7429.46, stdev=571.07 00:25:05.848 clat percentiles (usec): 00:25:05.848 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:25:05.848 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:25:05.848 | 70.00th=[ 7701], 80.00th=[ 7832], 90.00th=[ 8094], 95.00th=[ 8291], 00:25:05.848 | 99.00th=[ 8717], 99.50th=[ 8848], 99.90th=[10421], 99.95th=[11338], 00:25:05.848 | 99.99th=[12911] 00:25:05.848 bw ( KiB/s): min=36840, max=38744, per=99.95%, avg=38002.00, stdev=818.33, samples=4 00:25:05.848 iops : min= 9210, max= 9686, avg=9500.50, stdev=204.58, samples=4 00:25:05.848 write: IOPS=9514, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec); 0 zone resets 00:25:05.848 slat (nsec): min=2010, max=86400, avg=2575.91, stdev=1223.11 00:25:05.848 clat (usec): min=945, max=11738, avg=5982.06, stdev=500.84 00:25:05.848 lat (usec): min=952, max=11741, avg=5984.64, stdev=500.80 00:25:05.848 clat percentiles (usec): 00:25:05.848 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5604], 00:25:05.848 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:25:05.848 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6718], 00:25:05.848 | 99.00th=[ 7046], 99.50th=[ 7242], 99.90th=[ 9896], 99.95th=[10552], 00:25:05.848 | 99.99th=[11207] 00:25:05.848 bw ( KiB/s): min=37776, max=38336, per=99.98%, avg=38052.00, stdev=292.81, samples=4 00:25:05.848 iops : min= 9444, max= 9584, avg=9513.00, stdev=73.20, samples=4 00:25:05.848 lat (usec) : 1000=0.01% 00:25:05.848 lat (msec) : 2=0.02%, 4=0.11%, 10=99.76%, 20=0.11% 00:25:05.848 cpu : usr=63.44%, sys=34.16%, ctx=83, majf=0, minf=41 00:25:05.848 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:05.848 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:05.848 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:05.848 issued rwts: total=19068,19086,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:05.848 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:05.848 00:25:05.848 Run status group 0 (all jobs): 00:25:05.848 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2006-2006msec 00:25:05.848 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:25:05.848 15:26:04 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:05.848 15:26:04 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:05.848 15:26:04 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:05.848 15:26:04 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:05.848 15:26:04 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:05.848 15:26:04 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.848 15:26:04 -- common/autotest_common.sh@1330 -- # shift 00:25:05.848 15:26:04 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:05.848 15:26:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.848 15:26:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.848 15:26:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.848 15:26:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.848 15:26:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.848 15:26:04 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:05.848 15:26:04 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:05.848 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:05.848 fio-3.35 00:25:05.848 Starting 1 thread 00:25:05.848 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.467 00:25:08.467 test: (groupid=0, jobs=1): err= 0: pid=2858042: Tue Nov 19 15:26:06 2024 00:25:08.467 read: IOPS=9000, BW=141MiB/s (147MB/s)(283MiB/2009msec) 00:25:08.467 slat (usec): min=2, max=111, avg= 3.58, stdev= 1.86 00:25:08.467 clat (usec): min=1927, max=15524, avg=8426.57, stdev=2073.44 00:25:08.467 lat (usec): min=1931, max=15527, avg=8430.16, stdev=2073.50 00:25:08.467 clat percentiles (usec): 00:25:08.467 | 1.00th=[ 4293], 5.00th=[ 5145], 10.00th=[ 5866], 20.00th=[ 6652], 00:25:08.467 | 30.00th=[ 7242], 40.00th=[ 7832], 50.00th=[ 8356], 60.00th=[ 8979], 00:25:08.467 | 70.00th=[ 9372], 80.00th=[ 9896], 90.00th=[11076], 95.00th=[12125], 00:25:08.467 | 99.00th=[14222], 99.50th=[14746], 99.90th=[15270], 99.95th=[15401], 00:25:08.467 | 99.99th=[15533] 00:25:08.467 bw ( KiB/s): min=66496, max=76455, per=49.23%, avg=70905.75, stdev=4538.84, samples=4 00:25:08.467 iops : min= 4156, max= 4778, avg=4431.50, stdev=283.50, samples=4 00:25:08.467 write: IOPS=5167, BW=80.7MiB/s (84.7MB/s)(145MiB/1795msec); 0 zone resets 00:25:08.467 slat (usec): min=30, max=188, avg=33.38, stdev= 5.58 00:25:08.467 clat (usec): min=5056, max=17903, avg=10367.70, stdev=1838.36 00:25:08.467 lat (usec): min=5089, max=17937, avg=10401.08, stdev=1838.63 00:25:08.467 clat percentiles (usec): 00:25:08.467 | 1.00th=[ 6849], 5.00th=[ 7767], 10.00th=[ 8291], 20.00th=[ 8848], 00:25:08.467 | 30.00th=[ 9241], 40.00th=[ 9634], 50.00th=[10028], 60.00th=[10552], 00:25:08.467 | 70.00th=[11076], 80.00th=[11863], 90.00th=[13042], 95.00th=[13829], 00:25:08.467 | 99.00th=[15139], 99.50th=[15664], 99.90th=[16319], 99.95th=[17695], 00:25:08.467 | 99.99th=[17957] 00:25:08.467 bw ( KiB/s): min=69312, max=79169, per=89.09%, avg=73656.25, stdev=4348.06, samples=4 00:25:08.467 iops : min= 4332, max= 4948, avg=4603.50, stdev=271.73, samples=4 00:25:08.467 lat (msec) : 2=0.01%, 4=0.44%, 10=69.85%, 20=29.71% 00:25:08.467 cpu : usr=77.79%, sys=20.67%, ctx=39, majf=0, minf=65 00:25:08.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:25:08.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:08.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:08.467 issued rwts: total=18083,9275,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:08.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:08.467 00:25:08.467 Run status group 0 (all jobs): 00:25:08.467 READ: bw=141MiB/s (147MB/s), 141MiB/s-141MiB/s (147MB/s-147MB/s), io=283MiB (296MB), run=2009-2009msec 00:25:08.467 WRITE: bw=80.7MiB/s (84.7MB/s), 80.7MiB/s-80.7MiB/s (84.7MB/s-84.7MB/s), io=145MiB (152MB), run=1795-1795msec 00:25:08.467 15:26:06 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:08.467 15:26:06 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:08.467 15:26:06 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:08.467 15:26:06 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:08.467 15:26:06 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:08.467 15:26:06 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:08.467 15:26:06 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:08.467 15:26:06 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:08.467 15:26:06 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:08.467 15:26:06 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:08.467 15:26:06 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:08.467 15:26:06 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:11.744 Nvme0n1 00:25:11.744 15:26:10 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:15.025 15:26:12 -- host/fio.sh@53 -- # ls_guid=434b0d2d-c42c-4742-a618-ab14c6e9b722 00:25:15.025 15:26:12 -- host/fio.sh@54 -- # get_lvs_free_mb 434b0d2d-c42c-4742-a618-ab14c6e9b722 00:25:15.025 15:26:12 -- common/autotest_common.sh@1353 -- # local lvs_uuid=434b0d2d-c42c-4742-a618-ab14c6e9b722 00:25:15.025 15:26:12 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:15.025 15:26:12 -- common/autotest_common.sh@1355 -- # local fc 00:25:15.025 15:26:12 -- common/autotest_common.sh@1356 -- # local cs 00:25:15.025 15:26:12 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:15.025 15:26:13 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:15.025 { 00:25:15.025 "uuid": "434b0d2d-c42c-4742-a618-ab14c6e9b722", 00:25:15.025 "name": "lvs_0", 00:25:15.025 "base_bdev": "Nvme0n1", 00:25:15.025 "total_data_clusters": 930, 00:25:15.025 "free_clusters": 930, 00:25:15.025 "block_size": 512, 00:25:15.025 "cluster_size": 1073741824 00:25:15.025 } 00:25:15.025 ]' 00:25:15.025 15:26:13 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="434b0d2d-c42c-4742-a618-ab14c6e9b722") .free_clusters' 00:25:15.025 15:26:13 -- common/autotest_common.sh@1358 -- # fc=930 00:25:15.025 15:26:13 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="434b0d2d-c42c-4742-a618-ab14c6e9b722") .cluster_size' 00:25:15.025 15:26:13 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:15.025 15:26:13 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:15.025 15:26:13 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:15.025 952320 00:25:15.025 15:26:13 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:15.283 d9209a76-8562-4120-85b8-22da884fe4c7 00:25:15.283 15:26:13 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:15.541 15:26:13 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:15.798 15:26:14 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:16.056 15:26:14 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:16.056 15:26:14 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:16.056 15:26:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:16.056 15:26:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:16.056 15:26:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:16.056 15:26:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.056 15:26:14 -- common/autotest_common.sh@1330 -- # shift 00:25:16.056 15:26:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:16.056 15:26:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:16.056 15:26:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:16.056 15:26:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:16.056 15:26:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:16.056 15:26:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:16.056 15:26:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:16.056 15:26:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:16.313 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:16.313 fio-3.35 00:25:16.313 Starting 1 thread 00:25:16.313 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.839 [2024-11-19 15:26:17.083448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1097b50 is same with the state(5) to be set 00:25:18.839 00:25:18.839 test: (groupid=0, jobs=1): err= 0: pid=2859365: Tue Nov 19 15:26:17 2024 00:25:18.839 read: IOPS=6456, BW=25.2MiB/s (26.4MB/s)(50.6MiB/2007msec) 00:25:18.839 slat (nsec): min=1890, max=148342, avg=2472.20, stdev=2050.50 00:25:18.839 clat (usec): min=1125, max=170683, avg=10909.89, stdev=11250.99 00:25:18.839 lat (usec): min=1129, max=170718, avg=10912.36, stdev=11251.30 00:25:18.839 clat percentiles (msec): 00:25:18.839 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:18.839 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:18.839 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:18.839 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:18.839 | 99.99th=[ 171] 00:25:18.839 bw ( KiB/s): min=18360, max=28496, per=99.82%, avg=25780.00, stdev=4951.63, samples=4 00:25:18.839 iops : min= 4590, max= 7124, avg=6445.00, stdev=1237.91, samples=4 00:25:18.839 write: IOPS=6464, BW=25.3MiB/s (26.5MB/s)(50.7MiB/2007msec); 0 zone resets 00:25:18.839 slat (usec): min=2, max=129, avg= 2.59, stdev= 1.72 00:25:18.839 clat (usec): min=289, max=168994, avg=8802.59, stdev=10550.60 00:25:18.839 lat (usec): min=292, max=169000, avg=8805.17, stdev=10550.89 00:25:18.839 clat percentiles (msec): 00:25:18.839 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:18.839 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:18.839 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:18.839 | 99.00th=[ 10], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:25:18.839 | 99.99th=[ 169] 00:25:18.839 bw ( KiB/s): min=19368, max=28224, per=99.90%, avg=25834.00, stdev=4315.84, samples=4 00:25:18.839 iops : min= 4842, max= 7056, avg=6458.50, stdev=1078.96, samples=4 00:25:18.839 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:18.839 lat (msec) : 2=0.03%, 4=0.18%, 10=71.40%, 20=27.87%, 250=0.49% 00:25:18.839 cpu : usr=65.40%, sys=32.65%, ctx=135, majf=0, minf=41 00:25:18.839 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:18.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:18.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:18.839 issued rwts: total=12959,12975,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:18.840 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:18.840 00:25:18.840 Run status group 0 (all jobs): 00:25:18.840 READ: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.6MiB (53.1MB), run=2007-2007msec 00:25:18.840 WRITE: bw=25.3MiB/s (26.5MB/s), 25.3MiB/s-25.3MiB/s (26.5MB/s-26.5MB/s), io=50.7MiB (53.1MB), run=2007-2007msec 00:25:18.840 15:26:17 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:18.840 15:26:17 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:20.211 15:26:18 -- host/fio.sh@64 -- # ls_nested_guid=aa97320b-5d03-4a71-b3a7-d4f783b8f357 00:25:20.211 15:26:18 -- host/fio.sh@65 -- # get_lvs_free_mb aa97320b-5d03-4a71-b3a7-d4f783b8f357 00:25:20.211 15:26:18 -- common/autotest_common.sh@1353 -- # local lvs_uuid=aa97320b-5d03-4a71-b3a7-d4f783b8f357 00:25:20.211 15:26:18 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:20.211 15:26:18 -- common/autotest_common.sh@1355 -- # local fc 00:25:20.211 15:26:18 -- common/autotest_common.sh@1356 -- # local cs 00:25:20.211 15:26:18 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:20.469 15:26:18 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:20.469 { 00:25:20.469 "uuid": "434b0d2d-c42c-4742-a618-ab14c6e9b722", 00:25:20.469 "name": "lvs_0", 00:25:20.469 "base_bdev": "Nvme0n1", 00:25:20.469 "total_data_clusters": 930, 00:25:20.469 "free_clusters": 0, 00:25:20.469 "block_size": 512, 00:25:20.469 "cluster_size": 1073741824 00:25:20.469 }, 00:25:20.469 { 00:25:20.469 "uuid": "aa97320b-5d03-4a71-b3a7-d4f783b8f357", 00:25:20.469 "name": "lvs_n_0", 00:25:20.469 "base_bdev": "d9209a76-8562-4120-85b8-22da884fe4c7", 00:25:20.469 "total_data_clusters": 237847, 00:25:20.469 "free_clusters": 237847, 00:25:20.469 "block_size": 512, 00:25:20.469 "cluster_size": 4194304 00:25:20.469 } 00:25:20.469 ]' 00:25:20.469 15:26:18 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="aa97320b-5d03-4a71-b3a7-d4f783b8f357") .free_clusters' 00:25:20.469 15:26:18 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:20.469 15:26:18 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="aa97320b-5d03-4a71-b3a7-d4f783b8f357") .cluster_size' 00:25:20.469 15:26:18 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:20.469 15:26:18 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:20.469 15:26:18 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:20.469 951388 00:25:20.469 15:26:18 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:21.037 992a5445-3d28-4b08-8889-16a76069d33f 00:25:21.037 15:26:19 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:21.294 15:26:19 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:21.552 15:26:20 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:21.809 15:26:20 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:21.809 15:26:20 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:21.809 15:26:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:21.809 15:26:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:21.809 15:26:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:21.809 15:26:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:21.809 15:26:20 -- common/autotest_common.sh@1330 -- # shift 00:25:21.809 15:26:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:21.809 15:26:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:21.809 15:26:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:21.809 15:26:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:21.809 15:26:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:21.810 15:26:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:21.810 15:26:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:21.810 15:26:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:21.810 15:26:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:22.067 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:22.067 fio-3.35 00:25:22.067 Starting 1 thread 00:25:22.067 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.594 00:25:24.594 test: (groupid=0, jobs=1): err= 0: pid=2860249: Tue Nov 19 15:26:22 2024 00:25:24.594 read: IOPS=6176, BW=24.1MiB/s (25.3MB/s)(48.4MiB/2008msec) 00:25:24.594 slat (nsec): min=1923, max=164900, avg=2550.22, stdev=1993.74 00:25:24.594 clat (usec): min=4290, max=17835, avg=11429.33, stdev=967.70 00:25:24.594 lat (usec): min=4294, max=17838, avg=11431.88, stdev=967.64 00:25:24.594 clat percentiles (usec): 00:25:24.594 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:25:24.594 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[11600], 00:25:24.594 | 70.00th=[11863], 80.00th=[12256], 90.00th=[12649], 95.00th=[12911], 00:25:24.594 | 99.00th=[13566], 99.50th=[13829], 99.90th=[17171], 99.95th=[17433], 00:25:24.594 | 99.99th=[17695] 00:25:24.594 bw ( KiB/s): min=23384, max=25200, per=99.82%, avg=24660.00, stdev=855.28, samples=4 00:25:24.594 iops : min= 5846, max= 6300, avg=6165.00, stdev=213.82, samples=4 00:25:24.594 write: IOPS=6160, BW=24.1MiB/s (25.2MB/s)(48.3MiB/2008msec); 0 zone resets 00:25:24.594 slat (nsec): min=1997, max=95412, avg=2627.19, stdev=1377.44 00:25:24.594 clat (usec): min=2107, max=17231, avg=9165.41, stdev=830.40 00:25:24.594 lat (usec): min=2113, max=17234, avg=9168.04, stdev=830.39 00:25:24.595 clat percentiles (usec): 00:25:24.595 | 1.00th=[ 7308], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:24.595 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9110], 60.00th=[ 9372], 00:25:24.595 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10159], 95.00th=[10421], 00:25:24.595 | 99.00th=[10945], 99.50th=[11338], 99.90th=[14484], 99.95th=[15664], 00:25:24.595 | 99.99th=[17171] 00:25:24.595 bw ( KiB/s): min=24472, max=24768, per=99.95%, avg=24630.00, stdev=121.39, samples=4 00:25:24.595 iops : min= 6118, max= 6192, avg=6157.50, stdev=30.35, samples=4 00:25:24.595 lat (msec) : 4=0.04%, 10=46.26%, 20=53.70% 00:25:24.595 cpu : usr=62.58%, sys=35.58%, ctx=134, majf=0, minf=41 00:25:24.595 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:24.595 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:24.595 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:24.595 issued rwts: total=12402,12371,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:24.595 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:24.595 00:25:24.595 Run status group 0 (all jobs): 00:25:24.595 READ: bw=24.1MiB/s (25.3MB/s), 24.1MiB/s-24.1MiB/s (25.3MB/s-25.3MB/s), io=48.4MiB (50.8MB), run=2008-2008msec 00:25:24.595 WRITE: bw=24.1MiB/s (25.2MB/s), 24.1MiB/s-24.1MiB/s (25.2MB/s-25.2MB/s), io=48.3MiB (50.7MB), run=2008-2008msec 00:25:24.595 15:26:22 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:24.852 15:26:23 -- host/fio.sh@74 -- # sync 00:25:24.852 15:26:23 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:29.036 15:26:27 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:29.036 15:26:27 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:32.316 15:26:30 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:32.316 15:26:30 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:34.215 15:26:32 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:34.215 15:26:32 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:34.215 15:26:32 -- host/fio.sh@86 -- # nvmftestfini 00:25:34.215 15:26:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:34.215 15:26:32 -- nvmf/common.sh@116 -- # sync 00:25:34.215 15:26:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:34.215 15:26:32 -- nvmf/common.sh@119 -- # set +e 00:25:34.215 15:26:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:34.215 15:26:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:34.215 rmmod nvme_tcp 00:25:34.215 rmmod nvme_fabrics 00:25:34.215 rmmod nvme_keyring 00:25:34.215 15:26:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:34.215 15:26:32 -- nvmf/common.sh@123 -- # set -e 00:25:34.215 15:26:32 -- nvmf/common.sh@124 -- # return 0 00:25:34.215 15:26:32 -- nvmf/common.sh@477 -- # '[' -n 2857201 ']' 00:25:34.215 15:26:32 -- nvmf/common.sh@478 -- # killprocess 2857201 00:25:34.215 15:26:32 -- common/autotest_common.sh@936 -- # '[' -z 2857201 ']' 00:25:34.215 15:26:32 -- common/autotest_common.sh@940 -- # kill -0 2857201 00:25:34.215 15:26:32 -- common/autotest_common.sh@941 -- # uname 00:25:34.215 15:26:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.215 15:26:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2857201 00:25:34.215 15:26:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:34.215 15:26:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:34.215 15:26:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2857201' 00:25:34.215 killing process with pid 2857201 00:25:34.215 15:26:32 -- common/autotest_common.sh@955 -- # kill 2857201 00:25:34.215 15:26:32 -- common/autotest_common.sh@960 -- # wait 2857201 00:25:34.215 15:26:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:34.215 15:26:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:34.216 15:26:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:34.216 15:26:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:34.216 15:26:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:34.216 15:26:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.216 15:26:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.216 15:26:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.753 15:26:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:36.753 00:25:36.753 real 0m38.179s 00:25:36.753 user 2m26.111s 00:25:36.753 sys 0m6.965s 00:25:36.753 15:26:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:36.753 15:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:36.753 ************************************ 00:25:36.753 END TEST nvmf_fio_host 00:25:36.753 ************************************ 00:25:36.753 15:26:34 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:36.753 15:26:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:36.753 15:26:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:36.753 15:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:36.753 ************************************ 00:25:36.753 START TEST nvmf_failover 00:25:36.753 ************************************ 00:25:36.753 15:26:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:36.753 * Looking for test storage... 00:25:36.753 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:36.753 15:26:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:36.753 15:26:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:36.753 15:26:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:36.753 15:26:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:36.753 15:26:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:36.753 15:26:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:36.753 15:26:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:36.753 15:26:34 -- scripts/common.sh@335 -- # IFS=.-: 00:25:36.753 15:26:34 -- scripts/common.sh@335 -- # read -ra ver1 00:25:36.753 15:26:34 -- scripts/common.sh@336 -- # IFS=.-: 00:25:36.753 15:26:34 -- scripts/common.sh@336 -- # read -ra ver2 00:25:36.753 15:26:34 -- scripts/common.sh@337 -- # local 'op=<' 00:25:36.753 15:26:34 -- scripts/common.sh@339 -- # ver1_l=2 00:25:36.753 15:26:34 -- scripts/common.sh@340 -- # ver2_l=1 00:25:36.753 15:26:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:36.753 15:26:34 -- scripts/common.sh@343 -- # case "$op" in 00:25:36.753 15:26:34 -- scripts/common.sh@344 -- # : 1 00:25:36.753 15:26:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:36.753 15:26:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:36.753 15:26:34 -- scripts/common.sh@364 -- # decimal 1 00:25:36.753 15:26:34 -- scripts/common.sh@352 -- # local d=1 00:25:36.753 15:26:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:36.753 15:26:34 -- scripts/common.sh@354 -- # echo 1 00:25:36.754 15:26:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:36.754 15:26:34 -- scripts/common.sh@365 -- # decimal 2 00:25:36.754 15:26:34 -- scripts/common.sh@352 -- # local d=2 00:25:36.754 15:26:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:36.754 15:26:34 -- scripts/common.sh@354 -- # echo 2 00:25:36.754 15:26:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:36.754 15:26:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:36.754 15:26:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:36.754 15:26:34 -- scripts/common.sh@367 -- # return 0 00:25:36.754 15:26:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:36.754 15:26:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:36.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.754 --rc genhtml_branch_coverage=1 00:25:36.754 --rc genhtml_function_coverage=1 00:25:36.754 --rc genhtml_legend=1 00:25:36.754 --rc geninfo_all_blocks=1 00:25:36.754 --rc geninfo_unexecuted_blocks=1 00:25:36.754 00:25:36.754 ' 00:25:36.754 15:26:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:36.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.754 --rc genhtml_branch_coverage=1 00:25:36.754 --rc genhtml_function_coverage=1 00:25:36.754 --rc genhtml_legend=1 00:25:36.754 --rc geninfo_all_blocks=1 00:25:36.754 --rc geninfo_unexecuted_blocks=1 00:25:36.754 00:25:36.754 ' 00:25:36.754 15:26:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:36.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.754 --rc genhtml_branch_coverage=1 00:25:36.754 --rc genhtml_function_coverage=1 00:25:36.754 --rc genhtml_legend=1 00:25:36.754 --rc geninfo_all_blocks=1 00:25:36.754 --rc geninfo_unexecuted_blocks=1 00:25:36.754 00:25:36.754 ' 00:25:36.754 15:26:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:36.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:36.754 --rc genhtml_branch_coverage=1 00:25:36.754 --rc genhtml_function_coverage=1 00:25:36.754 --rc genhtml_legend=1 00:25:36.754 --rc geninfo_all_blocks=1 00:25:36.754 --rc geninfo_unexecuted_blocks=1 00:25:36.754 00:25:36.754 ' 00:25:36.754 15:26:34 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:36.754 15:26:34 -- nvmf/common.sh@7 -- # uname -s 00:25:36.754 15:26:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:36.754 15:26:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:36.754 15:26:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:36.754 15:26:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:36.754 15:26:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:36.754 15:26:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:36.754 15:26:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:36.754 15:26:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:36.754 15:26:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:36.754 15:26:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:36.754 15:26:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.754 15:26:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:36.754 15:26:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:36.754 15:26:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:36.754 15:26:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:36.754 15:26:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:36.754 15:26:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:36.754 15:26:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:36.754 15:26:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:36.754 15:26:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.754 15:26:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.754 15:26:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.754 15:26:34 -- paths/export.sh@5 -- # export PATH 00:25:36.754 15:26:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:36.754 15:26:34 -- nvmf/common.sh@46 -- # : 0 00:25:36.754 15:26:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:36.754 15:26:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:36.754 15:26:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:36.754 15:26:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:36.754 15:26:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:36.754 15:26:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:36.754 15:26:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:36.754 15:26:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:36.754 15:26:34 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:36.754 15:26:34 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:36.754 15:26:34 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:36.754 15:26:34 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:36.754 15:26:34 -- host/failover.sh@18 -- # nvmftestinit 00:25:36.754 15:26:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:36.754 15:26:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:36.754 15:26:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:36.754 15:26:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:36.754 15:26:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:36.754 15:26:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.754 15:26:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.754 15:26:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:36.754 15:26:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:36.754 15:26:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:36.754 15:26:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:36.754 15:26:34 -- common/autotest_common.sh@10 -- # set +x 00:25:38.654 15:26:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:38.654 15:26:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:38.654 15:26:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:38.654 15:26:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:38.654 15:26:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:38.654 15:26:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:38.654 15:26:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:38.654 15:26:37 -- nvmf/common.sh@294 -- # net_devs=() 00:25:38.654 15:26:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:38.654 15:26:37 -- nvmf/common.sh@295 -- # e810=() 00:25:38.654 15:26:37 -- nvmf/common.sh@295 -- # local -ga e810 00:25:38.654 15:26:37 -- nvmf/common.sh@296 -- # x722=() 00:25:38.654 15:26:37 -- nvmf/common.sh@296 -- # local -ga x722 00:25:38.654 15:26:37 -- nvmf/common.sh@297 -- # mlx=() 00:25:38.654 15:26:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:38.654 15:26:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:38.654 15:26:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:38.654 15:26:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:38.654 15:26:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.654 15:26:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:38.654 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:38.654 15:26:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.654 15:26:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:38.654 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:38.654 15:26:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.654 15:26:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.654 15:26:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.654 15:26:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:38.654 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:38.654 15:26:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.654 15:26:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.654 15:26:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.654 15:26:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.654 15:26:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:38.654 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:38.654 15:26:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.654 15:26:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:38.654 15:26:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:38.654 15:26:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:38.654 15:26:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:38.654 15:26:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:38.654 15:26:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:38.654 15:26:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:38.654 15:26:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:38.654 15:26:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:38.655 15:26:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:38.655 15:26:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:38.655 15:26:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:38.655 15:26:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:38.655 15:26:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:38.655 15:26:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:38.655 15:26:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:38.655 15:26:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:38.655 15:26:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:38.655 15:26:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:38.655 15:26:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:38.655 15:26:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:38.655 15:26:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:38.655 15:26:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:38.655 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:38.655 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:25:38.655 00:25:38.655 --- 10.0.0.2 ping statistics --- 00:25:38.655 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.655 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:25:38.655 15:26:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:38.655 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:38.655 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.194 ms 00:25:38.655 00:25:38.655 --- 10.0.0.1 ping statistics --- 00:25:38.655 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.655 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:25:38.655 15:26:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:38.655 15:26:37 -- nvmf/common.sh@410 -- # return 0 00:25:38.655 15:26:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:38.655 15:26:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:38.655 15:26:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:38.655 15:26:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:38.655 15:26:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:38.655 15:26:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:38.655 15:26:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:38.655 15:26:37 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:38.655 15:26:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:38.655 15:26:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:38.655 15:26:37 -- common/autotest_common.sh@10 -- # set +x 00:25:38.655 15:26:37 -- nvmf/common.sh@469 -- # nvmfpid=2863555 00:25:38.655 15:26:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:38.655 15:26:37 -- nvmf/common.sh@470 -- # waitforlisten 2863555 00:25:38.655 15:26:37 -- common/autotest_common.sh@829 -- # '[' -z 2863555 ']' 00:25:38.655 15:26:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:38.655 15:26:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:38.655 15:26:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:38.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:38.655 15:26:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:38.655 15:26:37 -- common/autotest_common.sh@10 -- # set +x 00:25:38.913 [2024-11-19 15:26:37.230328] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:38.913 [2024-11-19 15:26:37.230418] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:38.913 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.913 [2024-11-19 15:26:37.305135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:38.913 [2024-11-19 15:26:37.424184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:38.913 [2024-11-19 15:26:37.424355] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:38.913 [2024-11-19 15:26:37.424376] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:38.913 [2024-11-19 15:26:37.424391] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:38.913 [2024-11-19 15:26:37.424482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:38.913 [2024-11-19 15:26:37.425724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:38.913 [2024-11-19 15:26:37.425730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:39.845 15:26:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.845 15:26:38 -- common/autotest_common.sh@862 -- # return 0 00:25:39.845 15:26:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:39.845 15:26:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:39.845 15:26:38 -- common/autotest_common.sh@10 -- # set +x 00:25:39.845 15:26:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:39.845 15:26:38 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:40.102 [2024-11-19 15:26:38.474440] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:40.102 15:26:38 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:40.360 Malloc0 00:25:40.360 15:26:38 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:40.618 15:26:39 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:40.874 15:26:39 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:41.131 [2024-11-19 15:26:39.535769] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:41.131 15:26:39 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:41.388 [2024-11-19 15:26:39.788579] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:41.388 15:26:39 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:41.647 [2024-11-19 15:26:40.069631] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:41.647 15:26:40 -- host/failover.sh@31 -- # bdevperf_pid=2863985 00:25:41.647 15:26:40 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:41.647 15:26:40 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:41.647 15:26:40 -- host/failover.sh@34 -- # waitforlisten 2863985 /var/tmp/bdevperf.sock 00:25:41.647 15:26:40 -- common/autotest_common.sh@829 -- # '[' -z 2863985 ']' 00:25:41.647 15:26:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:41.647 15:26:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.647 15:26:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:41.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:41.647 15:26:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.647 15:26:40 -- common/autotest_common.sh@10 -- # set +x 00:25:42.580 15:26:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.580 15:26:41 -- common/autotest_common.sh@862 -- # return 0 00:25:42.580 15:26:41 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:43.146 NVMe0n1 00:25:43.146 15:26:41 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:43.404 00:25:43.404 15:26:41 -- host/failover.sh@39 -- # run_test_pid=2864137 00:25:43.404 15:26:41 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:43.404 15:26:41 -- host/failover.sh@41 -- # sleep 1 00:25:44.779 15:26:42 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.779 [2024-11-19 15:26:43.162344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.779 [2024-11-19 15:26:43.162800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.162992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 [2024-11-19 15:26:43.163073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x568cb0 is same with the state(5) to be set 00:25:44.780 15:26:43 -- host/failover.sh@45 -- # sleep 3 00:25:48.061 15:26:46 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.061 00:25:48.061 15:26:46 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:48.319 [2024-11-19 15:26:46.776266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 [2024-11-19 15:26:46.776756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56a3a0 is same with the state(5) to be set 00:25:48.320 15:26:46 -- host/failover.sh@50 -- # sleep 3 00:25:51.632 15:26:49 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:51.632 [2024-11-19 15:26:50.035876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:51.632 15:26:50 -- host/failover.sh@55 -- # sleep 1 00:25:52.620 15:26:51 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:52.880 [2024-11-19 15:26:51.341102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 [2024-11-19 15:26:51.341822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56aa80 is same with the state(5) to be set 00:25:52.880 15:26:51 -- host/failover.sh@59 -- # wait 2864137 00:25:59.446 0 00:25:59.446 15:26:57 -- host/failover.sh@61 -- # killprocess 2863985 00:25:59.446 15:26:57 -- common/autotest_common.sh@936 -- # '[' -z 2863985 ']' 00:25:59.446 15:26:57 -- common/autotest_common.sh@940 -- # kill -0 2863985 00:25:59.446 15:26:57 -- common/autotest_common.sh@941 -- # uname 00:25:59.446 15:26:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.446 15:26:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2863985 00:25:59.446 15:26:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.446 15:26:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.446 15:26:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2863985' 00:25:59.446 killing process with pid 2863985 00:25:59.446 15:26:57 -- common/autotest_common.sh@955 -- # kill 2863985 00:25:59.446 15:26:57 -- common/autotest_common.sh@960 -- # wait 2863985 00:25:59.446 15:26:57 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:59.446 [2024-11-19 15:26:40.127764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.446 [2024-11-19 15:26:40.127866] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2863985 ] 00:25:59.446 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.446 [2024-11-19 15:26:40.193247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.446 [2024-11-19 15:26:40.307747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.446 Running I/O for 15 seconds... 00:25:59.446 [2024-11-19 15:26:43.163388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.163972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.163986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.446 [2024-11-19 15:26:43.164345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.446 [2024-11-19 15:26:43.164359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:116176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:116192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:116200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:116216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:116248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:116272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.164856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.164959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.164978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:116280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:116296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:116304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:116328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:116336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.447 [2024-11-19 15:26:43.165515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.447 [2024-11-19 15:26:43.165544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.447 [2024-11-19 15:26:43.165558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.165572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.165929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.165958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.165973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.448 [2024-11-19 15:26:43.166759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.448 [2024-11-19 15:26:43.166774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.448 [2024-11-19 15:26:43.166789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.166819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.166849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.166878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.166912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.166943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.166972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.166988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.449 [2024-11-19 15:26:43.167162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:43.167374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbf96a0 is same with the state(5) to be set 00:25:59.449 [2024-11-19 15:26:43.167405] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.449 [2024-11-19 15:26:43.167416] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.449 [2024-11-19 15:26:43.167427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116152 len:8 PRP1 0x0 PRP2 0x0 00:25:59.449 [2024-11-19 15:26:43.167439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167495] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xbf96a0 was disconnected and freed. reset controller. 00:25:59.449 [2024-11-19 15:26:43.167520] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:59.449 [2024-11-19 15:26:43.167568] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:43.167589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:43.167618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167632] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:43.167646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:43.167673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:43.167686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.449 [2024-11-19 15:26:43.167748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbda870 (9): Bad file descriptor 00:25:59.449 [2024-11-19 15:26:43.169882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.449 [2024-11-19 15:26:43.277584] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.449 [2024-11-19 15:26:46.776080] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:46.776158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:46.776204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:46.776232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.449 [2024-11-19 15:26:46.776261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbda870 is same with the state(5) to be set 00:25:59.449 [2024-11-19 15:26:46.776885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:5128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.776909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.776952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.776969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:5152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.776984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.777009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.777023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.777038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.777052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.777074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.777089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.777105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.449 [2024-11-19 15:26:46.777143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.449 [2024-11-19 15:26:46.777158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:4616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:4656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:4672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:5288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:5296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:4680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:4688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:4704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:4728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:4736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:5368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.777941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.450 [2024-11-19 15:26:46.777973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.777999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:5392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.450 [2024-11-19 15:26:46.778012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.778026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:5400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.450 [2024-11-19 15:26:46.778044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.778059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.778073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.778087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:5416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.450 [2024-11-19 15:26:46.778100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.778114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.450 [2024-11-19 15:26:46.778127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.450 [2024-11-19 15:26:46.778141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:4800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:4824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:4840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:4848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:4896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:4936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:4944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:4992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:5016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:5072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:5464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.778748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:5472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.778777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.778964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.778982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.779092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:5568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.779152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:5592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.779235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.451 [2024-11-19 15:26:46.779263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.779290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.451 [2024-11-19 15:26:46.779304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.451 [2024-11-19 15:26:46.779317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:5120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:5640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:5656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:5664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:5680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:5688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:5696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.779857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.779979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.779994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:5736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.780010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.780334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:5832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.780363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.780451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.452 [2024-11-19 15:26:46.780481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.452 [2024-11-19 15:26:46.780495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.452 [2024-11-19 15:26:46.780509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:5240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:46.780754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbe6d10 is same with the state(5) to be set 00:25:59.453 [2024-11-19 15:26:46.780786] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.453 [2024-11-19 15:26:46.780797] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.453 [2024-11-19 15:26:46.780809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5360 len:8 PRP1 0x0 PRP2 0x0 00:25:59.453 [2024-11-19 15:26:46.780823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:46.780879] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xbe6d10 was disconnected and freed. reset controller. 00:25:59.453 [2024-11-19 15:26:46.780898] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:59.453 [2024-11-19 15:26:46.780914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.453 [2024-11-19 15:26:46.783131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.453 [2024-11-19 15:26:46.783169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbda870 (9): Bad file descriptor 00:25:59.453 [2024-11-19 15:26:46.932260] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.453 [2024-11-19 15:26:51.341957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.341998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:5440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:4848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:4888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:4896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:4936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:4960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.453 [2024-11-19 15:26:51.342864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.453 [2024-11-19 15:26:51.342878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.342893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.342907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.342922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.342945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.342960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.342974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.342989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:5088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:5696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:5704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:5712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:5728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:5752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:5776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:5784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:5800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:5808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.343959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.343974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.343988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.344003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:5840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.344032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.344047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.454 [2024-11-19 15:26:51.344062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.344077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:5856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.344090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.454 [2024-11-19 15:26:51.344105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:5864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.454 [2024-11-19 15:26:51.344123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:5920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:5960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:5968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:6024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.455 [2024-11-19 15:26:51.344886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.344959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.344975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:5336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.455 [2024-11-19 15:26:51.345200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.455 [2024-11-19 15:26:51.345214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.456 [2024-11-19 15:26:51.345257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:6112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.456 [2024-11-19 15:26:51.345351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:6128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.456 [2024-11-19 15:26:51.345407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.456 [2024-11-19 15:26:51.345435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:6152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.456 [2024-11-19 15:26:51.345489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:59.456 [2024-11-19 15:26:51.345959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.345973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbfd630 is same with the state(5) to be set 00:25:59.456 [2024-11-19 15:26:51.345989] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.456 [2024-11-19 15:26:51.346000] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.456 [2024-11-19 15:26:51.346013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5672 len:8 PRP1 0x0 PRP2 0x0 00:25:59.456 [2024-11-19 15:26:51.346026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.346087] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xbfd630 was disconnected and freed. reset controller. 00:25:59.456 [2024-11-19 15:26:51.346105] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:59.456 [2024-11-19 15:26:51.346153] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.456 [2024-11-19 15:26:51.346177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.346194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.456 [2024-11-19 15:26:51.346208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.346221] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.456 [2024-11-19 15:26:51.346234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.346248] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.456 [2024-11-19 15:26:51.346262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.456 [2024-11-19 15:26:51.346274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.456 [2024-11-19 15:26:51.348477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.456 [2024-11-19 15:26:51.348519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbda870 (9): Bad file descriptor 00:25:59.456 [2024-11-19 15:26:51.379949] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.456 00:25:59.456 Latency(us) 00:25:59.456 [2024-11-19T14:26:58.019Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.456 [2024-11-19T14:26:58.019Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:59.456 Verification LBA range: start 0x0 length 0x4000 00:25:59.456 NVMe0n1 : 15.01 12652.43 49.42 1114.38 0.00 9280.24 770.65 16408.27 00:25:59.456 [2024-11-19T14:26:58.019Z] =================================================================================================================== 00:25:59.456 [2024-11-19T14:26:58.019Z] Total : 12652.43 49.42 1114.38 0.00 9280.24 770.65 16408.27 00:25:59.456 Received shutdown signal, test time was about 15.000000 seconds 00:25:59.456 00:25:59.456 Latency(us) 00:25:59.456 [2024-11-19T14:26:58.019Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.456 [2024-11-19T14:26:58.019Z] =================================================================================================================== 00:25:59.456 [2024-11-19T14:26:58.019Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:59.456 15:26:57 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:59.456 15:26:57 -- host/failover.sh@65 -- # count=3 00:25:59.456 15:26:57 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:59.456 15:26:57 -- host/failover.sh@73 -- # bdevperf_pid=2866039 00:25:59.456 15:26:57 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:59.457 15:26:57 -- host/failover.sh@75 -- # waitforlisten 2866039 /var/tmp/bdevperf.sock 00:25:59.457 15:26:57 -- common/autotest_common.sh@829 -- # '[' -z 2866039 ']' 00:25:59.457 15:26:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:59.457 15:26:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.457 15:26:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:59.457 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:59.457 15:26:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.457 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:26:00.022 15:26:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.022 15:26:58 -- common/autotest_common.sh@862 -- # return 0 00:26:00.022 15:26:58 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:00.279 [2024-11-19 15:26:58.589957] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:00.279 15:26:58 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:00.537 [2024-11-19 15:26:58.842726] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:00.537 15:26:58 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:00.811 NVMe0n1 00:26:00.811 15:26:59 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:01.382 00:26:01.382 15:26:59 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:01.640 00:26:01.640 15:27:00 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:01.640 15:27:00 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:01.897 15:27:00 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:02.154 15:27:00 -- host/failover.sh@87 -- # sleep 3 00:26:05.432 15:27:03 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:05.432 15:27:03 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:05.691 15:27:03 -- host/failover.sh@90 -- # run_test_pid=2866973 00:26:05.691 15:27:03 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:05.691 15:27:04 -- host/failover.sh@92 -- # wait 2866973 00:26:06.625 0 00:26:06.625 15:27:05 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:06.625 [2024-11-19 15:26:57.407208] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.625 [2024-11-19 15:26:57.407311] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2866039 ] 00:26:06.625 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.625 [2024-11-19 15:26:57.467588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:06.625 [2024-11-19 15:26:57.571039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:06.625 [2024-11-19 15:27:00.684087] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:06.625 [2024-11-19 15:27:00.684178] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.625 [2024-11-19 15:27:00.684203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.625 [2024-11-19 15:27:00.684219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.625 [2024-11-19 15:27:00.684250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.625 [2024-11-19 15:27:00.684264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.625 [2024-11-19 15:27:00.684278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.625 [2024-11-19 15:27:00.684292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.625 [2024-11-19 15:27:00.684306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.625 [2024-11-19 15:27:00.684320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:06.625 [2024-11-19 15:27:00.684358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:06.625 [2024-11-19 15:27:00.684390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b60870 (9): Bad file descriptor 00:26:06.625 [2024-11-19 15:27:00.735807] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:06.625 Running I/O for 1 seconds... 00:26:06.625 00:26:06.625 Latency(us) 00:26:06.625 [2024-11-19T14:27:05.188Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:06.625 [2024-11-19T14:27:05.188Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:06.625 Verification LBA range: start 0x0 length 0x4000 00:26:06.625 NVMe0n1 : 1.01 12809.28 50.04 0.00 0.00 9948.07 1140.81 14757.74 00:26:06.625 [2024-11-19T14:27:05.188Z] =================================================================================================================== 00:26:06.625 [2024-11-19T14:27:05.188Z] Total : 12809.28 50.04 0.00 0.00 9948.07 1140.81 14757.74 00:26:06.625 15:27:05 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:06.625 15:27:05 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:06.883 15:27:05 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:07.140 15:27:05 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.140 15:27:05 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:07.398 15:27:05 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:07.656 15:27:06 -- host/failover.sh@101 -- # sleep 3 00:26:10.936 15:27:09 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:10.936 15:27:09 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:10.936 15:27:09 -- host/failover.sh@108 -- # killprocess 2866039 00:26:10.936 15:27:09 -- common/autotest_common.sh@936 -- # '[' -z 2866039 ']' 00:26:10.936 15:27:09 -- common/autotest_common.sh@940 -- # kill -0 2866039 00:26:10.936 15:27:09 -- common/autotest_common.sh@941 -- # uname 00:26:10.936 15:27:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:10.936 15:27:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2866039 00:26:11.194 15:27:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:11.194 15:27:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:11.194 15:27:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2866039' 00:26:11.194 killing process with pid 2866039 00:26:11.194 15:27:09 -- common/autotest_common.sh@955 -- # kill 2866039 00:26:11.194 15:27:09 -- common/autotest_common.sh@960 -- # wait 2866039 00:26:11.194 15:27:09 -- host/failover.sh@110 -- # sync 00:26:11.194 15:27:09 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:11.452 15:27:10 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:11.452 15:27:10 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:11.452 15:27:10 -- host/failover.sh@116 -- # nvmftestfini 00:26:11.452 15:27:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:11.452 15:27:10 -- nvmf/common.sh@116 -- # sync 00:26:11.452 15:27:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:11.452 15:27:10 -- nvmf/common.sh@119 -- # set +e 00:26:11.452 15:27:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:11.452 15:27:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:11.452 rmmod nvme_tcp 00:26:11.710 rmmod nvme_fabrics 00:26:11.710 rmmod nvme_keyring 00:26:11.710 15:27:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:11.710 15:27:10 -- nvmf/common.sh@123 -- # set -e 00:26:11.710 15:27:10 -- nvmf/common.sh@124 -- # return 0 00:26:11.710 15:27:10 -- nvmf/common.sh@477 -- # '[' -n 2863555 ']' 00:26:11.710 15:27:10 -- nvmf/common.sh@478 -- # killprocess 2863555 00:26:11.710 15:27:10 -- common/autotest_common.sh@936 -- # '[' -z 2863555 ']' 00:26:11.710 15:27:10 -- common/autotest_common.sh@940 -- # kill -0 2863555 00:26:11.710 15:27:10 -- common/autotest_common.sh@941 -- # uname 00:26:11.710 15:27:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:11.710 15:27:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2863555 00:26:11.710 15:27:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:11.710 15:27:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:11.710 15:27:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2863555' 00:26:11.710 killing process with pid 2863555 00:26:11.710 15:27:10 -- common/autotest_common.sh@955 -- # kill 2863555 00:26:11.710 15:27:10 -- common/autotest_common.sh@960 -- # wait 2863555 00:26:11.968 15:27:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:11.968 15:27:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:11.968 15:27:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:11.968 15:27:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:11.968 15:27:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:11.968 15:27:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.968 15:27:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.968 15:27:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.503 15:27:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:14.503 00:26:14.503 real 0m37.633s 00:26:14.503 user 2m12.408s 00:26:14.503 sys 0m6.332s 00:26:14.503 15:27:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:14.503 15:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:14.503 ************************************ 00:26:14.503 END TEST nvmf_failover 00:26:14.503 ************************************ 00:26:14.503 15:27:12 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:14.503 15:27:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:14.503 15:27:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:14.503 15:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:14.503 ************************************ 00:26:14.503 START TEST nvmf_discovery 00:26:14.503 ************************************ 00:26:14.503 15:27:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:14.503 * Looking for test storage... 00:26:14.503 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:14.503 15:27:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:14.503 15:27:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:14.503 15:27:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:14.503 15:27:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:14.503 15:27:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:14.503 15:27:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:14.503 15:27:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:14.503 15:27:12 -- scripts/common.sh@335 -- # IFS=.-: 00:26:14.503 15:27:12 -- scripts/common.sh@335 -- # read -ra ver1 00:26:14.503 15:27:12 -- scripts/common.sh@336 -- # IFS=.-: 00:26:14.503 15:27:12 -- scripts/common.sh@336 -- # read -ra ver2 00:26:14.503 15:27:12 -- scripts/common.sh@337 -- # local 'op=<' 00:26:14.503 15:27:12 -- scripts/common.sh@339 -- # ver1_l=2 00:26:14.503 15:27:12 -- scripts/common.sh@340 -- # ver2_l=1 00:26:14.503 15:27:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:14.503 15:27:12 -- scripts/common.sh@343 -- # case "$op" in 00:26:14.503 15:27:12 -- scripts/common.sh@344 -- # : 1 00:26:14.503 15:27:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:14.503 15:27:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:14.503 15:27:12 -- scripts/common.sh@364 -- # decimal 1 00:26:14.503 15:27:12 -- scripts/common.sh@352 -- # local d=1 00:26:14.503 15:27:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:14.503 15:27:12 -- scripts/common.sh@354 -- # echo 1 00:26:14.503 15:27:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:14.503 15:27:12 -- scripts/common.sh@365 -- # decimal 2 00:26:14.504 15:27:12 -- scripts/common.sh@352 -- # local d=2 00:26:14.504 15:27:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:14.504 15:27:12 -- scripts/common.sh@354 -- # echo 2 00:26:14.504 15:27:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:14.504 15:27:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:14.504 15:27:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:14.504 15:27:12 -- scripts/common.sh@367 -- # return 0 00:26:14.504 15:27:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:14.504 15:27:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:14.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:14.504 --rc genhtml_branch_coverage=1 00:26:14.504 --rc genhtml_function_coverage=1 00:26:14.504 --rc genhtml_legend=1 00:26:14.504 --rc geninfo_all_blocks=1 00:26:14.504 --rc geninfo_unexecuted_blocks=1 00:26:14.504 00:26:14.504 ' 00:26:14.504 15:27:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:14.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:14.504 --rc genhtml_branch_coverage=1 00:26:14.504 --rc genhtml_function_coverage=1 00:26:14.504 --rc genhtml_legend=1 00:26:14.504 --rc geninfo_all_blocks=1 00:26:14.504 --rc geninfo_unexecuted_blocks=1 00:26:14.504 00:26:14.504 ' 00:26:14.504 15:27:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:14.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:14.504 --rc genhtml_branch_coverage=1 00:26:14.504 --rc genhtml_function_coverage=1 00:26:14.504 --rc genhtml_legend=1 00:26:14.504 --rc geninfo_all_blocks=1 00:26:14.504 --rc geninfo_unexecuted_blocks=1 00:26:14.504 00:26:14.504 ' 00:26:14.504 15:27:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:14.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:14.504 --rc genhtml_branch_coverage=1 00:26:14.504 --rc genhtml_function_coverage=1 00:26:14.504 --rc genhtml_legend=1 00:26:14.504 --rc geninfo_all_blocks=1 00:26:14.504 --rc geninfo_unexecuted_blocks=1 00:26:14.504 00:26:14.504 ' 00:26:14.504 15:27:12 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:14.504 15:27:12 -- nvmf/common.sh@7 -- # uname -s 00:26:14.504 15:27:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:14.504 15:27:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:14.504 15:27:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:14.504 15:27:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:14.504 15:27:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:14.504 15:27:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:14.504 15:27:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:14.504 15:27:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:14.504 15:27:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:14.504 15:27:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:14.504 15:27:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:14.504 15:27:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:14.504 15:27:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:14.504 15:27:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:14.504 15:27:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:14.504 15:27:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:14.504 15:27:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:14.504 15:27:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:14.504 15:27:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:14.504 15:27:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.504 15:27:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.504 15:27:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.504 15:27:12 -- paths/export.sh@5 -- # export PATH 00:26:14.504 15:27:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.504 15:27:12 -- nvmf/common.sh@46 -- # : 0 00:26:14.504 15:27:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:14.504 15:27:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:14.504 15:27:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:14.504 15:27:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:14.504 15:27:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:14.504 15:27:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:14.504 15:27:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:14.504 15:27:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:14.504 15:27:12 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:14.504 15:27:12 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:14.504 15:27:12 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:14.504 15:27:12 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:14.504 15:27:12 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:14.504 15:27:12 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:14.504 15:27:12 -- host/discovery.sh@25 -- # nvmftestinit 00:26:14.504 15:27:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:14.504 15:27:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:14.504 15:27:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:14.504 15:27:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:14.504 15:27:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:14.504 15:27:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.504 15:27:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.504 15:27:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.504 15:27:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:14.504 15:27:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:14.504 15:27:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:14.504 15:27:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.408 15:27:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:16.408 15:27:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:16.408 15:27:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:16.408 15:27:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:16.408 15:27:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:16.408 15:27:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:16.408 15:27:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:16.408 15:27:14 -- nvmf/common.sh@294 -- # net_devs=() 00:26:16.408 15:27:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:16.408 15:27:14 -- nvmf/common.sh@295 -- # e810=() 00:26:16.408 15:27:14 -- nvmf/common.sh@295 -- # local -ga e810 00:26:16.408 15:27:14 -- nvmf/common.sh@296 -- # x722=() 00:26:16.408 15:27:14 -- nvmf/common.sh@296 -- # local -ga x722 00:26:16.408 15:27:14 -- nvmf/common.sh@297 -- # mlx=() 00:26:16.408 15:27:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:16.408 15:27:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:16.408 15:27:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:16.408 15:27:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:16.408 15:27:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:16.408 15:27:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:16.408 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:16.408 15:27:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:16.408 15:27:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:16.408 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:16.408 15:27:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:16.408 15:27:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:16.408 15:27:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:16.408 15:27:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:16.408 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:16.408 15:27:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:16.408 15:27:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:16.408 15:27:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:16.408 15:27:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:16.408 15:27:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:16.408 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:16.408 15:27:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:16.408 15:27:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:16.408 15:27:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:16.408 15:27:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:16.408 15:27:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:16.408 15:27:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:16.408 15:27:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:16.408 15:27:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:16.408 15:27:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:16.408 15:27:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:16.408 15:27:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:16.408 15:27:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:16.408 15:27:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:16.408 15:27:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:16.408 15:27:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:16.408 15:27:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:16.408 15:27:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:16.408 15:27:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:16.408 15:27:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:16.408 15:27:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:16.408 15:27:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:16.408 15:27:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:16.408 15:27:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:16.408 15:27:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:16.408 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:16.408 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:26:16.408 00:26:16.408 --- 10.0.0.2 ping statistics --- 00:26:16.408 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:16.408 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:26:16.408 15:27:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:16.408 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:16.408 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:26:16.409 00:26:16.409 --- 10.0.0.1 ping statistics --- 00:26:16.409 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:16.409 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:26:16.409 15:27:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:16.409 15:27:14 -- nvmf/common.sh@410 -- # return 0 00:26:16.409 15:27:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:16.409 15:27:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:16.409 15:27:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:16.409 15:27:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:16.409 15:27:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:16.409 15:27:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:16.409 15:27:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:16.409 15:27:14 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:16.409 15:27:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:16.409 15:27:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:16.409 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:16.409 15:27:14 -- nvmf/common.sh@469 -- # nvmfpid=2870120 00:26:16.409 15:27:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:16.409 15:27:14 -- nvmf/common.sh@470 -- # waitforlisten 2870120 00:26:16.409 15:27:14 -- common/autotest_common.sh@829 -- # '[' -z 2870120 ']' 00:26:16.409 15:27:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:16.409 15:27:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:16.409 15:27:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:16.409 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:16.409 15:27:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:16.409 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:16.409 [2024-11-19 15:27:14.908765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:16.409 [2024-11-19 15:27:14.908840] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:16.409 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.667 [2024-11-19 15:27:14.975368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.667 [2024-11-19 15:27:15.086460] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:16.667 [2024-11-19 15:27:15.086612] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:16.667 [2024-11-19 15:27:15.086639] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:16.667 [2024-11-19 15:27:15.086651] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:16.667 [2024-11-19 15:27:15.086728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:17.602 15:27:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:17.602 15:27:15 -- common/autotest_common.sh@862 -- # return 0 00:26:17.602 15:27:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:17.602 15:27:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 15:27:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:17.602 15:27:15 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:17.602 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 [2024-11-19 15:27:15.942793] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:17.602 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.602 15:27:15 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:17.602 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 [2024-11-19 15:27:15.950955] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:17.602 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.602 15:27:15 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:17.602 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 null0 00:26:17.602 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.602 15:27:15 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:17.602 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 null1 00:26:17.602 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.602 15:27:15 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:17.602 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.602 15:27:15 -- host/discovery.sh@45 -- # hostpid=2870279 00:26:17.602 15:27:15 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:17.602 15:27:15 -- host/discovery.sh@46 -- # waitforlisten 2870279 /tmp/host.sock 00:26:17.602 15:27:15 -- common/autotest_common.sh@829 -- # '[' -z 2870279 ']' 00:26:17.602 15:27:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:17.602 15:27:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:17.602 15:27:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:17.602 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:17.602 15:27:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:17.602 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:17.602 [2024-11-19 15:27:16.020054] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:17.602 [2024-11-19 15:27:16.020134] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2870279 ] 00:26:17.602 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.602 [2024-11-19 15:27:16.080680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:17.861 [2024-11-19 15:27:16.198555] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:17.861 [2024-11-19 15:27:16.198755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:18.795 15:27:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:18.795 15:27:17 -- common/autotest_common.sh@862 -- # return 0 00:26:18.795 15:27:17 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:18.795 15:27:17 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@72 -- # notify_id=0 00:26:18.795 15:27:17 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # sort 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # xargs 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:18.795 15:27:17 -- host/discovery.sh@79 -- # get_bdev_list 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # sort 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # xargs 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:18.795 15:27:17 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # sort 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # xargs 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:18.795 15:27:17 -- host/discovery.sh@83 -- # get_bdev_list 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # sort 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # xargs 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:18.795 15:27:17 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.795 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.795 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # sort 00:26:18.795 15:27:17 -- host/discovery.sh@59 -- # xargs 00:26:18.795 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.795 15:27:17 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:18.795 15:27:17 -- host/discovery.sh@87 -- # get_bdev_list 00:26:18.795 15:27:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.796 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # sort 00:26:18.796 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # xargs 00:26:18.796 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.796 15:27:17 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:18.796 15:27:17 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:18.796 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.796 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.796 [2024-11-19 15:27:17.306702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:18.796 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.796 15:27:17 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:18.796 15:27:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.796 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.796 15:27:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.796 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.796 15:27:17 -- host/discovery.sh@59 -- # sort 00:26:18.796 15:27:17 -- host/discovery.sh@59 -- # xargs 00:26:18.796 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.796 15:27:17 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:18.796 15:27:17 -- host/discovery.sh@93 -- # get_bdev_list 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.796 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # sort 00:26:18.796 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:18.796 15:27:17 -- host/discovery.sh@55 -- # xargs 00:26:19.054 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.054 15:27:17 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:19.054 15:27:17 -- host/discovery.sh@94 -- # get_notification_count 00:26:19.054 15:27:17 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:19.054 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.054 15:27:17 -- host/discovery.sh@74 -- # jq '. | length' 00:26:19.054 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:19.054 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.054 15:27:17 -- host/discovery.sh@74 -- # notification_count=0 00:26:19.054 15:27:17 -- host/discovery.sh@75 -- # notify_id=0 00:26:19.054 15:27:17 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:19.054 15:27:17 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:19.054 15:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.054 15:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:19.054 15:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.054 15:27:17 -- host/discovery.sh@100 -- # sleep 1 00:26:19.619 [2024-11-19 15:27:18.041847] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:19.619 [2024-11-19 15:27:18.041881] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:19.619 [2024-11-19 15:27:18.041908] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:19.619 [2024-11-19 15:27:18.128226] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:19.877 [2024-11-19 15:27:18.185235] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:19.877 [2024-11-19 15:27:18.185263] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:20.135 15:27:18 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:20.135 15:27:18 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.135 15:27:18 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.135 15:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 15:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 15:27:18 -- host/discovery.sh@59 -- # sort 00:26:20.135 15:27:18 -- host/discovery.sh@59 -- # xargs 00:26:20.135 15:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 15:27:18 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:20.135 15:27:18 -- host/discovery.sh@102 -- # get_bdev_list 00:26:20.135 15:27:18 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.135 15:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.135 15:27:18 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.135 15:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:20.135 15:27:18 -- host/discovery.sh@55 -- # sort 00:26:20.135 15:27:18 -- host/discovery.sh@55 -- # xargs 00:26:20.135 15:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.135 15:27:18 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:20.135 15:27:18 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:20.135 15:27:18 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:20.135 15:27:18 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:20.136 15:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.136 15:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:20.136 15:27:18 -- host/discovery.sh@63 -- # sort -n 00:26:20.136 15:27:18 -- host/discovery.sh@63 -- # xargs 00:26:20.136 15:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.136 15:27:18 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:20.136 15:27:18 -- host/discovery.sh@104 -- # get_notification_count 00:26:20.136 15:27:18 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:20.136 15:27:18 -- host/discovery.sh@74 -- # jq '. | length' 00:26:20.136 15:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.136 15:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:20.136 15:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.136 15:27:18 -- host/discovery.sh@74 -- # notification_count=1 00:26:20.136 15:27:18 -- host/discovery.sh@75 -- # notify_id=1 00:26:20.136 15:27:18 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:20.136 15:27:18 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:20.136 15:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.136 15:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:20.136 15:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.136 15:27:18 -- host/discovery.sh@109 -- # sleep 1 00:26:21.070 15:27:19 -- host/discovery.sh@110 -- # get_bdev_list 00:26:21.070 15:27:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.070 15:27:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.070 15:27:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 15:27:19 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 15:27:19 -- host/discovery.sh@55 -- # sort 00:26:21.070 15:27:19 -- host/discovery.sh@55 -- # xargs 00:26:21.330 15:27:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.330 15:27:19 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:21.330 15:27:19 -- host/discovery.sh@111 -- # get_notification_count 00:26:21.330 15:27:19 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:21.330 15:27:19 -- host/discovery.sh@74 -- # jq '. | length' 00:26:21.330 15:27:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.330 15:27:19 -- common/autotest_common.sh@10 -- # set +x 00:26:21.330 15:27:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.330 15:27:19 -- host/discovery.sh@74 -- # notification_count=1 00:26:21.330 15:27:19 -- host/discovery.sh@75 -- # notify_id=2 00:26:21.330 15:27:19 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:21.330 15:27:19 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:21.330 15:27:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.330 15:27:19 -- common/autotest_common.sh@10 -- # set +x 00:26:21.330 [2024-11-19 15:27:19.709954] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:21.330 [2024-11-19 15:27:19.710299] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:21.330 [2024-11-19 15:27:19.710337] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:21.330 15:27:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.330 15:27:19 -- host/discovery.sh@117 -- # sleep 1 00:26:21.330 [2024-11-19 15:27:19.837750] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:21.588 [2024-11-19 15:27:20.140112] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:21.588 [2024-11-19 15:27:20.140159] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:21.588 [2024-11-19 15:27:20.140170] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:22.522 15:27:20 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:22.522 15:27:20 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.522 15:27:20 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.522 15:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.522 15:27:20 -- common/autotest_common.sh@10 -- # set +x 00:26:22.522 15:27:20 -- host/discovery.sh@59 -- # sort 00:26:22.522 15:27:20 -- host/discovery.sh@59 -- # xargs 00:26:22.522 15:27:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@119 -- # get_bdev_list 00:26:22.522 15:27:20 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.522 15:27:20 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.522 15:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.522 15:27:20 -- host/discovery.sh@55 -- # sort 00:26:22.522 15:27:20 -- common/autotest_common.sh@10 -- # set +x 00:26:22.522 15:27:20 -- host/discovery.sh@55 -- # xargs 00:26:22.522 15:27:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:22.522 15:27:20 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:22.522 15:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.522 15:27:20 -- common/autotest_common.sh@10 -- # set +x 00:26:22.522 15:27:20 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:22.522 15:27:20 -- host/discovery.sh@63 -- # sort -n 00:26:22.522 15:27:20 -- host/discovery.sh@63 -- # xargs 00:26:22.522 15:27:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@121 -- # get_notification_count 00:26:22.522 15:27:20 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:22.522 15:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.522 15:27:20 -- common/autotest_common.sh@10 -- # set +x 00:26:22.522 15:27:20 -- host/discovery.sh@74 -- # jq '. | length' 00:26:22.522 15:27:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@74 -- # notification_count=0 00:26:22.522 15:27:20 -- host/discovery.sh@75 -- # notify_id=2 00:26:22.522 15:27:20 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:22.522 15:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.522 15:27:20 -- common/autotest_common.sh@10 -- # set +x 00:26:22.522 [2024-11-19 15:27:20.885599] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:22.522 [2024-11-19 15:27:20.885637] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.522 15:27:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.522 15:27:20 -- host/discovery.sh@127 -- # sleep 1 00:26:22.522 [2024-11-19 15:27:20.895152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.522 [2024-11-19 15:27:20.895189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.522 [2024-11-19 15:27:20.895208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.522 [2024-11-19 15:27:20.895232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.522 [2024-11-19 15:27:20.895264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.522 [2024-11-19 15:27:20.895278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.522 [2024-11-19 15:27:20.895291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:22.522 [2024-11-19 15:27:20.895304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:22.522 [2024-11-19 15:27:20.895317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.522 [2024-11-19 15:27:20.905156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.522 [2024-11-19 15:27:20.915203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.522 [2024-11-19 15:27:20.915410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.915563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.915591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.522 [2024-11-19 15:27:20.915609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.522 [2024-11-19 15:27:20.915634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.522 [2024-11-19 15:27:20.915657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.522 [2024-11-19 15:27:20.915681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.522 [2024-11-19 15:27:20.915709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.522 [2024-11-19 15:27:20.915752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.522 [2024-11-19 15:27:20.925284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.522 [2024-11-19 15:27:20.925472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.925649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.925674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.522 [2024-11-19 15:27:20.925698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.522 [2024-11-19 15:27:20.925728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.522 [2024-11-19 15:27:20.925749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.522 [2024-11-19 15:27:20.925763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.522 [2024-11-19 15:27:20.925776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.522 [2024-11-19 15:27:20.925795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.522 [2024-11-19 15:27:20.935364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.522 [2024-11-19 15:27:20.935524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.935699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.935743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.522 [2024-11-19 15:27:20.935765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.522 [2024-11-19 15:27:20.935788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.522 [2024-11-19 15:27:20.935809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.522 [2024-11-19 15:27:20.935822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.522 [2024-11-19 15:27:20.935835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.522 [2024-11-19 15:27:20.935854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.522 [2024-11-19 15:27:20.945444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.522 [2024-11-19 15:27:20.945612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.945737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-11-19 15:27:20.945765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.523 [2024-11-19 15:27:20.945780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.523 [2024-11-19 15:27:20.945802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.523 [2024-11-19 15:27:20.945822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.523 [2024-11-19 15:27:20.945836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.523 [2024-11-19 15:27:20.945848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.523 [2024-11-19 15:27:20.945866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.523 [2024-11-19 15:27:20.955521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.523 [2024-11-19 15:27:20.955696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-11-19 15:27:20.955866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-11-19 15:27:20.955892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.523 [2024-11-19 15:27:20.955907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.523 [2024-11-19 15:27:20.955928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.523 [2024-11-19 15:27:20.955979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.523 [2024-11-19 15:27:20.955999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.523 [2024-11-19 15:27:20.956013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.523 [2024-11-19 15:27:20.956046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.523 [2024-11-19 15:27:20.965599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:22.523 [2024-11-19 15:27:20.965806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-11-19 15:27:20.965897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-11-19 15:27:20.965923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d2810 with addr=10.0.0.2, port=4420 00:26:22.523 [2024-11-19 15:27:20.965938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d2810 is same with the state(5) to be set 00:26:22.523 [2024-11-19 15:27:20.965965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d2810 (9): Bad file descriptor 00:26:22.523 [2024-11-19 15:27:20.965998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:22.523 [2024-11-19 15:27:20.966014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:22.523 [2024-11-19 15:27:20.966027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:22.523 [2024-11-19 15:27:20.966045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:22.523 [2024-11-19 15:27:20.972037] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:22.523 [2024-11-19 15:27:20.972070] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:23.455 15:27:21 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:23.455 15:27:21 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:23.455 15:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.455 15:27:21 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:23.455 15:27:21 -- common/autotest_common.sh@10 -- # set +x 00:26:23.455 15:27:21 -- host/discovery.sh@59 -- # sort 00:26:23.455 15:27:21 -- host/discovery.sh@59 -- # xargs 00:26:23.455 15:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.455 15:27:21 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:23.455 15:27:21 -- host/discovery.sh@129 -- # get_bdev_list 00:26:23.455 15:27:21 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.455 15:27:21 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.455 15:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.455 15:27:21 -- host/discovery.sh@55 -- # sort 00:26:23.455 15:27:21 -- common/autotest_common.sh@10 -- # set +x 00:26:23.455 15:27:21 -- host/discovery.sh@55 -- # xargs 00:26:23.455 15:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.455 15:27:21 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.455 15:27:21 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:23.455 15:27:21 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:23.455 15:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.455 15:27:21 -- common/autotest_common.sh@10 -- # set +x 00:26:23.455 15:27:21 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:23.455 15:27:21 -- host/discovery.sh@63 -- # sort -n 00:26:23.455 15:27:21 -- host/discovery.sh@63 -- # xargs 00:26:23.455 15:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.455 15:27:22 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:23.455 15:27:22 -- host/discovery.sh@131 -- # get_notification_count 00:26:23.712 15:27:22 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:23.712 15:27:22 -- host/discovery.sh@74 -- # jq '. | length' 00:26:23.712 15:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.712 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:26:23.712 15:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.712 15:27:22 -- host/discovery.sh@74 -- # notification_count=0 00:26:23.712 15:27:22 -- host/discovery.sh@75 -- # notify_id=2 00:26:23.712 15:27:22 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:23.712 15:27:22 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:23.712 15:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.712 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:26:23.712 15:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.712 15:27:22 -- host/discovery.sh@135 -- # sleep 1 00:26:24.644 15:27:23 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:24.644 15:27:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:24.644 15:27:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.644 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:24.644 15:27:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:24.644 15:27:23 -- host/discovery.sh@59 -- # sort 00:26:24.644 15:27:23 -- host/discovery.sh@59 -- # xargs 00:26:24.644 15:27:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.644 15:27:23 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:24.644 15:27:23 -- host/discovery.sh@137 -- # get_bdev_list 00:26:24.644 15:27:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.644 15:27:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:24.644 15:27:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.644 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:24.644 15:27:23 -- host/discovery.sh@55 -- # sort 00:26:24.644 15:27:23 -- host/discovery.sh@55 -- # xargs 00:26:24.644 15:27:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.644 15:27:23 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:24.644 15:27:23 -- host/discovery.sh@138 -- # get_notification_count 00:26:24.644 15:27:23 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:24.644 15:27:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.644 15:27:23 -- host/discovery.sh@74 -- # jq '. | length' 00:26:24.644 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:24.644 15:27:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.644 15:27:23 -- host/discovery.sh@74 -- # notification_count=2 00:26:24.644 15:27:23 -- host/discovery.sh@75 -- # notify_id=4 00:26:24.644 15:27:23 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:24.644 15:27:23 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:24.644 15:27:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.644 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:26:26.018 [2024-11-19 15:27:24.248842] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:26.018 [2024-11-19 15:27:24.248866] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:26.018 [2024-11-19 15:27:24.248887] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:26.018 [2024-11-19 15:27:24.335192] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:26.276 [2024-11-19 15:27:24.603865] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:26.276 [2024-11-19 15:27:24.603898] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:26.276 15:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.276 15:27:24 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.276 15:27:24 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.276 15:27:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.276 15:27:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.276 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.276 15:27:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.276 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.276 15:27:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.276 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.276 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.276 request: 00:26:26.276 { 00:26:26.276 "name": "nvme", 00:26:26.276 "trtype": "tcp", 00:26:26.276 "traddr": "10.0.0.2", 00:26:26.276 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:26.276 "adrfam": "ipv4", 00:26:26.277 "trsvcid": "8009", 00:26:26.277 "wait_for_attach": true, 00:26:26.277 "method": "bdev_nvme_start_discovery", 00:26:26.277 "req_id": 1 00:26:26.277 } 00:26:26.277 Got JSON-RPC error response 00:26:26.277 response: 00:26:26.277 { 00:26:26.277 "code": -17, 00:26:26.277 "message": "File exists" 00:26:26.277 } 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:26.277 15:27:24 -- common/autotest_common.sh@653 -- # es=1 00:26:26.277 15:27:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:26.277 15:27:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:26.277 15:27:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:26.277 15:27:24 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # sort 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # xargs 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:26.277 15:27:24 -- host/discovery.sh@147 -- # get_bdev_list 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # sort 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # xargs 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.277 15:27:24 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.277 15:27:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.277 15:27:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.277 15:27:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.277 request: 00:26:26.277 { 00:26:26.277 "name": "nvme_second", 00:26:26.277 "trtype": "tcp", 00:26:26.277 "traddr": "10.0.0.2", 00:26:26.277 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:26.277 "adrfam": "ipv4", 00:26:26.277 "trsvcid": "8009", 00:26:26.277 "wait_for_attach": true, 00:26:26.277 "method": "bdev_nvme_start_discovery", 00:26:26.277 "req_id": 1 00:26:26.277 } 00:26:26.277 Got JSON-RPC error response 00:26:26.277 response: 00:26:26.277 { 00:26:26.277 "code": -17, 00:26:26.277 "message": "File exists" 00:26:26.277 } 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:26.277 15:27:24 -- common/autotest_common.sh@653 -- # es=1 00:26:26.277 15:27:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:26.277 15:27:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:26.277 15:27:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:26.277 15:27:24 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # sort 00:26:26.277 15:27:24 -- host/discovery.sh@67 -- # xargs 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:26.277 15:27:24 -- host/discovery.sh@153 -- # get_bdev_list 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # sort 00:26:26.277 15:27:24 -- host/discovery.sh@55 -- # xargs 00:26:26.277 15:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.277 15:27:24 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.277 15:27:24 -- common/autotest_common.sh@650 -- # local es=0 00:26:26.277 15:27:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.277 15:27:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:26.277 15:27:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:26.277 15:27:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:26.277 15:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.277 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:27.651 [2024-11-19 15:27:25.796128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:27.651 [2024-11-19 15:27:25.796313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:27.651 [2024-11-19 15:27:25.796343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5de0a0 with addr=10.0.0.2, port=8010 00:26:27.651 [2024-11-19 15:27:25.796365] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:27.651 [2024-11-19 15:27:25.796381] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:27.651 [2024-11-19 15:27:25.796393] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:28.622 [2024-11-19 15:27:26.798549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.622 [2024-11-19 15:27:26.798707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:28.622 [2024-11-19 15:27:26.798752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c2d30 with addr=10.0.0.2, port=8010 00:26:28.622 [2024-11-19 15:27:26.798772] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:28.622 [2024-11-19 15:27:26.798785] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:28.622 [2024-11-19 15:27:26.798796] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:29.583 [2024-11-19 15:27:27.800858] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:29.583 request: 00:26:29.583 { 00:26:29.583 "name": "nvme_second", 00:26:29.583 "trtype": "tcp", 00:26:29.583 "traddr": "10.0.0.2", 00:26:29.583 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:29.583 "adrfam": "ipv4", 00:26:29.583 "trsvcid": "8010", 00:26:29.583 "attach_timeout_ms": 3000, 00:26:29.583 "method": "bdev_nvme_start_discovery", 00:26:29.583 "req_id": 1 00:26:29.583 } 00:26:29.583 Got JSON-RPC error response 00:26:29.583 response: 00:26:29.583 { 00:26:29.583 "code": -110, 00:26:29.583 "message": "Connection timed out" 00:26:29.583 } 00:26:29.583 15:27:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:29.583 15:27:27 -- common/autotest_common.sh@653 -- # es=1 00:26:29.583 15:27:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:29.583 15:27:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:29.583 15:27:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:29.583 15:27:27 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:29.583 15:27:27 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:29.583 15:27:27 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:29.583 15:27:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.583 15:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:29.583 15:27:27 -- host/discovery.sh@67 -- # sort 00:26:29.583 15:27:27 -- host/discovery.sh@67 -- # xargs 00:26:29.583 15:27:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.583 15:27:27 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:29.583 15:27:27 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:29.583 15:27:27 -- host/discovery.sh@162 -- # kill 2870279 00:26:29.583 15:27:27 -- host/discovery.sh@163 -- # nvmftestfini 00:26:29.583 15:27:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:29.583 15:27:27 -- nvmf/common.sh@116 -- # sync 00:26:29.583 15:27:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:29.583 15:27:27 -- nvmf/common.sh@119 -- # set +e 00:26:29.583 15:27:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:29.583 15:27:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:29.583 rmmod nvme_tcp 00:26:29.583 rmmod nvme_fabrics 00:26:29.583 rmmod nvme_keyring 00:26:29.583 15:27:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:29.583 15:27:27 -- nvmf/common.sh@123 -- # set -e 00:26:29.583 15:27:27 -- nvmf/common.sh@124 -- # return 0 00:26:29.583 15:27:27 -- nvmf/common.sh@477 -- # '[' -n 2870120 ']' 00:26:29.583 15:27:27 -- nvmf/common.sh@478 -- # killprocess 2870120 00:26:29.583 15:27:27 -- common/autotest_common.sh@936 -- # '[' -z 2870120 ']' 00:26:29.583 15:27:27 -- common/autotest_common.sh@940 -- # kill -0 2870120 00:26:29.583 15:27:27 -- common/autotest_common.sh@941 -- # uname 00:26:29.583 15:27:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:29.583 15:27:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2870120 00:26:29.583 15:27:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:29.583 15:27:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:29.583 15:27:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2870120' 00:26:29.583 killing process with pid 2870120 00:26:29.583 15:27:27 -- common/autotest_common.sh@955 -- # kill 2870120 00:26:29.583 15:27:27 -- common/autotest_common.sh@960 -- # wait 2870120 00:26:29.843 15:27:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:29.843 15:27:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:29.843 15:27:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:29.843 15:27:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:29.843 15:27:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:29.843 15:27:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:29.843 15:27:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:29.843 15:27:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:31.750 15:27:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:31.750 00:26:31.750 real 0m17.763s 00:26:31.750 user 0m27.506s 00:26:31.750 sys 0m3.011s 00:26:31.750 15:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:31.750 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:31.750 ************************************ 00:26:31.750 END TEST nvmf_discovery 00:26:31.750 ************************************ 00:26:31.750 15:27:30 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:31.750 15:27:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:31.750 15:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:31.750 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:31.750 ************************************ 00:26:31.750 START TEST nvmf_discovery_remove_ifc 00:26:31.750 ************************************ 00:26:31.750 15:27:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:32.011 * Looking for test storage... 00:26:32.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:32.011 15:27:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:32.011 15:27:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:32.011 15:27:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:32.011 15:27:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:32.011 15:27:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:32.011 15:27:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:32.011 15:27:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:32.011 15:27:30 -- scripts/common.sh@335 -- # IFS=.-: 00:26:32.011 15:27:30 -- scripts/common.sh@335 -- # read -ra ver1 00:26:32.011 15:27:30 -- scripts/common.sh@336 -- # IFS=.-: 00:26:32.011 15:27:30 -- scripts/common.sh@336 -- # read -ra ver2 00:26:32.011 15:27:30 -- scripts/common.sh@337 -- # local 'op=<' 00:26:32.011 15:27:30 -- scripts/common.sh@339 -- # ver1_l=2 00:26:32.011 15:27:30 -- scripts/common.sh@340 -- # ver2_l=1 00:26:32.011 15:27:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:32.011 15:27:30 -- scripts/common.sh@343 -- # case "$op" in 00:26:32.011 15:27:30 -- scripts/common.sh@344 -- # : 1 00:26:32.011 15:27:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:32.011 15:27:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:32.011 15:27:30 -- scripts/common.sh@364 -- # decimal 1 00:26:32.011 15:27:30 -- scripts/common.sh@352 -- # local d=1 00:26:32.011 15:27:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:32.011 15:27:30 -- scripts/common.sh@354 -- # echo 1 00:26:32.011 15:27:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:32.011 15:27:30 -- scripts/common.sh@365 -- # decimal 2 00:26:32.011 15:27:30 -- scripts/common.sh@352 -- # local d=2 00:26:32.011 15:27:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:32.011 15:27:30 -- scripts/common.sh@354 -- # echo 2 00:26:32.011 15:27:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:32.011 15:27:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:32.011 15:27:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:32.011 15:27:30 -- scripts/common.sh@367 -- # return 0 00:26:32.011 15:27:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:32.011 15:27:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:32.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.011 --rc genhtml_branch_coverage=1 00:26:32.011 --rc genhtml_function_coverage=1 00:26:32.011 --rc genhtml_legend=1 00:26:32.011 --rc geninfo_all_blocks=1 00:26:32.011 --rc geninfo_unexecuted_blocks=1 00:26:32.011 00:26:32.011 ' 00:26:32.011 15:27:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:32.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.011 --rc genhtml_branch_coverage=1 00:26:32.011 --rc genhtml_function_coverage=1 00:26:32.011 --rc genhtml_legend=1 00:26:32.011 --rc geninfo_all_blocks=1 00:26:32.011 --rc geninfo_unexecuted_blocks=1 00:26:32.011 00:26:32.011 ' 00:26:32.011 15:27:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:32.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.011 --rc genhtml_branch_coverage=1 00:26:32.011 --rc genhtml_function_coverage=1 00:26:32.011 --rc genhtml_legend=1 00:26:32.011 --rc geninfo_all_blocks=1 00:26:32.011 --rc geninfo_unexecuted_blocks=1 00:26:32.011 00:26:32.011 ' 00:26:32.011 15:27:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:32.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:32.011 --rc genhtml_branch_coverage=1 00:26:32.011 --rc genhtml_function_coverage=1 00:26:32.011 --rc genhtml_legend=1 00:26:32.011 --rc geninfo_all_blocks=1 00:26:32.011 --rc geninfo_unexecuted_blocks=1 00:26:32.011 00:26:32.011 ' 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:32.011 15:27:30 -- nvmf/common.sh@7 -- # uname -s 00:26:32.011 15:27:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:32.011 15:27:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:32.011 15:27:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:32.011 15:27:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:32.011 15:27:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:32.011 15:27:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:32.011 15:27:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:32.011 15:27:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:32.011 15:27:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:32.011 15:27:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:32.011 15:27:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.011 15:27:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.011 15:27:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:32.011 15:27:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:32.011 15:27:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:32.011 15:27:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:32.011 15:27:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:32.011 15:27:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:32.011 15:27:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:32.011 15:27:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.011 15:27:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.011 15:27:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.011 15:27:30 -- paths/export.sh@5 -- # export PATH 00:26:32.011 15:27:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.011 15:27:30 -- nvmf/common.sh@46 -- # : 0 00:26:32.011 15:27:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:32.011 15:27:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:32.011 15:27:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:32.011 15:27:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:32.011 15:27:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:32.011 15:27:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:32.011 15:27:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:32.011 15:27:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:32.011 15:27:30 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:32.011 15:27:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:32.012 15:27:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:32.012 15:27:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:32.012 15:27:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:32.012 15:27:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:32.012 15:27:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:32.012 15:27:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:32.012 15:27:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:32.012 15:27:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:32.012 15:27:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:32.012 15:27:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:32.012 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:33.917 15:27:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:33.917 15:27:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:33.917 15:27:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:33.917 15:27:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:33.917 15:27:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:33.917 15:27:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:33.917 15:27:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:33.917 15:27:32 -- nvmf/common.sh@294 -- # net_devs=() 00:26:33.917 15:27:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:33.917 15:27:32 -- nvmf/common.sh@295 -- # e810=() 00:26:33.917 15:27:32 -- nvmf/common.sh@295 -- # local -ga e810 00:26:33.917 15:27:32 -- nvmf/common.sh@296 -- # x722=() 00:26:33.917 15:27:32 -- nvmf/common.sh@296 -- # local -ga x722 00:26:33.917 15:27:32 -- nvmf/common.sh@297 -- # mlx=() 00:26:33.917 15:27:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:33.917 15:27:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:33.917 15:27:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:33.917 15:27:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:33.917 15:27:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:33.917 15:27:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:33.917 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:33.917 15:27:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:33.917 15:27:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:33.917 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:33.917 15:27:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:33.917 15:27:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:33.917 15:27:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:33.917 15:27:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:33.917 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:33.917 15:27:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:33.917 15:27:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:33.917 15:27:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:33.917 15:27:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:33.917 15:27:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:33.917 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:33.917 15:27:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:33.917 15:27:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:33.917 15:27:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:33.917 15:27:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:33.917 15:27:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:33.917 15:27:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:33.917 15:27:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:33.917 15:27:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:33.917 15:27:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:33.917 15:27:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:33.917 15:27:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:33.917 15:27:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:33.917 15:27:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:33.917 15:27:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:33.917 15:27:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:33.917 15:27:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:33.917 15:27:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:34.176 15:27:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:34.176 15:27:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:34.176 15:27:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:34.176 15:27:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:34.176 15:27:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:34.176 15:27:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:34.176 15:27:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:34.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:34.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:26:34.176 00:26:34.176 --- 10.0.0.2 ping statistics --- 00:26:34.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:34.176 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:26:34.176 15:27:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:34.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:34.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:26:34.176 00:26:34.176 --- 10.0.0.1 ping statistics --- 00:26:34.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:34.176 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:26:34.176 15:27:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:34.176 15:27:32 -- nvmf/common.sh@410 -- # return 0 00:26:34.176 15:27:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:34.176 15:27:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:34.176 15:27:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:34.176 15:27:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:34.176 15:27:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:34.176 15:27:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:34.176 15:27:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:34.176 15:27:32 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:34.176 15:27:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:34.176 15:27:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:34.176 15:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:34.176 15:27:32 -- nvmf/common.sh@469 -- # nvmfpid=2873882 00:26:34.176 15:27:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:34.176 15:27:32 -- nvmf/common.sh@470 -- # waitforlisten 2873882 00:26:34.176 15:27:32 -- common/autotest_common.sh@829 -- # '[' -z 2873882 ']' 00:26:34.176 15:27:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:34.176 15:27:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:34.176 15:27:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:34.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:34.176 15:27:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:34.176 15:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:34.176 [2024-11-19 15:27:32.678648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:34.176 [2024-11-19 15:27:32.678741] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:34.176 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.435 [2024-11-19 15:27:32.748158] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:34.435 [2024-11-19 15:27:32.860816] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:34.435 [2024-11-19 15:27:32.860984] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:34.435 [2024-11-19 15:27:32.861014] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:34.435 [2024-11-19 15:27:32.861030] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:34.435 [2024-11-19 15:27:32.861072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:35.369 15:27:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:35.369 15:27:33 -- common/autotest_common.sh@862 -- # return 0 00:26:35.369 15:27:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:35.369 15:27:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:35.369 15:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:35.369 15:27:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:35.369 15:27:33 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:35.369 15:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.369 15:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:35.369 [2024-11-19 15:27:33.656234] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:35.369 [2024-11-19 15:27:33.664400] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:35.369 null0 00:26:35.369 [2024-11-19 15:27:33.696374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:35.369 15:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.369 15:27:33 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2874040 00:26:35.369 15:27:33 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:35.369 15:27:33 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2874040 /tmp/host.sock 00:26:35.369 15:27:33 -- common/autotest_common.sh@829 -- # '[' -z 2874040 ']' 00:26:35.369 15:27:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:35.369 15:27:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:35.369 15:27:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:35.369 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:35.369 15:27:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:35.369 15:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:35.369 [2024-11-19 15:27:33.757087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:35.369 [2024-11-19 15:27:33.757150] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2874040 ] 00:26:35.369 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.369 [2024-11-19 15:27:33.819353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:35.628 [2024-11-19 15:27:33.933476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:35.628 [2024-11-19 15:27:33.933699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:35.628 15:27:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:35.628 15:27:33 -- common/autotest_common.sh@862 -- # return 0 00:26:35.628 15:27:33 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:35.628 15:27:33 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:35.628 15:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.628 15:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:35.628 15:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.628 15:27:33 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:35.628 15:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.628 15:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:35.628 15:27:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.628 15:27:34 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:35.628 15:27:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.628 15:27:34 -- common/autotest_common.sh@10 -- # set +x 00:26:37.001 [2024-11-19 15:27:35.135395] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:37.001 [2024-11-19 15:27:35.135429] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:37.001 [2024-11-19 15:27:35.135456] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:37.001 [2024-11-19 15:27:35.263888] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:37.001 [2024-11-19 15:27:35.365425] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:37.001 [2024-11-19 15:27:35.365481] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:37.001 [2024-11-19 15:27:35.365523] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:37.001 [2024-11-19 15:27:35.365549] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:37.001 [2024-11-19 15:27:35.365576] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:37.001 15:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.001 15:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.001 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.001 [2024-11-19 15:27:35.372331] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1f6bd40 was disconnected and freed. delete nvme_qpair. 00:26:37.001 15:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.001 15:27:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.001 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.001 15:27:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.001 15:27:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:37.935 15:27:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.935 15:27:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.935 15:27:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.935 15:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.935 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:37.935 15:27:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.935 15:27:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.193 15:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.193 15:27:36 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.193 15:27:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.129 15:27:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.129 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.129 15:27:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:39.129 15:27:37 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:40.063 15:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.063 15:27:38 -- common/autotest_common.sh@10 -- # set +x 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:40.063 15:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:40.063 15:27:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.437 15:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.437 15:27:39 -- common/autotest_common.sh@10 -- # set +x 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.437 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:41.437 15:27:39 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.372 15:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.372 15:27:40 -- common/autotest_common.sh@10 -- # set +x 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.372 15:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.372 15:27:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.372 [2024-11-19 15:27:40.806649] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:42.372 [2024-11-19 15:27:40.806721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.372 [2024-11-19 15:27:40.806761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.372 [2024-11-19 15:27:40.806779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.372 [2024-11-19 15:27:40.806793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.372 [2024-11-19 15:27:40.806806] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.372 [2024-11-19 15:27:40.806819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.372 [2024-11-19 15:27:40.806832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.372 [2024-11-19 15:27:40.806845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.372 [2024-11-19 15:27:40.806859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.373 [2024-11-19 15:27:40.806872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.373 [2024-11-19 15:27:40.806885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f32430 is same with the state(5) to be set 00:26:42.373 [2024-11-19 15:27:40.816668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f32430 (9): Bad file descriptor 00:26:42.373 [2024-11-19 15:27:40.826723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:43.308 15:27:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.308 15:27:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.308 15:27:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.308 15:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.308 15:27:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.308 15:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:43.308 15:27:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.308 [2024-11-19 15:27:41.864725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:44.684 [2024-11-19 15:27:42.888743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:44.684 [2024-11-19 15:27:42.888841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f32430 with addr=10.0.0.2, port=4420 00:26:44.684 [2024-11-19 15:27:42.888865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f32430 is same with the state(5) to be set 00:26:44.684 [2024-11-19 15:27:42.888900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:44.684 [2024-11-19 15:27:42.888916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:44.684 [2024-11-19 15:27:42.888928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:44.684 [2024-11-19 15:27:42.888942] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:44.684 [2024-11-19 15:27:42.889371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f32430 (9): Bad file descriptor 00:26:44.684 [2024-11-19 15:27:42.889410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:44.684 [2024-11-19 15:27:42.889453] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:44.684 [2024-11-19 15:27:42.889502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:44.684 [2024-11-19 15:27:42.889522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.684 [2024-11-19 15:27:42.889540] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:44.684 [2024-11-19 15:27:42.889554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.684 [2024-11-19 15:27:42.889567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:44.684 [2024-11-19 15:27:42.889580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.684 [2024-11-19 15:27:42.889593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:44.684 [2024-11-19 15:27:42.889606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.684 [2024-11-19 15:27:42.889620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:44.684 [2024-11-19 15:27:42.889633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.684 [2024-11-19 15:27:42.889646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:44.684 [2024-11-19 15:27:42.889898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f32840 (9): Bad file descriptor 00:26:44.684 [2024-11-19 15:27:42.890918] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:44.684 [2024-11-19 15:27:42.890941] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:44.684 15:27:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:44.684 15:27:42 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:44.684 15:27:42 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:45.618 15:27:43 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.618 15:27:43 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.618 15:27:43 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.618 15:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.618 15:27:43 -- common/autotest_common.sh@10 -- # set +x 00:26:45.619 15:27:43 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.619 15:27:43 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.619 15:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.619 15:27:43 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:45.619 15:27:43 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:45.619 15:27:43 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.619 15:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.619 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.619 15:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:45.619 15:27:44 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:46.553 [2024-11-19 15:27:44.940407] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:46.553 [2024-11-19 15:27:44.940436] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:46.553 [2024-11-19 15:27:44.940460] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:46.553 [2024-11-19 15:27:45.068896] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.811 15:27:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.811 15:27:45 -- common/autotest_common.sh@10 -- # set +x 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.811 15:27:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:46.811 15:27:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:46.811 [2024-11-19 15:27:45.169928] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:46.811 [2024-11-19 15:27:45.169994] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:46.811 [2024-11-19 15:27:45.170031] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:46.811 [2024-11-19 15:27:45.170058] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:46.811 [2024-11-19 15:27:45.170074] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:46.811 [2024-11-19 15:27:45.178612] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1f40ef0 was disconnected and freed. delete nvme_qpair. 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:47.746 15:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.746 15:27:46 -- common/autotest_common.sh@10 -- # set +x 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:47.746 15:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:47.746 15:27:46 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2874040 00:26:47.746 15:27:46 -- common/autotest_common.sh@936 -- # '[' -z 2874040 ']' 00:26:47.746 15:27:46 -- common/autotest_common.sh@940 -- # kill -0 2874040 00:26:47.746 15:27:46 -- common/autotest_common.sh@941 -- # uname 00:26:47.746 15:27:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.746 15:27:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2874040 00:26:47.746 15:27:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:47.746 15:27:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:47.746 15:27:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2874040' 00:26:47.746 killing process with pid 2874040 00:26:47.746 15:27:46 -- common/autotest_common.sh@955 -- # kill 2874040 00:26:47.746 15:27:46 -- common/autotest_common.sh@960 -- # wait 2874040 00:26:48.005 15:27:46 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:48.005 15:27:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:48.005 15:27:46 -- nvmf/common.sh@116 -- # sync 00:26:48.005 15:27:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:48.005 15:27:46 -- nvmf/common.sh@119 -- # set +e 00:26:48.005 15:27:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:48.005 15:27:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:48.005 rmmod nvme_tcp 00:26:48.005 rmmod nvme_fabrics 00:26:48.005 rmmod nvme_keyring 00:26:48.005 15:27:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:48.005 15:27:46 -- nvmf/common.sh@123 -- # set -e 00:26:48.005 15:27:46 -- nvmf/common.sh@124 -- # return 0 00:26:48.005 15:27:46 -- nvmf/common.sh@477 -- # '[' -n 2873882 ']' 00:26:48.005 15:27:46 -- nvmf/common.sh@478 -- # killprocess 2873882 00:26:48.006 15:27:46 -- common/autotest_common.sh@936 -- # '[' -z 2873882 ']' 00:26:48.006 15:27:46 -- common/autotest_common.sh@940 -- # kill -0 2873882 00:26:48.006 15:27:46 -- common/autotest_common.sh@941 -- # uname 00:26:48.006 15:27:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:48.006 15:27:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2873882 00:26:48.265 15:27:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:48.265 15:27:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:48.265 15:27:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2873882' 00:26:48.265 killing process with pid 2873882 00:26:48.265 15:27:46 -- common/autotest_common.sh@955 -- # kill 2873882 00:26:48.265 15:27:46 -- common/autotest_common.sh@960 -- # wait 2873882 00:26:48.524 15:27:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:48.524 15:27:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:48.524 15:27:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:48.524 15:27:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:48.524 15:27:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:48.524 15:27:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:48.524 15:27:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:48.524 15:27:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:50.427 15:27:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:50.427 00:26:50.427 real 0m18.620s 00:26:50.427 user 0m25.855s 00:26:50.427 sys 0m2.941s 00:26:50.427 15:27:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:50.427 15:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:50.427 ************************************ 00:26:50.427 END TEST nvmf_discovery_remove_ifc 00:26:50.427 ************************************ 00:26:50.427 15:27:48 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:50.427 15:27:48 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:50.427 15:27:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:50.427 15:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:50.427 15:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:50.427 ************************************ 00:26:50.427 START TEST nvmf_digest 00:26:50.427 ************************************ 00:26:50.427 15:27:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:50.427 * Looking for test storage... 00:26:50.427 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:50.427 15:27:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:50.427 15:27:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:50.427 15:27:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:50.688 15:27:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:50.688 15:27:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:50.688 15:27:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:50.688 15:27:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:50.688 15:27:49 -- scripts/common.sh@335 -- # IFS=.-: 00:26:50.688 15:27:49 -- scripts/common.sh@335 -- # read -ra ver1 00:26:50.688 15:27:49 -- scripts/common.sh@336 -- # IFS=.-: 00:26:50.688 15:27:49 -- scripts/common.sh@336 -- # read -ra ver2 00:26:50.688 15:27:49 -- scripts/common.sh@337 -- # local 'op=<' 00:26:50.688 15:27:49 -- scripts/common.sh@339 -- # ver1_l=2 00:26:50.688 15:27:49 -- scripts/common.sh@340 -- # ver2_l=1 00:26:50.688 15:27:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:50.688 15:27:49 -- scripts/common.sh@343 -- # case "$op" in 00:26:50.688 15:27:49 -- scripts/common.sh@344 -- # : 1 00:26:50.688 15:27:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:50.688 15:27:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:50.688 15:27:49 -- scripts/common.sh@364 -- # decimal 1 00:26:50.688 15:27:49 -- scripts/common.sh@352 -- # local d=1 00:26:50.688 15:27:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:50.688 15:27:49 -- scripts/common.sh@354 -- # echo 1 00:26:50.688 15:27:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:50.688 15:27:49 -- scripts/common.sh@365 -- # decimal 2 00:26:50.688 15:27:49 -- scripts/common.sh@352 -- # local d=2 00:26:50.688 15:27:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:50.688 15:27:49 -- scripts/common.sh@354 -- # echo 2 00:26:50.688 15:27:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:50.688 15:27:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:50.689 15:27:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:50.689 15:27:49 -- scripts/common.sh@367 -- # return 0 00:26:50.689 15:27:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:50.689 15:27:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:50.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.689 --rc genhtml_branch_coverage=1 00:26:50.689 --rc genhtml_function_coverage=1 00:26:50.689 --rc genhtml_legend=1 00:26:50.689 --rc geninfo_all_blocks=1 00:26:50.689 --rc geninfo_unexecuted_blocks=1 00:26:50.689 00:26:50.689 ' 00:26:50.689 15:27:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:50.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.689 --rc genhtml_branch_coverage=1 00:26:50.689 --rc genhtml_function_coverage=1 00:26:50.689 --rc genhtml_legend=1 00:26:50.689 --rc geninfo_all_blocks=1 00:26:50.689 --rc geninfo_unexecuted_blocks=1 00:26:50.689 00:26:50.689 ' 00:26:50.689 15:27:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:50.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.689 --rc genhtml_branch_coverage=1 00:26:50.689 --rc genhtml_function_coverage=1 00:26:50.689 --rc genhtml_legend=1 00:26:50.689 --rc geninfo_all_blocks=1 00:26:50.689 --rc geninfo_unexecuted_blocks=1 00:26:50.689 00:26:50.689 ' 00:26:50.689 15:27:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:50.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:50.689 --rc genhtml_branch_coverage=1 00:26:50.689 --rc genhtml_function_coverage=1 00:26:50.689 --rc genhtml_legend=1 00:26:50.689 --rc geninfo_all_blocks=1 00:26:50.689 --rc geninfo_unexecuted_blocks=1 00:26:50.689 00:26:50.689 ' 00:26:50.689 15:27:49 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:50.689 15:27:49 -- nvmf/common.sh@7 -- # uname -s 00:26:50.689 15:27:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:50.689 15:27:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:50.689 15:27:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:50.689 15:27:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:50.689 15:27:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:50.689 15:27:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:50.689 15:27:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:50.689 15:27:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:50.689 15:27:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:50.689 15:27:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:50.689 15:27:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.689 15:27:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:50.689 15:27:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:50.689 15:27:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:50.689 15:27:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:50.689 15:27:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:50.689 15:27:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:50.689 15:27:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:50.689 15:27:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:50.689 15:27:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.689 15:27:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.689 15:27:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.689 15:27:49 -- paths/export.sh@5 -- # export PATH 00:26:50.689 15:27:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.689 15:27:49 -- nvmf/common.sh@46 -- # : 0 00:26:50.689 15:27:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:50.689 15:27:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:50.689 15:27:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:50.689 15:27:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:50.689 15:27:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:50.689 15:27:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:50.689 15:27:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:50.689 15:27:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:50.689 15:27:49 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:50.689 15:27:49 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:50.689 15:27:49 -- host/digest.sh@16 -- # runtime=2 00:26:50.689 15:27:49 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:50.689 15:27:49 -- host/digest.sh@132 -- # nvmftestinit 00:26:50.689 15:27:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:50.689 15:27:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:50.689 15:27:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:50.689 15:27:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:50.689 15:27:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:50.689 15:27:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.689 15:27:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.689 15:27:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:50.689 15:27:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:50.689 15:27:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:50.689 15:27:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:50.689 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:52.593 15:27:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:52.593 15:27:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:52.593 15:27:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:52.593 15:27:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:52.593 15:27:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:52.593 15:27:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:52.593 15:27:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:52.593 15:27:51 -- nvmf/common.sh@294 -- # net_devs=() 00:26:52.593 15:27:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:52.593 15:27:51 -- nvmf/common.sh@295 -- # e810=() 00:26:52.593 15:27:51 -- nvmf/common.sh@295 -- # local -ga e810 00:26:52.593 15:27:51 -- nvmf/common.sh@296 -- # x722=() 00:26:52.593 15:27:51 -- nvmf/common.sh@296 -- # local -ga x722 00:26:52.593 15:27:51 -- nvmf/common.sh@297 -- # mlx=() 00:26:52.593 15:27:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:52.593 15:27:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:52.593 15:27:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:52.593 15:27:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:52.593 15:27:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:52.593 15:27:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.593 15:27:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:52.593 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:52.593 15:27:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.593 15:27:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:52.593 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:52.593 15:27:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:52.593 15:27:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:52.593 15:27:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.593 15:27:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.593 15:27:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.593 15:27:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.593 15:27:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:52.593 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:52.593 15:27:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.593 15:27:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.593 15:27:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.593 15:27:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.593 15:27:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.593 15:27:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:52.593 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:52.593 15:27:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.594 15:27:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:52.594 15:27:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:52.594 15:27:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:52.594 15:27:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:52.594 15:27:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:52.594 15:27:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:52.594 15:27:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:52.594 15:27:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:52.594 15:27:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:52.594 15:27:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:52.594 15:27:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:52.594 15:27:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:52.594 15:27:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:52.594 15:27:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:52.594 15:27:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:52.594 15:27:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:52.594 15:27:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:52.594 15:27:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:52.594 15:27:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:52.594 15:27:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:52.594 15:27:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:52.594 15:27:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:52.853 15:27:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:52.853 15:27:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:52.853 15:27:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:52.853 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:52.853 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:26:52.853 00:26:52.853 --- 10.0.0.2 ping statistics --- 00:26:52.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.853 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:26:52.853 15:27:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:52.853 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:52.853 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:26:52.853 00:26:52.853 --- 10.0.0.1 ping statistics --- 00:26:52.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.853 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:26:52.853 15:27:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:52.853 15:27:51 -- nvmf/common.sh@410 -- # return 0 00:26:52.853 15:27:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:52.853 15:27:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:52.853 15:27:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:52.853 15:27:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:52.853 15:27:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:52.853 15:27:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:52.853 15:27:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:52.853 15:27:51 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:52.853 15:27:51 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:52.853 15:27:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:52.853 15:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:52.853 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:52.853 ************************************ 00:26:52.853 START TEST nvmf_digest_clean 00:26:52.853 ************************************ 00:26:52.853 15:27:51 -- common/autotest_common.sh@1114 -- # run_digest 00:26:52.853 15:27:51 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:52.853 15:27:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:52.853 15:27:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:52.853 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:52.853 15:27:51 -- nvmf/common.sh@469 -- # nvmfpid=2877560 00:26:52.853 15:27:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:52.853 15:27:51 -- nvmf/common.sh@470 -- # waitforlisten 2877560 00:26:52.853 15:27:51 -- common/autotest_common.sh@829 -- # '[' -z 2877560 ']' 00:26:52.853 15:27:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:52.853 15:27:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:52.853 15:27:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:52.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:52.853 15:27:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:52.853 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:52.853 [2024-11-19 15:27:51.268198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:52.853 [2024-11-19 15:27:51.268283] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:52.853 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.853 [2024-11-19 15:27:51.336456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.112 [2024-11-19 15:27:51.454269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:53.112 [2024-11-19 15:27:51.454431] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:53.112 [2024-11-19 15:27:51.454462] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:53.112 [2024-11-19 15:27:51.454477] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:53.112 [2024-11-19 15:27:51.454509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:53.112 15:27:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.112 15:27:51 -- common/autotest_common.sh@862 -- # return 0 00:26:53.112 15:27:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:53.112 15:27:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:53.112 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:53.112 15:27:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:53.112 15:27:51 -- host/digest.sh@120 -- # common_target_config 00:26:53.112 15:27:51 -- host/digest.sh@43 -- # rpc_cmd 00:26:53.112 15:27:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:53.112 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:53.112 null0 00:26:53.112 [2024-11-19 15:27:51.622620] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:53.112 [2024-11-19 15:27:51.646853] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:53.112 15:27:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:53.112 15:27:51 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:53.112 15:27:51 -- host/digest.sh@77 -- # local rw bs qd 00:26:53.112 15:27:51 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:53.112 15:27:51 -- host/digest.sh@80 -- # rw=randread 00:26:53.112 15:27:51 -- host/digest.sh@80 -- # bs=4096 00:26:53.112 15:27:51 -- host/digest.sh@80 -- # qd=128 00:26:53.112 15:27:51 -- host/digest.sh@82 -- # bperfpid=2877713 00:26:53.112 15:27:51 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:53.112 15:27:51 -- host/digest.sh@83 -- # waitforlisten 2877713 /var/tmp/bperf.sock 00:26:53.112 15:27:51 -- common/autotest_common.sh@829 -- # '[' -z 2877713 ']' 00:26:53.112 15:27:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:53.112 15:27:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:53.112 15:27:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:53.112 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:53.112 15:27:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:53.112 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:53.371 [2024-11-19 15:27:51.690309] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:53.371 [2024-11-19 15:27:51.690369] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2877713 ] 00:26:53.371 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.371 [2024-11-19 15:27:51.750902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.371 [2024-11-19 15:27:51.865027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.371 15:27:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.371 15:27:51 -- common/autotest_common.sh@862 -- # return 0 00:26:53.371 15:27:51 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.371 15:27:51 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.371 15:27:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.938 15:27:52 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.938 15:27:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:54.196 nvme0n1 00:26:54.196 15:27:52 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:54.196 15:27:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:54.196 Running I/O for 2 seconds... 00:26:56.725 00:26:56.725 Latency(us) 00:26:56.725 [2024-11-19T14:27:55.288Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.725 [2024-11-19T14:27:55.288Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:56.725 nvme0n1 : 2.00 16490.74 64.42 0.00 0.00 7754.73 3325.35 17961.72 00:26:56.725 [2024-11-19T14:27:55.288Z] =================================================================================================================== 00:26:56.725 [2024-11-19T14:27:55.288Z] Total : 16490.74 64.42 0.00 0.00 7754.73 3325.35 17961.72 00:26:56.725 0 00:26:56.725 15:27:54 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:56.725 15:27:54 -- host/digest.sh@92 -- # get_accel_stats 00:26:56.725 15:27:54 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:56.725 15:27:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.725 15:27:54 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:56.725 | select(.opcode=="crc32c") 00:26:56.725 | "\(.module_name) \(.executed)"' 00:26:56.725 15:27:54 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.725 15:27:54 -- host/digest.sh@93 -- # exp_module=software 00:26:56.725 15:27:54 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.725 15:27:54 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.725 15:27:54 -- host/digest.sh@97 -- # killprocess 2877713 00:26:56.725 15:27:54 -- common/autotest_common.sh@936 -- # '[' -z 2877713 ']' 00:26:56.725 15:27:54 -- common/autotest_common.sh@940 -- # kill -0 2877713 00:26:56.725 15:27:54 -- common/autotest_common.sh@941 -- # uname 00:26:56.725 15:27:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.725 15:27:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2877713 00:26:56.725 15:27:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.725 15:27:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.725 15:27:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2877713' 00:26:56.725 killing process with pid 2877713 00:26:56.725 15:27:55 -- common/autotest_common.sh@955 -- # kill 2877713 00:26:56.725 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.725 00:26:56.725 Latency(us) 00:26:56.725 [2024-11-19T14:27:55.288Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.725 [2024-11-19T14:27:55.288Z] =================================================================================================================== 00:26:56.725 [2024-11-19T14:27:55.288Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.725 15:27:55 -- common/autotest_common.sh@960 -- # wait 2877713 00:26:56.725 15:27:55 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:56.725 15:27:55 -- host/digest.sh@77 -- # local rw bs qd 00:26:56.725 15:27:55 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:56.725 15:27:55 -- host/digest.sh@80 -- # rw=randread 00:26:56.725 15:27:55 -- host/digest.sh@80 -- # bs=131072 00:26:56.725 15:27:55 -- host/digest.sh@80 -- # qd=16 00:26:56.725 15:27:55 -- host/digest.sh@82 -- # bperfpid=2878129 00:26:56.984 15:27:55 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:56.984 15:27:55 -- host/digest.sh@83 -- # waitforlisten 2878129 /var/tmp/bperf.sock 00:26:56.984 15:27:55 -- common/autotest_common.sh@829 -- # '[' -z 2878129 ']' 00:26:56.984 15:27:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.984 15:27:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.984 15:27:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.984 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.984 15:27:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.984 15:27:55 -- common/autotest_common.sh@10 -- # set +x 00:26:56.984 [2024-11-19 15:27:55.324741] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.984 [2024-11-19 15:27:55.324835] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2878129 ] 00:26:56.984 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:56.984 Zero copy mechanism will not be used. 00:26:56.984 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.984 [2024-11-19 15:27:55.382920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.984 [2024-11-19 15:27:55.488019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.243 15:27:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.243 15:27:55 -- common/autotest_common.sh@862 -- # return 0 00:26:57.243 15:27:55 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:57.243 15:27:55 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:57.243 15:27:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.502 15:27:55 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.502 15:27:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.760 nvme0n1 00:26:57.760 15:27:56 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:57.760 15:27:56 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:58.019 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:58.019 Zero copy mechanism will not be used. 00:26:58.019 Running I/O for 2 seconds... 00:26:59.920 00:26:59.920 Latency(us) 00:26:59.920 [2024-11-19T14:27:58.483Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.920 [2024-11-19T14:27:58.483Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:59.920 nvme0n1 : 2.00 6002.20 750.28 0.00 0.00 2661.52 694.80 7281.78 00:26:59.920 [2024-11-19T14:27:58.483Z] =================================================================================================================== 00:26:59.920 [2024-11-19T14:27:58.483Z] Total : 6002.20 750.28 0.00 0.00 2661.52 694.80 7281.78 00:26:59.920 0 00:26:59.920 15:27:58 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:59.920 15:27:58 -- host/digest.sh@92 -- # get_accel_stats 00:26:59.920 15:27:58 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:59.920 15:27:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:59.920 15:27:58 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:59.920 | select(.opcode=="crc32c") 00:26:59.920 | "\(.module_name) \(.executed)"' 00:27:00.178 15:27:58 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:00.178 15:27:58 -- host/digest.sh@93 -- # exp_module=software 00:27:00.178 15:27:58 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:00.178 15:27:58 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:00.178 15:27:58 -- host/digest.sh@97 -- # killprocess 2878129 00:27:00.178 15:27:58 -- common/autotest_common.sh@936 -- # '[' -z 2878129 ']' 00:27:00.178 15:27:58 -- common/autotest_common.sh@940 -- # kill -0 2878129 00:27:00.178 15:27:58 -- common/autotest_common.sh@941 -- # uname 00:27:00.178 15:27:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.178 15:27:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2878129 00:27:00.178 15:27:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.178 15:27:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.178 15:27:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2878129' 00:27:00.178 killing process with pid 2878129 00:27:00.178 15:27:58 -- common/autotest_common.sh@955 -- # kill 2878129 00:27:00.178 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.178 00:27:00.178 Latency(us) 00:27:00.178 [2024-11-19T14:27:58.741Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.178 [2024-11-19T14:27:58.741Z] =================================================================================================================== 00:27:00.178 [2024-11-19T14:27:58.741Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.178 15:27:58 -- common/autotest_common.sh@960 -- # wait 2878129 00:27:00.437 15:27:58 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:00.437 15:27:58 -- host/digest.sh@77 -- # local rw bs qd 00:27:00.437 15:27:58 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:00.437 15:27:58 -- host/digest.sh@80 -- # rw=randwrite 00:27:00.437 15:27:58 -- host/digest.sh@80 -- # bs=4096 00:27:00.437 15:27:58 -- host/digest.sh@80 -- # qd=128 00:27:00.437 15:27:58 -- host/digest.sh@82 -- # bperfpid=2878551 00:27:00.437 15:27:58 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:00.437 15:27:58 -- host/digest.sh@83 -- # waitforlisten 2878551 /var/tmp/bperf.sock 00:27:00.437 15:27:58 -- common/autotest_common.sh@829 -- # '[' -z 2878551 ']' 00:27:00.437 15:27:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.437 15:27:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.437 15:27:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.437 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.437 15:27:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.437 15:27:58 -- common/autotest_common.sh@10 -- # set +x 00:27:00.437 [2024-11-19 15:27:58.985112] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.437 [2024-11-19 15:27:58.985205] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2878551 ] 00:27:00.695 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.695 [2024-11-19 15:27:59.043411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.695 [2024-11-19 15:27:59.149047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:00.695 15:27:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:00.695 15:27:59 -- common/autotest_common.sh@862 -- # return 0 00:27:00.695 15:27:59 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:00.695 15:27:59 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:00.695 15:27:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:01.260 15:27:59 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.260 15:27:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.519 nvme0n1 00:27:01.519 15:27:59 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:01.519 15:27:59 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:01.519 Running I/O for 2 seconds... 00:27:04.052 00:27:04.052 Latency(us) 00:27:04.052 [2024-11-19T14:28:02.615Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.052 [2024-11-19T14:28:02.615Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:04.052 nvme0n1 : 2.00 21283.82 83.14 0.00 0.00 6007.08 2912.71 11747.93 00:27:04.052 [2024-11-19T14:28:02.615Z] =================================================================================================================== 00:27:04.052 [2024-11-19T14:28:02.615Z] Total : 21283.82 83.14 0.00 0.00 6007.08 2912.71 11747.93 00:27:04.052 0 00:27:04.052 15:28:02 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:04.052 15:28:02 -- host/digest.sh@92 -- # get_accel_stats 00:27:04.052 15:28:02 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:04.052 15:28:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:04.052 15:28:02 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:04.052 | select(.opcode=="crc32c") 00:27:04.052 | "\(.module_name) \(.executed)"' 00:27:04.052 15:28:02 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:04.052 15:28:02 -- host/digest.sh@93 -- # exp_module=software 00:27:04.052 15:28:02 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:04.052 15:28:02 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:04.052 15:28:02 -- host/digest.sh@97 -- # killprocess 2878551 00:27:04.052 15:28:02 -- common/autotest_common.sh@936 -- # '[' -z 2878551 ']' 00:27:04.052 15:28:02 -- common/autotest_common.sh@940 -- # kill -0 2878551 00:27:04.052 15:28:02 -- common/autotest_common.sh@941 -- # uname 00:27:04.052 15:28:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.052 15:28:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2878551 00:27:04.052 15:28:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:04.052 15:28:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:04.052 15:28:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2878551' 00:27:04.052 killing process with pid 2878551 00:27:04.052 15:28:02 -- common/autotest_common.sh@955 -- # kill 2878551 00:27:04.052 Received shutdown signal, test time was about 2.000000 seconds 00:27:04.052 00:27:04.052 Latency(us) 00:27:04.052 [2024-11-19T14:28:02.615Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.052 [2024-11-19T14:28:02.615Z] =================================================================================================================== 00:27:04.052 [2024-11-19T14:28:02.615Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:04.052 15:28:02 -- common/autotest_common.sh@960 -- # wait 2878551 00:27:04.336 15:28:02 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:04.336 15:28:02 -- host/digest.sh@77 -- # local rw bs qd 00:27:04.336 15:28:02 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:04.336 15:28:02 -- host/digest.sh@80 -- # rw=randwrite 00:27:04.336 15:28:02 -- host/digest.sh@80 -- # bs=131072 00:27:04.336 15:28:02 -- host/digest.sh@80 -- # qd=16 00:27:04.336 15:28:02 -- host/digest.sh@82 -- # bperfpid=2879031 00:27:04.336 15:28:02 -- host/digest.sh@83 -- # waitforlisten 2879031 /var/tmp/bperf.sock 00:27:04.336 15:28:02 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:04.336 15:28:02 -- common/autotest_common.sh@829 -- # '[' -z 2879031 ']' 00:27:04.336 15:28:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.336 15:28:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.336 15:28:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.336 15:28:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.336 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:04.336 [2024-11-19 15:28:02.673134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:04.336 [2024-11-19 15:28:02.673223] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2879031 ] 00:27:04.336 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:04.336 Zero copy mechanism will not be used. 00:27:04.336 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.336 [2024-11-19 15:28:02.738710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.336 [2024-11-19 15:28:02.851514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:04.632 15:28:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:04.632 15:28:02 -- common/autotest_common.sh@862 -- # return 0 00:27:04.633 15:28:02 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:04.633 15:28:02 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:04.633 15:28:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:04.892 15:28:03 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:04.892 15:28:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.457 nvme0n1 00:27:05.457 15:28:03 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:05.458 15:28:03 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:05.458 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:05.458 Zero copy mechanism will not be used. 00:27:05.458 Running I/O for 2 seconds... 00:27:07.357 00:27:07.357 Latency(us) 00:27:07.357 [2024-11-19T14:28:05.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:07.357 [2024-11-19T14:28:05.920Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:07.357 nvme0n1 : 2.00 6810.43 851.30 0.00 0.00 2342.39 1820.44 7524.50 00:27:07.357 [2024-11-19T14:28:05.920Z] =================================================================================================================== 00:27:07.357 [2024-11-19T14:28:05.920Z] Total : 6810.43 851.30 0.00 0.00 2342.39 1820.44 7524.50 00:27:07.357 0 00:27:07.357 15:28:05 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:07.357 15:28:05 -- host/digest.sh@92 -- # get_accel_stats 00:27:07.357 15:28:05 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:07.357 15:28:05 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:07.357 | select(.opcode=="crc32c") 00:27:07.357 | "\(.module_name) \(.executed)"' 00:27:07.357 15:28:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:07.614 15:28:06 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:07.615 15:28:06 -- host/digest.sh@93 -- # exp_module=software 00:27:07.615 15:28:06 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:07.615 15:28:06 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:07.615 15:28:06 -- host/digest.sh@97 -- # killprocess 2879031 00:27:07.615 15:28:06 -- common/autotest_common.sh@936 -- # '[' -z 2879031 ']' 00:27:07.615 15:28:06 -- common/autotest_common.sh@940 -- # kill -0 2879031 00:27:07.615 15:28:06 -- common/autotest_common.sh@941 -- # uname 00:27:07.615 15:28:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:07.615 15:28:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879031 00:27:07.873 15:28:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:07.873 15:28:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:07.873 15:28:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879031' 00:27:07.873 killing process with pid 2879031 00:27:07.873 15:28:06 -- common/autotest_common.sh@955 -- # kill 2879031 00:27:07.873 Received shutdown signal, test time was about 2.000000 seconds 00:27:07.873 00:27:07.873 Latency(us) 00:27:07.873 [2024-11-19T14:28:06.436Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:07.873 [2024-11-19T14:28:06.436Z] =================================================================================================================== 00:27:07.873 [2024-11-19T14:28:06.436Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:07.873 15:28:06 -- common/autotest_common.sh@960 -- # wait 2879031 00:27:08.131 15:28:06 -- host/digest.sh@126 -- # killprocess 2877560 00:27:08.131 15:28:06 -- common/autotest_common.sh@936 -- # '[' -z 2877560 ']' 00:27:08.131 15:28:06 -- common/autotest_common.sh@940 -- # kill -0 2877560 00:27:08.131 15:28:06 -- common/autotest_common.sh@941 -- # uname 00:27:08.131 15:28:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:08.131 15:28:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2877560 00:27:08.131 15:28:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:08.131 15:28:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:08.131 15:28:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2877560' 00:27:08.131 killing process with pid 2877560 00:27:08.131 15:28:06 -- common/autotest_common.sh@955 -- # kill 2877560 00:27:08.131 15:28:06 -- common/autotest_common.sh@960 -- # wait 2877560 00:27:08.390 00:27:08.390 real 0m15.518s 00:27:08.390 user 0m30.949s 00:27:08.390 sys 0m4.249s 00:27:08.390 15:28:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:08.390 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:08.390 ************************************ 00:27:08.390 END TEST nvmf_digest_clean 00:27:08.390 ************************************ 00:27:08.390 15:28:06 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:08.390 15:28:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:08.390 15:28:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:08.390 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:08.390 ************************************ 00:27:08.390 START TEST nvmf_digest_error 00:27:08.390 ************************************ 00:27:08.390 15:28:06 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:08.390 15:28:06 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:08.390 15:28:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:08.390 15:28:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:08.390 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:08.390 15:28:06 -- nvmf/common.sh@469 -- # nvmfpid=2879548 00:27:08.390 15:28:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:08.390 15:28:06 -- nvmf/common.sh@470 -- # waitforlisten 2879548 00:27:08.390 15:28:06 -- common/autotest_common.sh@829 -- # '[' -z 2879548 ']' 00:27:08.390 15:28:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:08.390 15:28:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.390 15:28:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:08.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:08.390 15:28:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.390 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:27:08.390 [2024-11-19 15:28:06.811261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.390 [2024-11-19 15:28:06.811337] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:08.390 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.390 [2024-11-19 15:28:06.873638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.649 [2024-11-19 15:28:06.977371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:08.649 [2024-11-19 15:28:06.977510] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:08.649 [2024-11-19 15:28:06.977526] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:08.649 [2024-11-19 15:28:06.977538] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:08.649 [2024-11-19 15:28:06.977564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:08.649 15:28:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:08.649 15:28:07 -- common/autotest_common.sh@862 -- # return 0 00:27:08.649 15:28:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:08.649 15:28:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:08.649 15:28:07 -- common/autotest_common.sh@10 -- # set +x 00:27:08.649 15:28:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:08.649 15:28:07 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:08.649 15:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.649 15:28:07 -- common/autotest_common.sh@10 -- # set +x 00:27:08.649 [2024-11-19 15:28:07.054153] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:08.649 15:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.649 15:28:07 -- host/digest.sh@104 -- # common_target_config 00:27:08.649 15:28:07 -- host/digest.sh@43 -- # rpc_cmd 00:27:08.649 15:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.649 15:28:07 -- common/autotest_common.sh@10 -- # set +x 00:27:08.649 null0 00:27:08.649 [2024-11-19 15:28:07.172020] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:08.649 [2024-11-19 15:28:07.196268] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:08.649 15:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.649 15:28:07 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:08.649 15:28:07 -- host/digest.sh@54 -- # local rw bs qd 00:27:08.649 15:28:07 -- host/digest.sh@56 -- # rw=randread 00:27:08.649 15:28:07 -- host/digest.sh@56 -- # bs=4096 00:27:08.649 15:28:07 -- host/digest.sh@56 -- # qd=128 00:27:08.649 15:28:07 -- host/digest.sh@58 -- # bperfpid=2879688 00:27:08.649 15:28:07 -- host/digest.sh@60 -- # waitforlisten 2879688 /var/tmp/bperf.sock 00:27:08.649 15:28:07 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:08.649 15:28:07 -- common/autotest_common.sh@829 -- # '[' -z 2879688 ']' 00:27:08.649 15:28:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:08.649 15:28:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.649 15:28:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:08.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:08.649 15:28:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.649 15:28:07 -- common/autotest_common.sh@10 -- # set +x 00:27:08.908 [2024-11-19 15:28:07.239319] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.908 [2024-11-19 15:28:07.239378] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2879688 ] 00:27:08.908 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.908 [2024-11-19 15:28:07.300537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.908 [2024-11-19 15:28:07.414442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:09.844 15:28:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:09.844 15:28:08 -- common/autotest_common.sh@862 -- # return 0 00:27:09.844 15:28:08 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:09.844 15:28:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.103 15:28:08 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.103 15:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.103 15:28:08 -- common/autotest_common.sh@10 -- # set +x 00:27:10.103 15:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.103 15:28:08 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.103 15:28:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.669 nvme0n1 00:27:10.669 15:28:09 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:10.669 15:28:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.669 15:28:09 -- common/autotest_common.sh@10 -- # set +x 00:27:10.669 15:28:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.669 15:28:09 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:10.669 15:28:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:10.669 Running I/O for 2 seconds... 00:27:10.669 [2024-11-19 15:28:09.230493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.669 [2024-11-19 15:28:09.230544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.669 [2024-11-19 15:28:09.230565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.242317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.242354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:7838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.242374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.258697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.258734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.258769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.274893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.274926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:4136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.274944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.291540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.291576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.291596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.308078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.308114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.308134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.325100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.325137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13717 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.325157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.336147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.927 [2024-11-19 15:28:09.336178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.927 [2024-11-19 15:28:09.336194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.927 [2024-11-19 15:28:09.351899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.351938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.351956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.368571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.368607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.368627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.385982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.386031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:1411 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.386050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.402878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.402908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19996 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.402924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.419490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.419526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:11311 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.419545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.429921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.429952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.429984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.445953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.445983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.446013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.462546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.462582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.462601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.928 [2024-11-19 15:28:09.479428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:10.928 [2024-11-19 15:28:09.479464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.928 [2024-11-19 15:28:09.479484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.495026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.495059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:8242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.495077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.506913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.506942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:15219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.506959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.523766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.523795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.523811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.540716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.540751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.540772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.557258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.557293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:8899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.557313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.572926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.572954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:21479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.572970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.590178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.590213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:15061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.590233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.606336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.606372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:20378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.606391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.617212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.617246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.617272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.633043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.633071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.633087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.647905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.647934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.647951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.659024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.659068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:2720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.659084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.670916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.670946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.670963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.186 [2024-11-19 15:28:09.684342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.186 [2024-11-19 15:28:09.684371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.186 [2024-11-19 15:28:09.684387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.187 [2024-11-19 15:28:09.700561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.187 [2024-11-19 15:28:09.700593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.187 [2024-11-19 15:28:09.700611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.187 [2024-11-19 15:28:09.712428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.187 [2024-11-19 15:28:09.712462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:158 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.187 [2024-11-19 15:28:09.712481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.187 [2024-11-19 15:28:09.729041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.187 [2024-11-19 15:28:09.729076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.187 [2024-11-19 15:28:09.729095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.187 [2024-11-19 15:28:09.745934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.187 [2024-11-19 15:28:09.745967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.187 [2024-11-19 15:28:09.745984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.763730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.763775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:11540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.763792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.774318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.774353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:14285 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.774373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.790371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.790407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:24125 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.790426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.807209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.807244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:19774 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.807277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.820228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.820263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:8570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.820283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.831934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.831967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.831984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.847873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.847906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19788 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.847924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.859590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.859624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.859650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.874846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.874877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9644 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.874894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.886855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.886884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.886900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.897695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.897723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:21689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.897739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.910603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.910638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.910658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.927343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.927378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:14953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.927398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.944228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.944257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25305 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.944274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.958856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.958888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.958906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.970046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.970078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.970095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:09.986711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:09.986753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19932 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:09.986774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-19 15:28:10.003759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.446 [2024-11-19 15:28:10.003793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6609 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-19 15:28:10.003810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.021435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.021472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.021490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.032802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.032848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:3068 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.032866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.048516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.048552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:8611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.048572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.063280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.063318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:4394 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.063337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.077852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.077884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:4211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.077902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.094003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.094033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:22092 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.094050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.110895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.110925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:17614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.110940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.127426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.127457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.127474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.144551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.144583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9931 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.144600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.161786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.161834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2686 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.161852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.178796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.178827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:7640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.178846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.196422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.196457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:12119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.196477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.213112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.213142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:14186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.213160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.229748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.229778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.229810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.247164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.247195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.247230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.705 [2024-11-19 15:28:10.263904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.705 [2024-11-19 15:28:10.263936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.705 [2024-11-19 15:28:10.263959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.964 [2024-11-19 15:28:10.280892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.964 [2024-11-19 15:28:10.280923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.964 [2024-11-19 15:28:10.280940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.964 [2024-11-19 15:28:10.297677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.964 [2024-11-19 15:28:10.297722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:24190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.964 [2024-11-19 15:28:10.297756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.964 [2024-11-19 15:28:10.314569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.964 [2024-11-19 15:28:10.314599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:23728 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.964 [2024-11-19 15:28:10.314616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.964 [2024-11-19 15:28:10.330893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.964 [2024-11-19 15:28:10.330923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:3949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.964 [2024-11-19 15:28:10.330940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.964 [2024-11-19 15:28:10.347388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.347432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:19850 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.347449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.363864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.363895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.363913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.380412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.380441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:11947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.380457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.397623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.397653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14637 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.397685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.414209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.414243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6692 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.414260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.430944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.430973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.430989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.447604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.447632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.447649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.464289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.464318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:20087 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.464348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.481186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.481221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.481241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.492413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.492450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:19770 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.492469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.508861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.508891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10990 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.508908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.965 [2024-11-19 15:28:10.525981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:11.965 [2024-11-19 15:28:10.526034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.965 [2024-11-19 15:28:10.526056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.542759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.542790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6009 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.542807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.560062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.560099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2856 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.560118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.577213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.577248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:19458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.577267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.593979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.594016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:17538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.594059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.611029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.611058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19440 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.611076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.627854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.627884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:3889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.627901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.644112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.644143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11428 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.644158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.660539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.660573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:21252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.660592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.677542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.677577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.677607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.693981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.694009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:19304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.694034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.710826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.710855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.710875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.727613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.727647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:13464 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.727668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.744038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.744072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.744102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.761364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.761408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:20431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.761429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.222 [2024-11-19 15:28:10.778531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.222 [2024-11-19 15:28:10.778565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6649 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.222 [2024-11-19 15:28:10.778584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.795526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.795562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.795584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.806742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.806789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:11283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.806806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.822855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.822885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:20566 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.822903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.839205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.839233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:4343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.839252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.855785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.855815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.855836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.873492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.873527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:4869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.873547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.886382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.886411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:2784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.886446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.898037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.898071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19481 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.898089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.913669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.913718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:4262 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.913738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.930438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.930472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:18990 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.930502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.947318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.947352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:3390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.947378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.963534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.963569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:13085 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.963596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.980303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.980337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:12827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.980357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:10.997220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:10.997256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:21313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:10.997276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:11.008418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:11.008454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:25393 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:11.008473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:11.023917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:11.023964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:11.023981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.480 [2024-11-19 15:28:11.041250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.480 [2024-11-19 15:28:11.041285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5665 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.480 [2024-11-19 15:28:11.041304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.058004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.058051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.058071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.073291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.073320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.073335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.084055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.084090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:7407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.084110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.101357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.101402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:15520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.101423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.117604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.117639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:13867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.117659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.128602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.128633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:13965 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.128650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.144971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.145015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:23145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.145035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.161663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.161706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2674 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.161727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.177767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.177795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:7582 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.177811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.194570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.194605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.194624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 [2024-11-19 15:28:11.211233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x650bb0) 00:27:12.739 [2024-11-19 15:28:11.211262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.739 [2024-11-19 15:28:11.211277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.739 00:27:12.739 Latency(us) 00:27:12.739 [2024-11-19T14:28:11.302Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.739 [2024-11-19T14:28:11.302Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:12.739 nvme0n1 : 2.01 16345.17 63.85 0.00 0.00 7825.20 3470.98 26020.22 00:27:12.739 [2024-11-19T14:28:11.302Z] =================================================================================================================== 00:27:12.739 [2024-11-19T14:28:11.302Z] Total : 16345.17 63.85 0.00 0.00 7825.20 3470.98 26020.22 00:27:12.739 0 00:27:12.739 15:28:11 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:12.739 15:28:11 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:12.739 15:28:11 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:12.739 | .driver_specific 00:27:12.739 | .nvme_error 00:27:12.739 | .status_code 00:27:12.739 | .command_transient_transport_error' 00:27:12.739 15:28:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:12.997 15:28:11 -- host/digest.sh@71 -- # (( 128 > 0 )) 00:27:12.997 15:28:11 -- host/digest.sh@73 -- # killprocess 2879688 00:27:12.997 15:28:11 -- common/autotest_common.sh@936 -- # '[' -z 2879688 ']' 00:27:12.997 15:28:11 -- common/autotest_common.sh@940 -- # kill -0 2879688 00:27:12.997 15:28:11 -- common/autotest_common.sh@941 -- # uname 00:27:12.997 15:28:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:12.997 15:28:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879688 00:27:13.255 15:28:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:13.255 15:28:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:13.255 15:28:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879688' 00:27:13.255 killing process with pid 2879688 00:27:13.255 15:28:11 -- common/autotest_common.sh@955 -- # kill 2879688 00:27:13.256 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.256 00:27:13.256 Latency(us) 00:27:13.256 [2024-11-19T14:28:11.819Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.256 [2024-11-19T14:28:11.819Z] =================================================================================================================== 00:27:13.256 [2024-11-19T14:28:11.819Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.256 15:28:11 -- common/autotest_common.sh@960 -- # wait 2879688 00:27:13.514 15:28:11 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:13.514 15:28:11 -- host/digest.sh@54 -- # local rw bs qd 00:27:13.514 15:28:11 -- host/digest.sh@56 -- # rw=randread 00:27:13.514 15:28:11 -- host/digest.sh@56 -- # bs=131072 00:27:13.514 15:28:11 -- host/digest.sh@56 -- # qd=16 00:27:13.514 15:28:11 -- host/digest.sh@58 -- # bperfpid=2880242 00:27:13.514 15:28:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:13.514 15:28:11 -- host/digest.sh@60 -- # waitforlisten 2880242 /var/tmp/bperf.sock 00:27:13.514 15:28:11 -- common/autotest_common.sh@829 -- # '[' -z 2880242 ']' 00:27:13.514 15:28:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:13.514 15:28:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:13.514 15:28:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:13.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:13.514 15:28:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:13.514 15:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:13.514 [2024-11-19 15:28:11.890736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:13.514 [2024-11-19 15:28:11.890827] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2880242 ] 00:27:13.514 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:13.514 Zero copy mechanism will not be used. 00:27:13.514 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.514 [2024-11-19 15:28:11.952902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:13.514 [2024-11-19 15:28:12.063560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.449 15:28:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:14.449 15:28:12 -- common/autotest_common.sh@862 -- # return 0 00:27:14.449 15:28:12 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.449 15:28:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.706 15:28:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:14.706 15:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.706 15:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:14.706 15:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.706 15:28:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.706 15:28:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.272 nvme0n1 00:27:15.272 15:28:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:15.272 15:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:15.272 15:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:15.272 15:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:15.272 15:28:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:15.272 15:28:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:15.272 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:15.272 Zero copy mechanism will not be used. 00:27:15.272 Running I/O for 2 seconds... 00:27:15.272 [2024-11-19 15:28:13.777581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.777642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.777664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.784481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.784519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.784539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.792064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.792100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.792119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.799658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.799702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.799724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.807325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.807361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.807382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.814891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.814923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.814950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.822640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.822675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.822705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.273 [2024-11-19 15:28:13.830136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.273 [2024-11-19 15:28:13.830173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.273 [2024-11-19 15:28:13.830192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.837846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.837878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.837896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.845486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.845520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.845540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.853279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.853313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.853332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.860151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.860187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.860207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.867813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.867844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.867861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.875000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.875032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.875066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.881070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.881126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.881146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.887532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.887567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.887586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.892464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.892500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.892518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.897966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.898015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.898034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.903477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.903512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.903530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.908931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.908990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.909009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.914585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.914619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.914638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.919715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.919764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.919782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.924429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.924463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.924481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.928846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.928877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.928894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.933423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.933456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.933474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.937409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.937440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.937457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.941354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.941388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.941406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.945617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.945650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.945668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.949722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.949763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.949780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.954189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.954223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.954242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.958990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.959020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.959036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.964057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.964096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.964115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.532 [2024-11-19 15:28:13.968869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.532 [2024-11-19 15:28:13.968898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.532 [2024-11-19 15:28:13.968929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:13.973919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:13.973948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:13.973964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:13.979612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:13.979646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:13.979665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:13.984868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:13.984898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:13.984915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:13.990249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:13.990282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:13.990300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:13.996384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:13.996417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:13.996437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.002272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.002305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.002324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.007746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.007776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.007793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.013371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.013401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.013418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.018615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.018648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.018666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.024068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.024098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.024115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.030569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.030603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.030622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.037276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.037312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.037331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.044521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.044555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.044577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.052040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.052090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.052110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.060381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.060416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.060435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.068136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.068172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.068201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.074874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.074905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.074923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.082079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.082113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.082142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.533 [2024-11-19 15:28:14.090020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.533 [2024-11-19 15:28:14.090056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.533 [2024-11-19 15:28:14.090075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.098381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.098416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.098436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.106798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.106830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.106862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.115089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.115124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.115143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.123613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.123647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.123666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.131649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.131684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.131723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.138949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.138986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.139031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.147163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.147198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.147219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.154399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.154434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.154456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.160488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.160522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.160542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.167749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.167794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.167811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.173813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.173843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.173878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.179865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.179911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.179930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.186380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.186413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.186432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.192739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.192770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.192788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.199482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.199516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.199535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.205686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.205728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.205760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.212344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.212379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.212399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.218555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.218589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.218610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.224996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.225046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.225065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.231042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.231072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.231104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.236773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.792 [2024-11-19 15:28:14.236804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.792 [2024-11-19 15:28:14.236824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.792 [2024-11-19 15:28:14.242318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.242364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.242381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.246827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.246858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.246895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.251606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.251638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.251656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.257320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.257355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.257376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.264081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.264117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.264136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.270908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.270939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.270957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.277821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.277853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.277870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.285366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.285401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.285429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.292668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.292738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.292768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.299487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.299521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.299551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.306183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.306224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.306253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.312329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.312363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.312381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.318402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.318437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.318456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.324950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.324990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.325008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.331859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.331889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.331909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.338241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.338276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.338296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.344339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.344374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.344394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:15.793 [2024-11-19 15:28:14.349796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:15.793 [2024-11-19 15:28:14.349827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.793 [2024-11-19 15:28:14.349851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.355682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.355740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.355758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.361208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.361243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.361276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.366585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.366619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.366638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.371884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.371914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.371933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.377186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.377219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.377238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.382494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.382526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.382544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.387919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.387948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.387966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.393500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.393532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.393551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.399083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.399112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.052 [2024-11-19 15:28:14.399130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.052 [2024-11-19 15:28:14.404687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.052 [2024-11-19 15:28:14.404734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.404768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.410068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.410112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.410131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.415304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.415335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.415353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.420195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.420229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.420249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.425315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.425348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.425383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.430440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.430473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.430491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.435559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.435590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.435608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.440881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.440911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.440928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.445923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.445952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.445977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.450946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.450986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.451020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.455784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.455813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.455830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.460913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.460943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.460964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.465917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.465946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.465965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.470929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.470958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.470975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.475885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.475914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.475936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.481156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.481190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.481208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.486286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.486318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.486337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.491379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.491411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.491438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.496684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.496742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.496760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.502107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.502157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.502174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.507546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.507578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.507597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.512894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.512924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.512943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.518173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.518206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.518231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.523161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.523193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.523212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.527944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.527974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.527996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.533053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.533086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.533105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.053 [2024-11-19 15:28:14.538257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.053 [2024-11-19 15:28:14.538299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.053 [2024-11-19 15:28:14.538319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.543855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.543885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.543901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.549347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.549379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.549398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.554726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.554756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.554777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.560192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.560225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.560244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.565608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.565641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.565659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.570829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.570860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.570880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.575892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.575922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.575941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.581110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.581140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.581160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.586422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.586464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.586482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.591862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.591891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.591910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.597058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.597104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.597122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.602541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.602574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.602593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.607856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.607886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.607906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.054 [2024-11-19 15:28:14.612906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.054 [2024-11-19 15:28:14.612936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.054 [2024-11-19 15:28:14.612955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.617894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.617925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.617944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.622747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.622776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.622795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.627301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.627333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.627358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.630589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.630621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.630640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.635706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.635751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.635768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.641120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.641151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.641171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.646451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.646497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.646517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.651865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.651908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.651947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.657401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.657433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.657451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.662748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.662777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.662796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.668564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.668597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.668616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.672438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.672477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.313 [2024-11-19 15:28:14.672497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.313 [2024-11-19 15:28:14.677340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.313 [2024-11-19 15:28:14.677373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.677395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.681889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.681918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.681935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.686108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.686141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.686159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.690929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.690960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.690977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.696317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.696350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.696370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.701566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.701599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.701619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.706817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.706848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.706867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.712849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.712879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.712899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.718852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.718883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.718903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.725268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.725303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.725323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.729607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.729640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.729662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.733767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.733797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.733814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.737992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.738046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.738065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.742934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.742964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.742980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.748433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.748466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.748485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.753885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.753915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.753932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.759135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.759175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.759195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.764515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.764549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.764567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.770096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.770130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.770148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.775349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.775382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.775400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.780660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.780703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.780726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.785789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.785820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.785837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.790941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.790971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.790988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.796013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.796046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.796066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.801182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.801215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.801234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.806355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.806389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.806408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.811616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.314 [2024-11-19 15:28:14.811650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.314 [2024-11-19 15:28:14.811669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.314 [2024-11-19 15:28:14.816995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.817041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.817061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.822517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.822549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.822567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.828010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.828040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.828057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.833347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.833380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.833399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.838340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.838373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.838391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.843351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.843383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.843401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.848351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.848384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.848408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.853295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.853328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.853346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.858736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.858776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.858807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.864083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.864116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.864135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.869306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.869339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.869357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.315 [2024-11-19 15:28:14.874440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.315 [2024-11-19 15:28:14.874474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.315 [2024-11-19 15:28:14.874492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.879676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.879716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.879733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.885170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.885200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.885217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.890658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.890697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.890718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.895894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.895930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.895948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.900919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.900949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.900965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.905941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.905970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.905987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.910974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.911022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.911040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.916003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.916034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.916066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.921291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.921324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.921342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.926596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.926628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.926647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.931806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.931835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.931852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.937285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.937318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.937337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.942426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.942458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.942477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.948451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.948485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.948503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.954305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.954339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.574 [2024-11-19 15:28:14.954359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.574 [2024-11-19 15:28:14.959501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.574 [2024-11-19 15:28:14.959534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.959552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.964904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.964934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.964951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.970097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.970131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.970149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.974919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.974949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.974983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.978959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.979008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.979026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.982892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.982922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.982944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.987298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.987333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.987353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.991059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.991092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.991111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:14.995551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:14.995584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:14.995602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.000622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.000655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.000674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.005667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.005710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.005746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.010786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.010817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.010834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.016109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.016144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.016163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.021135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.021168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.021187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.024743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.024773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.024789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.029212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.029257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.029276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.034373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.034406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.034424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.039554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.039603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.039621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.044737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.044784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.044802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.050121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.050153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.050173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.055591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.055624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.055643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.060807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.060836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.060853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.066170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.066202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.066227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.071679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.071738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.071756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.077163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.077196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.077215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.082338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.082371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.082390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.087736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.087781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.575 [2024-11-19 15:28:15.087797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.575 [2024-11-19 15:28:15.093106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.575 [2024-11-19 15:28:15.093138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.093157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.098774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.098803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.098819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.104028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.104077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.104096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.109363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.109397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.109415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.114545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.114585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.114605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.119763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.119791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.119806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.124963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.124993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.125009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.576 [2024-11-19 15:28:15.130195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.576 [2024-11-19 15:28:15.130228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.576 [2024-11-19 15:28:15.130247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.135550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.135584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.135603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.140974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.141022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.141042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.146073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.146107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.146127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.151025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.151072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.151091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.156151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.156184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.156202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.161242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.161275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.161294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.166364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.166397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.166415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.171505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.171539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.171558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.176469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.176502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.176520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.181493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.181526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.181544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.186500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.186547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.186566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.191615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.191647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.191666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.196502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.196534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.196552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.201418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.201450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.201478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.206494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.206526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.206545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.211581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.211614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.211633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.216764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.216794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.216810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.221833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.221862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.221879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.226775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.226803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.226818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.231798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.231828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.231858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.236722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.236768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.236784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.241626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.241658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.241677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.246751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.835 [2024-11-19 15:28:15.246784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.835 [2024-11-19 15:28:15.246801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.835 [2024-11-19 15:28:15.251763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.251791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.251807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.256637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.256670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.256698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.261577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.261610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.261629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.266476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.266508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.266527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.271355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.271388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.271407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.276560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.276593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.276611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.281544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.281576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.281594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.286506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.286535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.286567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.291370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.291402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.291421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.296430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.296463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.296481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.301478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.301510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.301529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.306866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.306909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.306926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.312094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.312128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.312147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.317217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.317251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.317270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.322758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.322786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.322802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.328002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.328047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.328066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.333336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.333369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.333394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.338395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.338428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.338446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.343569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.343601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.343620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.349434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.349468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.349487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.355484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.355518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.355536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.362148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.362182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.362202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.369732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.369767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.369786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.377178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.377215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.377234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.384669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.384712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.384746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.836 [2024-11-19 15:28:15.391856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:16.836 [2024-11-19 15:28:15.391887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.836 [2024-11-19 15:28:15.391904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.397189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.397226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.397245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.403422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.403457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.403476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.409373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.409409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.409428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.414475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.414510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.414529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.418959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.419008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.419027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.423209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.096 [2024-11-19 15:28:15.423242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.096 [2024-11-19 15:28:15.423261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.096 [2024-11-19 15:28:15.427816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.427846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.427862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.432638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.432671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.432709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.437756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.437784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.437815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.442671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.442712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.442745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.447661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.447701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.447722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.452665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.452704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.452724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.457684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.457724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.457757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.462635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.462664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.462706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.467710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.467757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.467773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.472614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.472646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.472665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.477886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.477919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.477935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.483144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.483176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.483195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.488164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.488193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.488210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.493137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.493170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.493189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.498480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.498514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.498533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.503940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.503994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.504010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.509375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.509407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.509425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.514843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.514873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.514890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.520248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.520281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.520300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.525704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.525751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.525768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.530956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.530985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.531017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.535988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.536017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.536050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.541037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.541068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.541087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.545931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.545959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.545992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.550967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.550995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.551027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.556051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.097 [2024-11-19 15:28:15.556084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.097 [2024-11-19 15:28:15.556104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.097 [2024-11-19 15:28:15.561256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.561290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.561308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.567000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.567045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.567071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.572486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.572518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.572537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.577886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.577916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.577932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.583327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.583360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.583379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.588554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.588598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.588615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.593919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.593948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.593965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.599163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.599196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.599215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.604367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.604400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.604418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.609672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.609713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.609748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.615072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.615111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.615130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.620195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.620224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.620241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.625495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.625528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.625547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.630844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.630872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.630888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.635790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.635820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.635836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.640851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.640879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.640895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.645801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.645831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.645848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.650962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.651009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.651028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.098 [2024-11-19 15:28:15.656364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.098 [2024-11-19 15:28:15.656399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.098 [2024-11-19 15:28:15.656418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.661753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.661799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.661816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.667121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.667155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.667174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.672554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.672587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.672605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.677914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.677944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.677961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.683336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.683368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.683387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.688519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.688551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.688570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.693473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.693505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.693523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.698519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.698551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.698569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.703437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.703470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.703495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.708637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.708669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.708695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.713673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.713713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.713745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.718765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.718794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.718811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.723880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.723908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.723924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.357 [2024-11-19 15:28:15.729218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.357 [2024-11-19 15:28:15.729250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.357 [2024-11-19 15:28:15.729268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.734477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.734507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.734542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.739784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.739812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.739827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.744669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.744712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.744745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.750083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.750122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.750142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.755404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.755436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.755454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.760158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.760190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.760209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.764809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.764838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.764854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.358 [2024-11-19 15:28:15.769503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x15d8bb0) 00:27:17.358 [2024-11-19 15:28:15.769535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.358 [2024-11-19 15:28:15.769553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.358 00:27:17.358 Latency(us) 00:27:17.358 [2024-11-19T14:28:15.921Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.358 [2024-11-19T14:28:15.921Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:17.358 nvme0n1 : 2.00 5646.62 705.83 0.00 0.00 2829.61 776.72 9175.04 00:27:17.358 [2024-11-19T14:28:15.921Z] =================================================================================================================== 00:27:17.358 [2024-11-19T14:28:15.921Z] Total : 5646.62 705.83 0.00 0.00 2829.61 776.72 9175.04 00:27:17.358 0 00:27:17.358 15:28:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:17.358 15:28:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:17.358 15:28:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:17.358 15:28:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:17.358 | .driver_specific 00:27:17.358 | .nvme_error 00:27:17.358 | .status_code 00:27:17.358 | .command_transient_transport_error' 00:27:17.616 15:28:16 -- host/digest.sh@71 -- # (( 364 > 0 )) 00:27:17.616 15:28:16 -- host/digest.sh@73 -- # killprocess 2880242 00:27:17.616 15:28:16 -- common/autotest_common.sh@936 -- # '[' -z 2880242 ']' 00:27:17.616 15:28:16 -- common/autotest_common.sh@940 -- # kill -0 2880242 00:27:17.616 15:28:16 -- common/autotest_common.sh@941 -- # uname 00:27:17.616 15:28:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.616 15:28:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2880242 00:27:17.616 15:28:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:17.616 15:28:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:17.616 15:28:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2880242' 00:27:17.616 killing process with pid 2880242 00:27:17.616 15:28:16 -- common/autotest_common.sh@955 -- # kill 2880242 00:27:17.616 Received shutdown signal, test time was about 2.000000 seconds 00:27:17.616 00:27:17.616 Latency(us) 00:27:17.616 [2024-11-19T14:28:16.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.616 [2024-11-19T14:28:16.179Z] =================================================================================================================== 00:27:17.616 [2024-11-19T14:28:16.179Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:17.616 15:28:16 -- common/autotest_common.sh@960 -- # wait 2880242 00:27:17.874 15:28:16 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:17.874 15:28:16 -- host/digest.sh@54 -- # local rw bs qd 00:27:17.874 15:28:16 -- host/digest.sh@56 -- # rw=randwrite 00:27:17.874 15:28:16 -- host/digest.sh@56 -- # bs=4096 00:27:17.874 15:28:16 -- host/digest.sh@56 -- # qd=128 00:27:17.874 15:28:16 -- host/digest.sh@58 -- # bperfpid=2880796 00:27:17.874 15:28:16 -- host/digest.sh@60 -- # waitforlisten 2880796 /var/tmp/bperf.sock 00:27:17.874 15:28:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:17.874 15:28:16 -- common/autotest_common.sh@829 -- # '[' -z 2880796 ']' 00:27:17.874 15:28:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:17.874 15:28:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:17.874 15:28:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:17.874 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:17.874 15:28:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:17.874 15:28:16 -- common/autotest_common.sh@10 -- # set +x 00:27:17.874 [2024-11-19 15:28:16.363588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:17.874 [2024-11-19 15:28:16.363680] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2880796 ] 00:27:17.874 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.874 [2024-11-19 15:28:16.422454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.132 [2024-11-19 15:28:16.528995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.066 15:28:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.066 15:28:17 -- common/autotest_common.sh@862 -- # return 0 00:27:19.066 15:28:17 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:19.066 15:28:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:19.324 15:28:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:19.324 15:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.324 15:28:17 -- common/autotest_common.sh@10 -- # set +x 00:27:19.324 15:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.324 15:28:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.324 15:28:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.582 nvme0n1 00:27:19.582 15:28:18 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:19.582 15:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.582 15:28:18 -- common/autotest_common.sh@10 -- # set +x 00:27:19.582 15:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.582 15:28:18 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:19.582 15:28:18 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:19.841 Running I/O for 2 seconds... 00:27:19.841 [2024-11-19 15:28:18.206364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190eea00 00:27:19.841 [2024-11-19 15:28:18.207791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:9730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.841 [2024-11-19 15:28:18.207834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.841 [2024-11-19 15:28:18.218374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ee190 00:27:19.841 [2024-11-19 15:28:18.219636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.841 [2024-11-19 15:28:18.219669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:19.841 [2024-11-19 15:28:18.229809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e49b0 00:27:19.841 [2024-11-19 15:28:18.231622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.841 [2024-11-19 15:28:18.231653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.841 [2024-11-19 15:28:18.240334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0350 00:27:19.841 [2024-11-19 15:28:18.241356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.841 [2024-11-19 15:28:18.241385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:19.841 [2024-11-19 15:28:18.252927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6cc8 00:27:19.841 [2024-11-19 15:28:18.253363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.841 [2024-11-19 15:28:18.253394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:19.841 [2024-11-19 15:28:18.264793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e9168 00:27:19.841 [2024-11-19 15:28:18.265436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:8234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.265467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.276423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e0a68 00:27:19.842 [2024-11-19 15:28:18.277041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:15131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.277086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.287979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f8a50 00:27:19.842 [2024-11-19 15:28:18.288581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.288625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.299574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7da8 00:27:19.842 [2024-11-19 15:28:18.300078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.300108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.311115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f8a50 00:27:19.842 [2024-11-19 15:28:18.311652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.311682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.322578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e0a68 00:27:19.842 [2024-11-19 15:28:18.323023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.323053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.333947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190efae0 00:27:19.842 [2024-11-19 15:28:18.334382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.334413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.345044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7100 00:27:19.842 [2024-11-19 15:28:18.346472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.346504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.356490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0ff8 00:27:19.842 [2024-11-19 15:28:18.357837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:17478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.357883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.368085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f3e60 00:27:19.842 [2024-11-19 15:28:18.369402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:16771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.369451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.380033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190dfdc0 00:27:19.842 [2024-11-19 15:28:18.381245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:22813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.381289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.391496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e01f8 00:27:19.842 [2024-11-19 15:28:18.392780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:1311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.842 [2024-11-19 15:28:18.392827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:19.842 [2024-11-19 15:28:18.403144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ea680 00:27:20.100 [2024-11-19 15:28:18.404402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:6662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.100 [2024-11-19 15:28:18.404453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:20.100 [2024-11-19 15:28:18.414760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f9b30 00:27:20.100 [2024-11-19 15:28:18.416063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:2772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.100 [2024-11-19 15:28:18.416107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:20.100 [2024-11-19 15:28:18.426257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0bc0 00:27:20.100 [2024-11-19 15:28:18.427534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:16209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.100 [2024-11-19 15:28:18.427566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:20.100 [2024-11-19 15:28:18.438066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6890 00:27:20.100 [2024-11-19 15:28:18.439087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.100 [2024-11-19 15:28:18.439131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:20.100 [2024-11-19 15:28:18.449828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0ff8 00:27:20.100 [2024-11-19 15:28:18.450541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:6586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.100 [2024-11-19 15:28:18.450572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:20.100 [2024-11-19 15:28:18.461490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f31b8 00:27:20.100 [2024-11-19 15:28:18.462114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:4464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.462144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.473770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f2510 00:27:20.101 [2024-11-19 15:28:18.474394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:1181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.474422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.486209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e1f80 00:27:20.101 [2024-11-19 15:28:18.486764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:9372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.486794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.498533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7970 00:27:20.101 [2024-11-19 15:28:18.499071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:22313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.499102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.510545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f1868 00:27:20.101 [2024-11-19 15:28:18.511079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:22733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.511109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.522113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f5378 00:27:20.101 [2024-11-19 15:28:18.522617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:12422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.522646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.534553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f4f40 00:27:20.101 [2024-11-19 15:28:18.535400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:1421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.535431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.547192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f1ca0 00:27:20.101 [2024-11-19 15:28:18.547837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:22287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.547866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.559404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7da8 00:27:20.101 [2024-11-19 15:28:18.560028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.560071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.571647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e12d8 00:27:20.101 [2024-11-19 15:28:18.572238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:9852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.572268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.583910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0350 00:27:20.101 [2024-11-19 15:28:18.584483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:24223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.584526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.596128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e0ea0 00:27:20.101 [2024-11-19 15:28:18.596647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.596677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.608237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f8e88 00:27:20.101 [2024-11-19 15:28:18.608752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:24525 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.608782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.620278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ed920 00:27:20.101 [2024-11-19 15:28:18.620754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:25567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.620784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.632279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ef6a8 00:27:20.101 [2024-11-19 15:28:18.632890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.632919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.644214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f3a28 00:27:20.101 [2024-11-19 15:28:18.644866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:11731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.644895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:20.101 [2024-11-19 15:28:18.656204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7538 00:27:20.101 [2024-11-19 15:28:18.656863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:10381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.101 [2024-11-19 15:28:18.656893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.668208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f3e60 00:27:20.359 [2024-11-19 15:28:18.669824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:2563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.359 [2024-11-19 15:28:18.669855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.680508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190fac10 00:27:20.359 [2024-11-19 15:28:18.681807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.359 [2024-11-19 15:28:18.681835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.693609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ea248 00:27:20.359 [2024-11-19 15:28:18.694229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.359 [2024-11-19 15:28:18.694257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.705944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0ff8 00:27:20.359 [2024-11-19 15:28:18.706669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:17474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.359 [2024-11-19 15:28:18.706705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.718022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e0630 00:27:20.359 [2024-11-19 15:28:18.718781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:1063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.359 [2024-11-19 15:28:18.718815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:20.359 [2024-11-19 15:28:18.730163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ea680 00:27:20.360 [2024-11-19 15:28:18.730867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.730896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.742338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f9b30 00:27:20.360 [2024-11-19 15:28:18.743021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:14993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.743051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.754517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190df988 00:27:20.360 [2024-11-19 15:28:18.755178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:24724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.755208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.766417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190dece0 00:27:20.360 [2024-11-19 15:28:18.768165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:12671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.768210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.778657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e0ea0 00:27:20.360 [2024-11-19 15:28:18.780256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:7139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.780304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.790584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f81e0 00:27:20.360 [2024-11-19 15:28:18.791817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.791847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.803078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190ed4e8 00:27:20.360 [2024-11-19 15:28:18.804824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:2455 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.804870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.815571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f7970 00:27:20.360 [2024-11-19 15:28:18.817128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:1835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.817161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.828532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190e8d30 00:27:20.360 [2024-11-19 15:28:18.829320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:12654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.829354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.839223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0788 00:27:20.360 [2024-11-19 15:28:18.840455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:13526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.840489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.851336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f0788 00:27:20.360 [2024-11-19 15:28:18.852736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:13264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.852782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.864754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.360 [2024-11-19 15:28:18.865014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:23102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.865045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.878271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.360 [2024-11-19 15:28:18.878578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14717 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.878608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.891853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.360 [2024-11-19 15:28:18.892116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:13568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.892146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.905077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.360 [2024-11-19 15:28:18.905410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:8759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.905445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.360 [2024-11-19 15:28:18.918912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.360 [2024-11-19 15:28:18.919245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:16822 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.360 [2024-11-19 15:28:18.919277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:18.932342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:18.932643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.618 [2024-11-19 15:28:18.932676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:18.945909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:18.946234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:7981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.618 [2024-11-19 15:28:18.946264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:18.959397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:18.959713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:7215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.618 [2024-11-19 15:28:18.959743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:18.972902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:18.973196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:17545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.618 [2024-11-19 15:28:18.973226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:18.986607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:18.986910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:4682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.618 [2024-11-19 15:28:18.986941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.618 [2024-11-19 15:28:19.000117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.618 [2024-11-19 15:28:19.000430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.000460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.013751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.014014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:24463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.014044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.027261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.027595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:24470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.027624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.040744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.040993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:16438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.041024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.054246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.054552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.054582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.067702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.067969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:5789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.067999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.081075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.081386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:25519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.081417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.094587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.094888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:11002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.094919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.108046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.108370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:17422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.108401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.121541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.121850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:5644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.121881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.135019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.135322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:1940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.135353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.148325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.148638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:6854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.148668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.161666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.161960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:5442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.161991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.619 [2024-11-19 15:28:19.175254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.619 [2024-11-19 15:28:19.175559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.619 [2024-11-19 15:28:19.175595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.188836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.189149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:3576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.189181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.202291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.202606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:11063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.202638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.215846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.216167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.216195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.229254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.229559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:10520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.229589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.242845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.243094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:15229 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.243135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.256266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.256556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.256588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.269699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.269944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:2329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.269974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.283304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.283626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:6224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.283661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.296953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.297244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:21684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.297273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.310550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.310859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:22955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.310890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.324105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.324414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:1630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.324445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.337656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.337945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.337975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.351134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.351443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:12319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.351474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.364599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.364899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:10779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.364930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.378138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.378435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.378465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.391627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.391918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:23663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.391948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.405047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.405367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.405397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.418842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.419156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:9221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.419201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:20.877 [2024-11-19 15:28:19.432446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:20.877 [2024-11-19 15:28:19.432760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:15420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:20.877 [2024-11-19 15:28:19.432791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.445972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.446285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:3473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.446316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.459750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.460014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.460045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.473162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.473452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.473482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.486806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.487092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:22297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.487120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.500677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.500964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.500993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.514390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.514677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:24497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.514716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.528127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.528403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:6897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.528437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.541702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.541996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:19535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.542025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.555331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.555587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.555615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.568830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.569089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:18871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.569122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.582368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.582662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:21980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.582697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.596163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.596447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:12122 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.596477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.609870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.610125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:16338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.610155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.623476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.136 [2024-11-19 15:28:19.623786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.136 [2024-11-19 15:28:19.623816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.136 [2024-11-19 15:28:19.637298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.137 [2024-11-19 15:28:19.637580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.137 [2024-11-19 15:28:19.637626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.137 [2024-11-19 15:28:19.651138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.137 [2024-11-19 15:28:19.651413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:16035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.137 [2024-11-19 15:28:19.651441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.137 [2024-11-19 15:28:19.664988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.137 [2024-11-19 15:28:19.665294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:8281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.137 [2024-11-19 15:28:19.665327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.137 [2024-11-19 15:28:19.678708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.137 [2024-11-19 15:28:19.678980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:21319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.137 [2024-11-19 15:28:19.679010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.137 [2024-11-19 15:28:19.692485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.137 [2024-11-19 15:28:19.692753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5171 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.137 [2024-11-19 15:28:19.692783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.705997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.706279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:10626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.706308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.719836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.720114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:12782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.720144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.733528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.733809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:15106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.733839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.747247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.747542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:2089 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.747575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.760930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.761202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:2627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.761230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.774465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.774749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:11913 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.774777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.787890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.788143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:20158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.788172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.801516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.801805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.801833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.814924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.395 [2024-11-19 15:28:19.815203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:24605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.395 [2024-11-19 15:28:19.815232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.395 [2024-11-19 15:28:19.828564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.828850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:10381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.828880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.842006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.842282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.842311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.855638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.855952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:2768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.855982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.869172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.869469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:14651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.869502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.882956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.883221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:9425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.883250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.896520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.896816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:3048 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.896845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.910039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.910291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:13482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.910320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.923741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.923991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:1206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.924023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.937506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.937808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:3225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.937837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.396 [2024-11-19 15:28:19.951298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.396 [2024-11-19 15:28:19.951584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:3338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.396 [2024-11-19 15:28:19.951613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:19.964955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:19.965260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:9910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:19.965288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:19.978528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:19.978827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11415 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:19.978855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:19.992175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:19.992479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:24477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:19.992508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.006648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.006941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:9618 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.006982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.020534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.020837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.020871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.034891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.035193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:5081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.035224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.048818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.049072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.049102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.062986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.063288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.063318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.076857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.077111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.077140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.090767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.091003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:3173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.091032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.104590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.104887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:8793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.104918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.118468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.118776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:22918 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.118806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.132076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.132388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:22781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.132417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.145752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.146019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:21779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.146047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.159324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.655 [2024-11-19 15:28:20.159639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:6061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.655 [2024-11-19 15:28:20.159672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.655 [2024-11-19 15:28:20.172995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.656 [2024-11-19 15:28:20.173305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:24615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.656 [2024-11-19 15:28:20.173335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.656 [2024-11-19 15:28:20.186697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.656 [2024-11-19 15:28:20.186980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:8183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.656 [2024-11-19 15:28:20.187008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.656 [2024-11-19 15:28:20.200345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1aad0) with pdu=0x2000190f6458 00:27:21.656 [2024-11-19 15:28:20.200599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:21.656 [2024-11-19 15:28:20.200628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:21.656 00:27:21.656 Latency(us) 00:27:21.656 [2024-11-19T14:28:20.219Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.656 [2024-11-19T14:28:20.219Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:21.656 nvme0n1 : 2.01 19594.34 76.54 0.00 0.00 6517.82 2961.26 14563.56 00:27:21.656 [2024-11-19T14:28:20.219Z] =================================================================================================================== 00:27:21.656 [2024-11-19T14:28:20.219Z] Total : 19594.34 76.54 0.00 0.00 6517.82 2961.26 14563.56 00:27:21.656 0 00:27:21.913 15:28:20 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:21.913 15:28:20 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:21.913 15:28:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:21.913 15:28:20 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:21.913 | .driver_specific 00:27:21.913 | .nvme_error 00:27:21.913 | .status_code 00:27:21.913 | .command_transient_transport_error' 00:27:22.171 15:28:20 -- host/digest.sh@71 -- # (( 154 > 0 )) 00:27:22.171 15:28:20 -- host/digest.sh@73 -- # killprocess 2880796 00:27:22.171 15:28:20 -- common/autotest_common.sh@936 -- # '[' -z 2880796 ']' 00:27:22.171 15:28:20 -- common/autotest_common.sh@940 -- # kill -0 2880796 00:27:22.171 15:28:20 -- common/autotest_common.sh@941 -- # uname 00:27:22.171 15:28:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:22.171 15:28:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2880796 00:27:22.171 15:28:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:22.171 15:28:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:22.171 15:28:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2880796' 00:27:22.171 killing process with pid 2880796 00:27:22.171 15:28:20 -- common/autotest_common.sh@955 -- # kill 2880796 00:27:22.171 Received shutdown signal, test time was about 2.000000 seconds 00:27:22.171 00:27:22.171 Latency(us) 00:27:22.172 [2024-11-19T14:28:20.735Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.172 [2024-11-19T14:28:20.735Z] =================================================================================================================== 00:27:22.172 [2024-11-19T14:28:20.735Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:22.172 15:28:20 -- common/autotest_common.sh@960 -- # wait 2880796 00:27:22.430 15:28:20 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:22.430 15:28:20 -- host/digest.sh@54 -- # local rw bs qd 00:27:22.430 15:28:20 -- host/digest.sh@56 -- # rw=randwrite 00:27:22.430 15:28:20 -- host/digest.sh@56 -- # bs=131072 00:27:22.430 15:28:20 -- host/digest.sh@56 -- # qd=16 00:27:22.430 15:28:20 -- host/digest.sh@58 -- # bperfpid=2881319 00:27:22.430 15:28:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:22.430 15:28:20 -- host/digest.sh@60 -- # waitforlisten 2881319 /var/tmp/bperf.sock 00:27:22.430 15:28:20 -- common/autotest_common.sh@829 -- # '[' -z 2881319 ']' 00:27:22.430 15:28:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:22.430 15:28:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:22.430 15:28:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:22.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:22.430 15:28:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:22.430 15:28:20 -- common/autotest_common.sh@10 -- # set +x 00:27:22.430 [2024-11-19 15:28:20.841627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:22.430 [2024-11-19 15:28:20.841726] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2881319 ] 00:27:22.430 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:22.430 Zero copy mechanism will not be used. 00:27:22.430 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.430 [2024-11-19 15:28:20.902926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:22.689 [2024-11-19 15:28:21.017924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:23.253 15:28:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:23.253 15:28:21 -- common/autotest_common.sh@862 -- # return 0 00:27:23.254 15:28:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:23.254 15:28:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:23.512 15:28:22 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:23.512 15:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:23.512 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:23.512 15:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:23.512 15:28:22 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:23.512 15:28:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:24.078 nvme0n1 00:27:24.078 15:28:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:24.078 15:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.078 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:24.078 15:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.078 15:28:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:24.078 15:28:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:24.078 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:24.078 Zero copy mechanism will not be used. 00:27:24.078 Running I/O for 2 seconds... 00:27:24.078 [2024-11-19 15:28:22.621204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.078 [2024-11-19 15:28:22.621540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.078 [2024-11-19 15:28:22.621585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.078 [2024-11-19 15:28:22.626287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.078 [2024-11-19 15:28:22.626467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.078 [2024-11-19 15:28:22.626501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.078 [2024-11-19 15:28:22.631055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.078 [2024-11-19 15:28:22.631182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.078 [2024-11-19 15:28:22.631215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.078 [2024-11-19 15:28:22.635843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.078 [2024-11-19 15:28:22.636067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.078 [2024-11-19 15:28:22.636100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.641012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.641176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.641208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.646106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.646258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.646290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.651258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.651484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.651516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.656675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.656910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.656946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.661987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.662271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.662304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.667215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.667413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.667445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.672442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.672591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.672624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.677629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.677782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.677811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.682843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.682978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.683022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.688210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.688366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.688399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.693368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.693573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.693604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.698613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.698868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.698896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.703843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.704074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.704107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.709078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.709363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.709396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.714131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.714408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.714441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.719200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.719366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.719397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.724230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.724380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.724411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.729614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.729822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.729851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.734718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.734933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.734962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.740126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.740382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.740413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.338 [2024-11-19 15:28:22.745642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.338 [2024-11-19 15:28:22.745920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.338 [2024-11-19 15:28:22.745949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.750784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.750982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.751010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.756049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.756301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.756332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.761247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.761499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.761532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.766517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.766682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.766735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.771784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.771939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.771984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.776827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.777020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.777051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.781917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.782100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.782131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.787211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.787457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.787488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.792399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.792687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.792748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.797504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.797735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.797765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.802685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.802864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.802891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.807783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.807939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.807967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.812921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.813102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.813130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.817975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.818146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.818175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.823079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.823254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.823283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.828126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.828396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.828426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.833343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.833606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.833636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.838441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.838611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.838641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.843631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.843790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.843818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.848728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.848859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.848887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.853783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.853914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.339 [2024-11-19 15:28:22.853942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.339 [2024-11-19 15:28:22.858831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.339 [2024-11-19 15:28:22.858995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.859023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.863948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.864123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.864152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.869050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.869257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.869285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.874092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.874362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.874391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.879006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.879239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.879267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.884019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.884180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.884208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.889105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.889292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.889320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.340 [2024-11-19 15:28:22.894190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.340 [2024-11-19 15:28:22.894346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.340 [2024-11-19 15:28:22.894375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.599 [2024-11-19 15:28:22.899219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.599 [2024-11-19 15:28:22.899399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.599 [2024-11-19 15:28:22.899430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.599 [2024-11-19 15:28:22.904349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.599 [2024-11-19 15:28:22.904537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.599 [2024-11-19 15:28:22.904566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.599 [2024-11-19 15:28:22.909033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.599 [2024-11-19 15:28:22.909232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.599 [2024-11-19 15:28:22.909261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.599 [2024-11-19 15:28:22.913343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.599 [2024-11-19 15:28:22.913555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.599 [2024-11-19 15:28:22.913583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.917920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.918085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.918114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.922396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.922565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.922600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.926921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.927136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.927166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.931502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.931687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.931724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.936123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.936258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.936286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.940489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.940623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.940652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.945278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.945463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.945490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.950500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.950801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.950830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.955387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.955583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.955613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.959794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.959972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.960007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.964407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.964581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.964610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.969049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.969228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.969257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.973608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.973729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.973757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.978231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.978408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.978437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.982744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.982928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.982956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.987245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.987495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.987523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.991836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.992043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.992073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:22.996345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:22.996478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:22.996506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.001434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.001555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.001589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.006615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.006775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.006804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.011518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.011594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.011622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.016571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.016679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.016716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.021657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.021830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.021858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.026484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.026669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.026706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.031470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.031604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.031633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.036256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.600 [2024-11-19 15:28:23.036341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.600 [2024-11-19 15:28:23.036369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.600 [2024-11-19 15:28:23.041249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.041387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.041415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.046032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.046174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.046202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.050767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.050851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.050879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.055618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.055758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.055787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.060279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.060420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.060449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.064480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.064703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.064733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.068670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.068824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.068852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.072714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.072828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.072858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.076822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.076979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.077007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.080792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.080898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.080926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.084814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.084941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.084969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.088870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.088994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.089023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.093076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.093238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.093266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.097211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.097427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.097455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.101346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.101494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.101523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.105489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.105600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.105643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.110208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.110332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.110360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.114655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.114838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.114866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.118910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.119020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.119068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.123215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.123370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.123398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.127568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.127719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.127755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.131747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.131968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.131996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.136043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.136189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.136219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.140327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.140448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.140477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.144492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.144662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.144702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.148780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.148883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.148911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.601 [2024-11-19 15:28:23.153106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.601 [2024-11-19 15:28:23.153252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.601 [2024-11-19 15:28:23.153281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.602 [2024-11-19 15:28:23.157512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.602 [2024-11-19 15:28:23.157632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.602 [2024-11-19 15:28:23.157661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.161582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.161795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.161834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.165904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.166111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.166140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.170287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.170467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.170510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.175285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.175378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.175406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.179717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.179831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.179859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.183902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.184006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.184035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.188205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.188349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.188377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.192399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.192515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.192543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.196659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.196807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.196836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.200973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.201188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.861 [2024-11-19 15:28:23.201217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.861 [2024-11-19 15:28:23.205088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.861 [2024-11-19 15:28:23.205251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.205279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.209234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.209369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.209413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.213464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.213603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.213631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.217568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.217706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.217734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.221823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.221958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.221986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.225938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.226058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.226086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.230238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.230395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.230428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.234515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.234727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.234756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.238726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.238879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.238907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.242862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.242973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.243002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.247026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.247211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.247239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.251090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.251199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.251227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.255232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.255384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.255413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.259307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.259448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.259476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.263729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.263867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.263895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.268771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.268957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.268984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.273049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.273206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.273235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.277141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.277247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.277275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.281432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.281589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.281618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.285686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.285837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.285865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.289830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.289972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.290000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.293952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.294040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.294068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.298211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.298384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.298412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.302547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.302768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.302797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.306791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.306963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.306992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.310963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.311103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.311130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.315290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.862 [2024-11-19 15:28:23.315399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.862 [2024-11-19 15:28:23.315427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.862 [2024-11-19 15:28:23.319589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.319715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.319745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.323774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.323889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.323917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.327879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.327993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.328022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.332234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.332388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.332416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.336489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.336708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.336736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.340807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.340976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.341009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.344971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.345092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.345134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.349262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.349377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.349405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.353562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.353659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.353694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.357797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.357895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.357923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.362141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.362272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.362300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.367197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.367357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.367386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.372341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.372622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.372650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.377644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.377875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.377905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.383556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.383751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.383780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.388635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.388828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.388856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.393844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.394010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.394038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.399257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.399444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.399472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.404550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.404815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.404844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.409727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.409896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.409925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.415125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.415395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.415424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:24.863 [2024-11-19 15:28:23.420339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:24.863 [2024-11-19 15:28:23.420502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.863 [2024-11-19 15:28:23.420531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.425435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.425614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.425643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.430684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.430826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.430855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.435766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.435932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.435960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.441171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.441343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.441370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.446304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.446509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.446536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.451512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.451709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.451738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.456414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.456645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.456674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.461092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.461272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.461300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.466215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.466415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.466442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.471368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.471542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.471575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.476520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.476730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.476759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.481630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.481784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.481812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.486854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.486993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.487021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.491952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.492109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.492137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.497105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.497292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.497319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.502262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.502528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.502556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.507420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.123 [2024-11-19 15:28:23.507633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.123 [2024-11-19 15:28:23.507662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.123 [2024-11-19 15:28:23.512493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.512649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.512679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.517854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.518034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.518064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.523091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.523272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.523303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.528274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.528471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.528502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.533503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.533697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.533726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.538657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.538937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.538965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.543879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.544164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.544195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.549288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.549512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.549541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.554609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.554856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.554884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.559891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.560065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.560095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.565063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.565231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.565261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.570286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.570449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.570479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.575565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.575819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.575848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.580963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.581226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.581257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.586156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.586398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.586428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.591453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.591656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.591703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.596749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.596876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.596904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.601942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.602128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.602157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.607141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.607297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.607331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.612466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.612624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.612654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.617678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.617848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.617876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.622940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.623243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.623272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.628071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.628314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.628345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.633256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.633436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.633465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.638525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.638665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.638702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.643735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.643865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.643893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.648895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.649072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.124 [2024-11-19 15:28:23.649100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.124 [2024-11-19 15:28:23.654126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.124 [2024-11-19 15:28:23.654297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.654326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.125 [2024-11-19 15:28:23.659250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.125 [2024-11-19 15:28:23.659435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.659464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.125 [2024-11-19 15:28:23.664667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.125 [2024-11-19 15:28:23.664921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.664949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.125 [2024-11-19 15:28:23.669936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.125 [2024-11-19 15:28:23.670278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.670307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.125 [2024-11-19 15:28:23.675389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.125 [2024-11-19 15:28:23.675575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.675604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.125 [2024-11-19 15:28:23.680639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.125 [2024-11-19 15:28:23.680813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.125 [2024-11-19 15:28:23.680841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.384 [2024-11-19 15:28:23.685830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.384 [2024-11-19 15:28:23.686032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.384 [2024-11-19 15:28:23.686062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.384 [2024-11-19 15:28:23.691086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.384 [2024-11-19 15:28:23.691230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.384 [2024-11-19 15:28:23.691259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.384 [2024-11-19 15:28:23.696371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.384 [2024-11-19 15:28:23.696621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.384 [2024-11-19 15:28:23.696651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.384 [2024-11-19 15:28:23.701566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.384 [2024-11-19 15:28:23.701788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.384 [2024-11-19 15:28:23.701817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.384 [2024-11-19 15:28:23.706987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.384 [2024-11-19 15:28:23.707242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.384 [2024-11-19 15:28:23.707273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.712304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.712559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.712589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.717605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.717856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.717884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.722795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.723023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.723054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.727918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.728098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.728128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.733267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.733411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.733442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.738538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.738807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.738835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.743732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.743967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.744000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.749120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.749408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.749438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.754202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.754500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.754531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.759598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.759808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.759836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.764851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.765030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.765059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.770013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.770138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.770167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.775160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.775316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.775345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.780431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.780716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.780760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.785609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.785795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.785823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.791553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.791854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.791883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.796551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.796807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.796835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.801219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.801434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.801465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.806142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.806301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.806331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.811016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.811145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.811174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.816083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.816201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.816230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.821094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.821273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.821301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.825844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.826035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.826064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.830872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.831077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.831110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.835615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.835775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.835804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.840223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.840375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.840402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.385 [2024-11-19 15:28:23.844753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.385 [2024-11-19 15:28:23.844884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.385 [2024-11-19 15:28:23.844912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.849366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.849534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.849561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.854704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.854801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.854829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.858791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.858950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.858978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.862918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.863039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.863067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.867284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.867514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.867542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.871530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.871774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.871803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.875861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.876039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.876067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.879941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.880073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.880100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.884993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.885155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.885183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.889586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.889683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.889719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.893920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.894065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.894094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.898167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.898359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.898388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.902441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.902661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.902698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.906792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.906987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.907016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.911847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.911995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.912024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.916206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.916308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.916337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.920505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.920617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.920645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.924740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.924871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.924899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.929208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.929405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.929434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.933815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.933945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.933973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.938175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.938374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.938402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.386 [2024-11-19 15:28:23.942271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.386 [2024-11-19 15:28:23.942460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.386 [2024-11-19 15:28:23.942504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.946507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.946683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.946728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.950745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.950875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.950903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.954937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.955086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.955114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.959491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.959600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.959629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.963722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.963888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.963917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.967855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.968031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.968059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.972476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.972686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.972723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.976871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.977057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.977086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.981307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.981471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.981499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.985631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.985770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.985798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.989944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.990059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.646 [2024-11-19 15:28:23.990086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.646 [2024-11-19 15:28:23.994261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.646 [2024-11-19 15:28:23.994373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:23.994401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:23.998548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:23.998743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:23.998771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.002896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.003028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.003060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.007213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.007417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.007447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.011464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.011663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.011698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.015730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.015898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.015927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.019969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.020092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.020120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.024152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.024362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.024390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.028388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.028523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.028550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.032821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.033026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.033054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.037531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.037667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.037705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.042337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.042555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.042583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.046677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.046885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.046913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.050971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.051132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.051160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.055174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.055315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.055343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.059284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.059420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.059453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.063378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.063512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.063540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.067636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.067788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.067817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.071793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.071943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.071972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.076179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.076399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.076428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.080354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.080562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.080590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.084513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.084732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.084761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.088772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.088897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.088925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.092862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.092978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.093006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.097013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.097113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.097139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.101279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.101428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.101456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.105475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.105590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.647 [2024-11-19 15:28:24.105619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.647 [2024-11-19 15:28:24.109978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.647 [2024-11-19 15:28:24.110173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.110201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.114339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.114510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.114537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.118701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.118843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.118872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.122846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.122961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.122989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.126938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.127045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.127073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.131059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.131197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.131224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.135966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.136118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.136147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.140675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.140818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.140846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.144881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.145108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.145137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.149384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.149604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.149632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.153806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.154023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.154051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.158576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.158754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.158783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.163779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.163922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.163960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.169492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.169639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.169666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.175030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.175133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.175167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.179635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.179752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.179780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.184528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.184756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.184785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.189253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.189443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.189471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.194055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.194287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.194316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.198944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.199060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.199088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.648 [2024-11-19 15:28:24.203750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.648 [2024-11-19 15:28:24.203906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.648 [2024-11-19 15:28:24.203935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.208430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.208536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.208564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.213284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.213479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.213508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.217976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.218121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.218150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.222218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.222418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.222447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.226321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.226457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.226485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.230433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.230569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.230598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.234986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.235125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.235153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.239567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.239668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.239704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.243942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.244082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.244109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.248971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.249128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.249157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.253257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.253410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.253438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.257572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.257805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.257834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.261898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.262036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.262064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.908 [2024-11-19 15:28:24.266112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.908 [2024-11-19 15:28:24.266299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.908 [2024-11-19 15:28:24.266328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.270486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.270599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.270627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.274745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.274857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.274886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.279011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.279111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.279138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.283219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.283398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.283426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.287469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.287588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.287616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.291832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.292065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.292099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.296086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.296304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.296332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.300501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.300673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.300709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.304802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.304935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.304964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.309035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.309155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.309184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.313184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.313352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.313380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.317457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.317615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.317643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.321655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.321795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.321824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.325948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.326164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.326192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.330146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.330397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.330426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.334584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.334778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.334808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.339385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.339548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.339576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.344432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.344628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.344655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.349074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.349177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.349204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.354144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.354349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.354377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.359040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.359182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.359211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.364018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.364240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.364268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.368777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.368947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.368975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.373724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.373937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.373966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.378552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.378644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.378670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.383594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.383683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.383716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.909 [2024-11-19 15:28:24.388685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.909 [2024-11-19 15:28:24.388797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.909 [2024-11-19 15:28:24.388825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.393626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.393777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.393806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.398582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.398736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.398764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.403571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.403798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.403827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.408469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.408619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.408650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.413276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.413425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.413459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.418197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.418280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.418306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.423082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.423252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.423281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.427920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.428037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.428065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.432793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.432945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.432974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.437628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.437750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.437778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.442621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.442825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.442854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.447186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.447372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.447400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.452173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.452350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.452379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.456935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.457081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.457109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.461880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.461975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.462003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:25.910 [2024-11-19 15:28:24.466883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:25.910 [2024-11-19 15:28:24.466989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.910 [2024-11-19 15:28:24.467017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.169 [2024-11-19 15:28:24.471725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.169 [2024-11-19 15:28:24.471866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.169 [2024-11-19 15:28:24.471895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.169 [2024-11-19 15:28:24.476391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.169 [2024-11-19 15:28:24.476540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.169 [2024-11-19 15:28:24.476570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.169 [2024-11-19 15:28:24.481340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.169 [2024-11-19 15:28:24.481541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.169 [2024-11-19 15:28:24.481570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.169 [2024-11-19 15:28:24.486283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.169 [2024-11-19 15:28:24.486482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.169 [2024-11-19 15:28:24.486512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.169 [2024-11-19 15:28:24.491199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.491400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.491430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.496043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.496179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.496213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.500869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.501026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.501055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.505837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.505915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.505943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.510633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.510777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.510807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.515425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.515561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.515590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.520625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.520832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.520861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.525772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.525925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.525953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.530625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.530819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.530848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.535410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.535538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.535566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.540378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.540495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.540523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.545236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.545318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.545345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.550025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.550186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.550214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.554901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.555023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.555052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.560006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.560228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.560256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.564759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.564935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.564963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.569637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.569831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.569859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.574652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.574799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.574827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.579449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.579545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.579573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.584270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.584391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.584418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.589071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.589225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.589253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.593853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.593997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.594025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.599014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.599213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.599241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.603972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.604150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.604178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.608914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.609091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.609120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.613722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.613845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.613873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:26.170 [2024-11-19 15:28:24.618599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe1afb0) with pdu=0x2000190fef90 00:27:26.170 [2024-11-19 15:28:24.618725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:26.170 [2024-11-19 15:28:24.618752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:26.170 00:27:26.170 Latency(us) 00:27:26.170 [2024-11-19T14:28:24.734Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:26.171 [2024-11-19T14:28:24.734Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:26.171 nvme0n1 : 2.00 6540.84 817.61 0.00 0.00 2439.12 1747.63 6213.78 00:27:26.171 [2024-11-19T14:28:24.734Z] =================================================================================================================== 00:27:26.171 [2024-11-19T14:28:24.734Z] Total : 6540.84 817.61 0.00 0.00 2439.12 1747.63 6213.78 00:27:26.171 0 00:27:26.171 15:28:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:26.171 15:28:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:26.171 15:28:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:26.171 | .driver_specific 00:27:26.171 | .nvme_error 00:27:26.171 | .status_code 00:27:26.171 | .command_transient_transport_error' 00:27:26.171 15:28:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:26.429 15:28:24 -- host/digest.sh@71 -- # (( 422 > 0 )) 00:27:26.429 15:28:24 -- host/digest.sh@73 -- # killprocess 2881319 00:27:26.429 15:28:24 -- common/autotest_common.sh@936 -- # '[' -z 2881319 ']' 00:27:26.429 15:28:24 -- common/autotest_common.sh@940 -- # kill -0 2881319 00:27:26.429 15:28:24 -- common/autotest_common.sh@941 -- # uname 00:27:26.429 15:28:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:26.429 15:28:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2881319 00:27:26.429 15:28:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:26.429 15:28:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:26.429 15:28:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2881319' 00:27:26.429 killing process with pid 2881319 00:27:26.429 15:28:24 -- common/autotest_common.sh@955 -- # kill 2881319 00:27:26.429 Received shutdown signal, test time was about 2.000000 seconds 00:27:26.429 00:27:26.429 Latency(us) 00:27:26.429 [2024-11-19T14:28:24.992Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:26.429 [2024-11-19T14:28:24.992Z] =================================================================================================================== 00:27:26.429 [2024-11-19T14:28:24.992Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:26.429 15:28:24 -- common/autotest_common.sh@960 -- # wait 2881319 00:27:26.687 15:28:25 -- host/digest.sh@115 -- # killprocess 2879548 00:27:26.687 15:28:25 -- common/autotest_common.sh@936 -- # '[' -z 2879548 ']' 00:27:26.687 15:28:25 -- common/autotest_common.sh@940 -- # kill -0 2879548 00:27:26.687 15:28:25 -- common/autotest_common.sh@941 -- # uname 00:27:26.687 15:28:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:26.687 15:28:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879548 00:27:26.687 15:28:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:26.687 15:28:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:26.687 15:28:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879548' 00:27:26.687 killing process with pid 2879548 00:27:26.687 15:28:25 -- common/autotest_common.sh@955 -- # kill 2879548 00:27:26.687 15:28:25 -- common/autotest_common.sh@960 -- # wait 2879548 00:27:26.945 00:27:26.945 real 0m18.725s 00:27:26.945 user 0m38.417s 00:27:26.945 sys 0m4.410s 00:27:26.945 15:28:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:26.945 15:28:25 -- common/autotest_common.sh@10 -- # set +x 00:27:26.945 ************************************ 00:27:26.945 END TEST nvmf_digest_error 00:27:26.945 ************************************ 00:27:27.204 15:28:25 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:27.204 15:28:25 -- host/digest.sh@139 -- # nvmftestfini 00:27:27.204 15:28:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:27.204 15:28:25 -- nvmf/common.sh@116 -- # sync 00:27:27.204 15:28:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:27.204 15:28:25 -- nvmf/common.sh@119 -- # set +e 00:27:27.204 15:28:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:27.204 15:28:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:27.204 rmmod nvme_tcp 00:27:27.204 rmmod nvme_fabrics 00:27:27.204 rmmod nvme_keyring 00:27:27.204 15:28:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:27.204 15:28:25 -- nvmf/common.sh@123 -- # set -e 00:27:27.204 15:28:25 -- nvmf/common.sh@124 -- # return 0 00:27:27.204 15:28:25 -- nvmf/common.sh@477 -- # '[' -n 2879548 ']' 00:27:27.204 15:28:25 -- nvmf/common.sh@478 -- # killprocess 2879548 00:27:27.204 15:28:25 -- common/autotest_common.sh@936 -- # '[' -z 2879548 ']' 00:27:27.204 15:28:25 -- common/autotest_common.sh@940 -- # kill -0 2879548 00:27:27.204 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2879548) - No such process 00:27:27.204 15:28:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2879548 is not found' 00:27:27.204 Process with pid 2879548 is not found 00:27:27.204 15:28:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:27.204 15:28:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:27.204 15:28:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:27.204 15:28:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:27.204 15:28:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:27.204 15:28:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:27.204 15:28:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:27.204 15:28:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:29.106 15:28:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:29.106 00:27:29.106 real 0m38.694s 00:27:29.106 user 1m10.282s 00:27:29.106 sys 0m10.180s 00:27:29.106 15:28:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:29.106 15:28:27 -- common/autotest_common.sh@10 -- # set +x 00:27:29.106 ************************************ 00:27:29.106 END TEST nvmf_digest 00:27:29.106 ************************************ 00:27:29.106 15:28:27 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:29.106 15:28:27 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:29.106 15:28:27 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:29.106 15:28:27 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:29.106 15:28:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:29.106 15:28:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:29.106 15:28:27 -- common/autotest_common.sh@10 -- # set +x 00:27:29.106 ************************************ 00:27:29.106 START TEST nvmf_bdevperf 00:27:29.106 ************************************ 00:27:29.106 15:28:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:29.364 * Looking for test storage... 00:27:29.364 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:29.364 15:28:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:29.364 15:28:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:29.364 15:28:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:29.364 15:28:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:29.364 15:28:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:29.365 15:28:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:29.365 15:28:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:29.365 15:28:27 -- scripts/common.sh@335 -- # IFS=.-: 00:27:29.365 15:28:27 -- scripts/common.sh@335 -- # read -ra ver1 00:27:29.365 15:28:27 -- scripts/common.sh@336 -- # IFS=.-: 00:27:29.365 15:28:27 -- scripts/common.sh@336 -- # read -ra ver2 00:27:29.365 15:28:27 -- scripts/common.sh@337 -- # local 'op=<' 00:27:29.365 15:28:27 -- scripts/common.sh@339 -- # ver1_l=2 00:27:29.365 15:28:27 -- scripts/common.sh@340 -- # ver2_l=1 00:27:29.365 15:28:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:29.365 15:28:27 -- scripts/common.sh@343 -- # case "$op" in 00:27:29.365 15:28:27 -- scripts/common.sh@344 -- # : 1 00:27:29.365 15:28:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:29.365 15:28:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:29.365 15:28:27 -- scripts/common.sh@364 -- # decimal 1 00:27:29.365 15:28:27 -- scripts/common.sh@352 -- # local d=1 00:27:29.365 15:28:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:29.365 15:28:27 -- scripts/common.sh@354 -- # echo 1 00:27:29.365 15:28:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:29.365 15:28:27 -- scripts/common.sh@365 -- # decimal 2 00:27:29.365 15:28:27 -- scripts/common.sh@352 -- # local d=2 00:27:29.365 15:28:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:29.365 15:28:27 -- scripts/common.sh@354 -- # echo 2 00:27:29.365 15:28:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:29.365 15:28:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:29.365 15:28:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:29.365 15:28:27 -- scripts/common.sh@367 -- # return 0 00:27:29.365 15:28:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:29.365 15:28:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:29.365 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:29.365 --rc genhtml_branch_coverage=1 00:27:29.365 --rc genhtml_function_coverage=1 00:27:29.365 --rc genhtml_legend=1 00:27:29.365 --rc geninfo_all_blocks=1 00:27:29.365 --rc geninfo_unexecuted_blocks=1 00:27:29.365 00:27:29.365 ' 00:27:29.365 15:28:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:29.365 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:29.365 --rc genhtml_branch_coverage=1 00:27:29.365 --rc genhtml_function_coverage=1 00:27:29.365 --rc genhtml_legend=1 00:27:29.365 --rc geninfo_all_blocks=1 00:27:29.365 --rc geninfo_unexecuted_blocks=1 00:27:29.365 00:27:29.365 ' 00:27:29.365 15:28:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:29.365 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:29.365 --rc genhtml_branch_coverage=1 00:27:29.365 --rc genhtml_function_coverage=1 00:27:29.365 --rc genhtml_legend=1 00:27:29.365 --rc geninfo_all_blocks=1 00:27:29.365 --rc geninfo_unexecuted_blocks=1 00:27:29.365 00:27:29.365 ' 00:27:29.365 15:28:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:29.365 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:29.365 --rc genhtml_branch_coverage=1 00:27:29.365 --rc genhtml_function_coverage=1 00:27:29.365 --rc genhtml_legend=1 00:27:29.365 --rc geninfo_all_blocks=1 00:27:29.365 --rc geninfo_unexecuted_blocks=1 00:27:29.365 00:27:29.365 ' 00:27:29.365 15:28:27 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:29.365 15:28:27 -- nvmf/common.sh@7 -- # uname -s 00:27:29.365 15:28:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:29.365 15:28:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:29.365 15:28:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:29.365 15:28:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:29.365 15:28:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:29.365 15:28:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:29.365 15:28:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:29.365 15:28:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:29.365 15:28:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:29.365 15:28:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:29.365 15:28:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:29.365 15:28:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:29.365 15:28:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:29.365 15:28:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:29.365 15:28:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:29.365 15:28:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:29.365 15:28:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:29.365 15:28:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:29.365 15:28:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:29.365 15:28:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:29.365 15:28:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:29.365 15:28:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:29.365 15:28:27 -- paths/export.sh@5 -- # export PATH 00:27:29.365 15:28:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:29.365 15:28:27 -- nvmf/common.sh@46 -- # : 0 00:27:29.365 15:28:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:29.365 15:28:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:29.365 15:28:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:29.365 15:28:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:29.365 15:28:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:29.365 15:28:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:29.365 15:28:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:29.365 15:28:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:29.365 15:28:27 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:29.365 15:28:27 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:29.365 15:28:27 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:29.365 15:28:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:29.365 15:28:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:29.365 15:28:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:29.365 15:28:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:29.365 15:28:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:29.365 15:28:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:29.365 15:28:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:29.365 15:28:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:29.365 15:28:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:29.365 15:28:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:29.365 15:28:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:29.365 15:28:27 -- common/autotest_common.sh@10 -- # set +x 00:27:31.268 15:28:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:31.268 15:28:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:31.268 15:28:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:31.268 15:28:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:31.268 15:28:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:31.268 15:28:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:31.268 15:28:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:31.268 15:28:29 -- nvmf/common.sh@294 -- # net_devs=() 00:27:31.268 15:28:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:31.268 15:28:29 -- nvmf/common.sh@295 -- # e810=() 00:27:31.268 15:28:29 -- nvmf/common.sh@295 -- # local -ga e810 00:27:31.268 15:28:29 -- nvmf/common.sh@296 -- # x722=() 00:27:31.268 15:28:29 -- nvmf/common.sh@296 -- # local -ga x722 00:27:31.268 15:28:29 -- nvmf/common.sh@297 -- # mlx=() 00:27:31.268 15:28:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:31.268 15:28:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:31.268 15:28:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:31.268 15:28:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:31.268 15:28:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:31.268 15:28:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:31.268 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:31.268 15:28:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:31.268 15:28:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:31.268 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:31.268 15:28:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:31.268 15:28:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:31.268 15:28:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:31.268 15:28:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:31.268 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:31.268 15:28:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:31.268 15:28:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:31.268 15:28:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:31.268 15:28:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:31.268 15:28:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:31.268 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:31.268 15:28:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:31.268 15:28:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:31.268 15:28:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:31.268 15:28:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:31.268 15:28:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:31.268 15:28:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:31.268 15:28:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:31.268 15:28:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:31.268 15:28:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:31.268 15:28:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:31.268 15:28:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:31.268 15:28:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:31.268 15:28:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:31.268 15:28:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:31.268 15:28:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:31.268 15:28:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:31.268 15:28:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:31.268 15:28:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:31.268 15:28:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:31.268 15:28:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:31.268 15:28:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:31.268 15:28:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:31.527 15:28:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:31.527 15:28:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:31.527 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:31.527 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:27:31.527 00:27:31.527 --- 10.0.0.2 ping statistics --- 00:27:31.527 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:31.527 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:27:31.527 15:28:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:31.527 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:31.527 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:27:31.527 00:27:31.527 --- 10.0.0.1 ping statistics --- 00:27:31.527 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:31.527 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:27:31.527 15:28:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:31.527 15:28:29 -- nvmf/common.sh@410 -- # return 0 00:27:31.527 15:28:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:31.527 15:28:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:31.527 15:28:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:31.527 15:28:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:31.527 15:28:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:31.527 15:28:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:31.527 15:28:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:31.527 15:28:29 -- host/bdevperf.sh@25 -- # tgt_init 00:27:31.527 15:28:29 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:31.527 15:28:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:31.527 15:28:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:31.527 15:28:29 -- common/autotest_common.sh@10 -- # set +x 00:27:31.527 15:28:29 -- nvmf/common.sh@469 -- # nvmfpid=2883806 00:27:31.527 15:28:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:31.527 15:28:29 -- nvmf/common.sh@470 -- # waitforlisten 2883806 00:27:31.527 15:28:29 -- common/autotest_common.sh@829 -- # '[' -z 2883806 ']' 00:27:31.527 15:28:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:31.527 15:28:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:31.527 15:28:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:31.527 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:31.527 15:28:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:31.527 15:28:29 -- common/autotest_common.sh@10 -- # set +x 00:27:31.527 [2024-11-19 15:28:29.911137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:31.527 [2024-11-19 15:28:29.911210] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:31.527 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.527 [2024-11-19 15:28:29.981123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:31.785 [2024-11-19 15:28:30.104833] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:31.785 [2024-11-19 15:28:30.105005] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:31.785 [2024-11-19 15:28:30.105022] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:31.785 [2024-11-19 15:28:30.105034] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:31.785 [2024-11-19 15:28:30.105086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:31.785 [2024-11-19 15:28:30.105303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:31.785 [2024-11-19 15:28:30.105308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:32.483 15:28:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:32.483 15:28:30 -- common/autotest_common.sh@862 -- # return 0 00:27:32.483 15:28:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:32.483 15:28:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:32.483 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.483 15:28:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:32.483 15:28:30 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:32.483 15:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:32.483 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.483 [2024-11-19 15:28:30.897778] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:32.483 15:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:32.483 15:28:30 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:32.483 15:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:32.483 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.483 Malloc0 00:27:32.483 15:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:32.483 15:28:30 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:32.483 15:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:32.483 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.483 15:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:32.483 15:28:30 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:32.483 15:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:32.483 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.484 15:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:32.484 15:28:30 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:32.484 15:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:32.484 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:27:32.484 [2024-11-19 15:28:30.956161] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:32.484 15:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:32.484 15:28:30 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:32.484 15:28:30 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:32.484 15:28:30 -- nvmf/common.sh@520 -- # config=() 00:27:32.484 15:28:30 -- nvmf/common.sh@520 -- # local subsystem config 00:27:32.484 15:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:32.484 15:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:32.484 { 00:27:32.484 "params": { 00:27:32.484 "name": "Nvme$subsystem", 00:27:32.484 "trtype": "$TEST_TRANSPORT", 00:27:32.484 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:32.484 "adrfam": "ipv4", 00:27:32.484 "trsvcid": "$NVMF_PORT", 00:27:32.484 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:32.484 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:32.484 "hdgst": ${hdgst:-false}, 00:27:32.484 "ddgst": ${ddgst:-false} 00:27:32.484 }, 00:27:32.484 "method": "bdev_nvme_attach_controller" 00:27:32.484 } 00:27:32.484 EOF 00:27:32.484 )") 00:27:32.484 15:28:30 -- nvmf/common.sh@542 -- # cat 00:27:32.484 15:28:30 -- nvmf/common.sh@544 -- # jq . 00:27:32.484 15:28:30 -- nvmf/common.sh@545 -- # IFS=, 00:27:32.484 15:28:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:32.484 "params": { 00:27:32.484 "name": "Nvme1", 00:27:32.484 "trtype": "tcp", 00:27:32.484 "traddr": "10.0.0.2", 00:27:32.484 "adrfam": "ipv4", 00:27:32.484 "trsvcid": "4420", 00:27:32.484 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:32.484 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:32.484 "hdgst": false, 00:27:32.484 "ddgst": false 00:27:32.484 }, 00:27:32.484 "method": "bdev_nvme_attach_controller" 00:27:32.484 }' 00:27:32.484 [2024-11-19 15:28:30.999150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:32.484 [2024-11-19 15:28:30.999239] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2883928 ] 00:27:32.742 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.742 [2024-11-19 15:28:31.062814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:32.742 [2024-11-19 15:28:31.170003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:32.999 Running I/O for 1 seconds... 00:27:33.931 00:27:33.931 Latency(us) 00:27:33.931 [2024-11-19T14:28:32.494Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:33.931 [2024-11-19T14:28:32.494Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:33.931 Verification LBA range: start 0x0 length 0x4000 00:27:33.931 Nvme1n1 : 1.01 13012.25 50.83 0.00 0.00 9791.53 1298.58 16019.91 00:27:33.931 [2024-11-19T14:28:32.494Z] =================================================================================================================== 00:27:33.931 [2024-11-19T14:28:32.494Z] Total : 13012.25 50.83 0.00 0.00 9791.53 1298.58 16019.91 00:27:34.189 15:28:32 -- host/bdevperf.sh@30 -- # bdevperfpid=2884171 00:27:34.189 15:28:32 -- host/bdevperf.sh@32 -- # sleep 3 00:27:34.189 15:28:32 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:34.189 15:28:32 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:34.189 15:28:32 -- nvmf/common.sh@520 -- # config=() 00:27:34.189 15:28:32 -- nvmf/common.sh@520 -- # local subsystem config 00:27:34.189 15:28:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:34.189 15:28:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:34.189 { 00:27:34.189 "params": { 00:27:34.189 "name": "Nvme$subsystem", 00:27:34.189 "trtype": "$TEST_TRANSPORT", 00:27:34.189 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:34.189 "adrfam": "ipv4", 00:27:34.189 "trsvcid": "$NVMF_PORT", 00:27:34.189 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:34.189 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:34.189 "hdgst": ${hdgst:-false}, 00:27:34.189 "ddgst": ${ddgst:-false} 00:27:34.189 }, 00:27:34.189 "method": "bdev_nvme_attach_controller" 00:27:34.189 } 00:27:34.189 EOF 00:27:34.189 )") 00:27:34.189 15:28:32 -- nvmf/common.sh@542 -- # cat 00:27:34.189 15:28:32 -- nvmf/common.sh@544 -- # jq . 00:27:34.189 15:28:32 -- nvmf/common.sh@545 -- # IFS=, 00:27:34.189 15:28:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:34.189 "params": { 00:27:34.189 "name": "Nvme1", 00:27:34.189 "trtype": "tcp", 00:27:34.189 "traddr": "10.0.0.2", 00:27:34.189 "adrfam": "ipv4", 00:27:34.190 "trsvcid": "4420", 00:27:34.190 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:34.190 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:34.190 "hdgst": false, 00:27:34.190 "ddgst": false 00:27:34.190 }, 00:27:34.190 "method": "bdev_nvme_attach_controller" 00:27:34.190 }' 00:27:34.190 [2024-11-19 15:28:32.675194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:34.190 [2024-11-19 15:28:32.675276] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2884171 ] 00:27:34.190 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.190 [2024-11-19 15:28:32.735428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:34.448 [2024-11-19 15:28:32.841345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:34.705 Running I/O for 15 seconds... 00:27:37.236 15:28:35 -- host/bdevperf.sh@33 -- # kill -9 2883806 00:27:37.236 15:28:35 -- host/bdevperf.sh@35 -- # sleep 3 00:27:37.236 [2024-11-19 15:28:35.650752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:129824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.650803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.650834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:129312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.650852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.650872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:129328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.650888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.650905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:129336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.650920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.650937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:129360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.650953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.650985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:129384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:129400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:129424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:129872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:129880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:129888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:129904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:129912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:129928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:129936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:129944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:129968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:129976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.236 [2024-11-19 15:28:35.651492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:129984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.236 [2024-11-19 15:28:35.651510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:130000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:130008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:129432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:129448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:129480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:129512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:129520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:129552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:129560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:130016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:130024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:130056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.651952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.651986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:130064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:130072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:130088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:130104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:130112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:130120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:130128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:129592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:129600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:129616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:129624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:129632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:129640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:130136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:130144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:130152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:130160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:130168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:130176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:130184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:130192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:130200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:130208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.237 [2024-11-19 15:28:35.652816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:130216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.237 [2024-11-19 15:28:35.652845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.237 [2024-11-19 15:28:35.652860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:130224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.652873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.652889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:130232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.652902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.652917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:130240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.652930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.652945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:130248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.652959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.652991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:130256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:130264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:130272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:130280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:130288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:130296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:130304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:130312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:130320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:130328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:130336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:130344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:130352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:130360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:130368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:130376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:130384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:130392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:129792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:129800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:130400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:130408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.653905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:130416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:130424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.653963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.653994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:130432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.654008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.654022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:130440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.654057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.654076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:130448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.654091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.654108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:130456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.654123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.654140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:130464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.238 [2024-11-19 15:28:35.654156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.238 [2024-11-19 15:28:35.654173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:130472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.238 [2024-11-19 15:28:35.654188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:130480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:130488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:130496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:130504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:130512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:130520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:130528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:130536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:130544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:130552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:130560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:130568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:130576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:37.239 [2024-11-19 15:28:35.654605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:129816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:129832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:129856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:129864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:129896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:129920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:129952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:129960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.654957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.654989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:129992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.655004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:130032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.655036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:130040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.655067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:130048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.655099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:130080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:37.239 [2024-11-19 15:28:35.655131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1695740 is same with the state(5) to be set 00:27:37.239 [2024-11-19 15:28:35.655165] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:37.239 [2024-11-19 15:28:35.655177] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:37.239 [2024-11-19 15:28:35.655189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:130096 len:8 PRP1 0x0 PRP2 0x0 00:27:37.239 [2024-11-19 15:28:35.655203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:37.239 [2024-11-19 15:28:35.655272] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1695740 was disconnected and freed. reset controller. 00:27:37.239 [2024-11-19 15:28:35.657959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.239 [2024-11-19 15:28:35.658054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.239 [2024-11-19 15:28:35.658567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.239 [2024-11-19 15:28:35.658759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.239 [2024-11-19 15:28:35.658785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.239 [2024-11-19 15:28:35.658802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.239 [2024-11-19 15:28:35.658920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.239 [2024-11-19 15:28:35.659105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.239 [2024-11-19 15:28:35.659128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.239 [2024-11-19 15:28:35.659145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.239 [2024-11-19 15:28:35.661627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.239 [2024-11-19 15:28:35.670554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.239 [2024-11-19 15:28:35.670903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.239 [2024-11-19 15:28:35.671071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.239 [2024-11-19 15:28:35.671100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.239 [2024-11-19 15:28:35.671118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.239 [2024-11-19 15:28:35.671264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.239 [2024-11-19 15:28:35.671469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.671492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.671507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.673868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.683204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.683565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.683729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.683759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.683777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.683924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.684075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.684098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.684113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.686304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.695858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.696158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.696266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.696291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.696306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.696437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.696650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.696679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.696707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.698919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.708166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.708463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.708641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.708667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.708683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.708864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.709045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.709069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.709084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.711439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.720603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.720917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.721098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.721127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.721144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.721309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.721460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.721482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.721497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.723954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.733261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.733631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.733759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.733787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.733805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.733969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.734139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.734162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.734182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.736557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.745887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.746184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.746337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.746382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.746400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.746566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.746783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.746807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.746822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.749030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.758635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.758878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.758996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.759037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.759053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.759136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.759315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.759338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.759353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.761476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.771376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.240 [2024-11-19 15:28:35.771648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.771854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.240 [2024-11-19 15:28:35.771880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.240 [2024-11-19 15:28:35.771896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.240 [2024-11-19 15:28:35.772129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.240 [2024-11-19 15:28:35.772316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.240 [2024-11-19 15:28:35.772338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.240 [2024-11-19 15:28:35.772353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.240 [2024-11-19 15:28:35.774644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.240 [2024-11-19 15:28:35.783992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.241 [2024-11-19 15:28:35.784350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.241 [2024-11-19 15:28:35.784485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.241 [2024-11-19 15:28:35.784512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.241 [2024-11-19 15:28:35.784528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.241 [2024-11-19 15:28:35.784698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.241 [2024-11-19 15:28:35.784868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.241 [2024-11-19 15:28:35.784891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.241 [2024-11-19 15:28:35.784906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.241 [2024-11-19 15:28:35.787294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.796422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.796772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.796913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.796940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.796957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.797103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.797290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.797314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.797329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.799711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.808925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.809313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.809517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.809546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.809563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.809721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.809873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.809896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.809911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.812227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.821517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.821841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.821973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.822000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.822017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.822218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.822370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.822392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.822408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.824739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.834095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.834419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.834533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.834577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.834593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.834817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.835042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.835065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.835081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.837560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.846793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.847090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.847254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.847279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.847294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.847456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.847659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.847681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.847709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.850194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.859413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.859736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.859870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.859895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.859910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.860084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.860253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.500 [2024-11-19 15:28:35.860275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.500 [2024-11-19 15:28:35.860290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.500 [2024-11-19 15:28:35.862610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.500 [2024-11-19 15:28:35.872175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.500 [2024-11-19 15:28:35.872487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.872621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.500 [2024-11-19 15:28:35.872649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.500 [2024-11-19 15:28:35.872667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.500 [2024-11-19 15:28:35.872878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.500 [2024-11-19 15:28:35.873065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.873087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.873102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.875456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.884940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.885218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.885351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.885379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.885395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.885577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.885740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.885764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.885779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.888233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.897403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.897705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.897824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.897857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.897875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.898040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.898228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.898250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.898266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.900532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.909984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.910306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.910414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.910443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.910461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.910627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.910862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.910886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.910903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.913206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.922468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.922790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.922953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.922982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.923000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.923147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.923334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.923357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.923373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.925737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.935048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.935350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.935532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.935558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.935579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.935739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.935950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.935974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.935990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.938344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.947538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.947849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.948001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.948026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.948042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.948256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.948425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.948449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.948465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.950535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.960240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.960597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.960701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.960729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.960744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.960893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.961094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.961119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.961134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.963453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.972889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.973170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.973273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.973301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.973318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.973489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.973622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.973645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.973660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.975931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.501 [2024-11-19 15:28:35.985600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.501 [2024-11-19 15:28:35.985906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.986047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.501 [2024-11-19 15:28:35.986075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.501 [2024-11-19 15:28:35.986092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.501 [2024-11-19 15:28:35.986240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.501 [2024-11-19 15:28:35.986373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.501 [2024-11-19 15:28:35.986395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.501 [2024-11-19 15:28:35.986410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.501 [2024-11-19 15:28:35.988657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.502 [2024-11-19 15:28:35.998203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.502 [2024-11-19 15:28:35.998515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:35.998631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:35.998660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.502 [2024-11-19 15:28:35.998677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.502 [2024-11-19 15:28:35.998851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.502 [2024-11-19 15:28:35.999002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.502 [2024-11-19 15:28:35.999025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.502 [2024-11-19 15:28:35.999040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.502 [2024-11-19 15:28:36.001409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.502 [2024-11-19 15:28:36.011002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.502 [2024-11-19 15:28:36.011284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.011442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.011471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.502 [2024-11-19 15:28:36.011489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.502 [2024-11-19 15:28:36.011654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.502 [2024-11-19 15:28:36.011822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.502 [2024-11-19 15:28:36.011847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.502 [2024-11-19 15:28:36.011862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.502 [2024-11-19 15:28:36.014256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.502 [2024-11-19 15:28:36.023685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.502 [2024-11-19 15:28:36.024011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.024145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.024174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.502 [2024-11-19 15:28:36.024191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.502 [2024-11-19 15:28:36.024410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.502 [2024-11-19 15:28:36.024579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.502 [2024-11-19 15:28:36.024601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.502 [2024-11-19 15:28:36.024616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.502 [2024-11-19 15:28:36.026840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.502 [2024-11-19 15:28:36.036370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.502 [2024-11-19 15:28:36.036646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.036831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.036857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.502 [2024-11-19 15:28:36.036873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.502 [2024-11-19 15:28:36.037084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.502 [2024-11-19 15:28:36.037253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.502 [2024-11-19 15:28:36.037276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.502 [2024-11-19 15:28:36.037291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.502 [2024-11-19 15:28:36.039610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.502 [2024-11-19 15:28:36.048995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.502 [2024-11-19 15:28:36.049272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.049406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.502 [2024-11-19 15:28:36.049434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.502 [2024-11-19 15:28:36.049452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.502 [2024-11-19 15:28:36.049634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.502 [2024-11-19 15:28:36.049812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.502 [2024-11-19 15:28:36.049842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.502 [2024-11-19 15:28:36.049858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.502 [2024-11-19 15:28:36.052267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.761 [2024-11-19 15:28:36.061673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.061970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.062082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.062107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.062121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.062278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.062440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.062463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.062478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.064861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.074268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.074596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.074706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.074736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.074754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.074919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.075142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.075165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.075181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.077442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.087027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.087330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.087487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.087512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.087528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.087665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.087845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.087869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.087891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.090192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.099593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.099898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.100062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.100091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.100108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.100255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.100406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.100429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.100445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.102805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.112168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.112471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.112619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.112646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.112662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.112801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.113000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.113023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.113039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.115499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.124628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.124979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.125112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.125138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.125153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.125285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.125449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.125469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.125483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.127480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.137218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.137574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.137687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.137740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.137755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.137888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.138070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.138093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.138108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.140519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.149838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.150152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.150326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.150351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.150367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.150528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.150701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.150725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.150756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.153015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.162431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.162760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.162890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.162916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.762 [2024-11-19 15:28:36.162932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.762 [2024-11-19 15:28:36.163050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.762 [2024-11-19 15:28:36.163202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.762 [2024-11-19 15:28:36.163224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.762 [2024-11-19 15:28:36.163239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.762 [2024-11-19 15:28:36.165620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.762 [2024-11-19 15:28:36.175046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.762 [2024-11-19 15:28:36.175418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.762 [2024-11-19 15:28:36.175565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.175590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.175606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.175827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.175943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.175966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.175981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.178379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.187367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.187617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.187775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.187801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.187817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.188013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.188193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.188213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.188228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.190315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.199604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.199987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.200130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.200159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.200176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.200377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.200510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.200532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.200548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.202856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.212289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.212636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.212767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.212797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.212814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.212961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.213147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.213170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.213199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.215468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.224931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.225204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.225368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.225393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.225409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.225589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.225789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.225813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.225828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.228094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.237292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.237631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.237770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.237800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.237817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.238001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.238224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.238247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.238262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.240542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.249935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.250269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.250416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.250441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.250457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.250619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.250809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.250833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.250848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.253052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.262638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.263025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.263158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.263185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.263202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.263360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.263580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.263604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.263618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.265942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.275112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.275483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.275587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.275614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.275629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.275885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.763 [2024-11-19 15:28:36.276056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.763 [2024-11-19 15:28:36.276079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.763 [2024-11-19 15:28:36.276094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.763 [2024-11-19 15:28:36.278589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.763 [2024-11-19 15:28:36.287703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.763 [2024-11-19 15:28:36.288052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.288212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.763 [2024-11-19 15:28:36.288240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.763 [2024-11-19 15:28:36.288263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.763 [2024-11-19 15:28:36.288482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.764 [2024-11-19 15:28:36.288614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.764 [2024-11-19 15:28:36.288636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.764 [2024-11-19 15:28:36.288652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.764 [2024-11-19 15:28:36.290923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.764 [2024-11-19 15:28:36.300222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.764 [2024-11-19 15:28:36.300537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.764 [2024-11-19 15:28:36.300667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.764 [2024-11-19 15:28:36.300705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.764 [2024-11-19 15:28:36.300725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.764 [2024-11-19 15:28:36.300925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.764 [2024-11-19 15:28:36.301094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.764 [2024-11-19 15:28:36.301117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.764 [2024-11-19 15:28:36.301133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.764 [2024-11-19 15:28:36.303243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.764 [2024-11-19 15:28:36.312653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.764 [2024-11-19 15:28:36.312985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.764 [2024-11-19 15:28:36.313134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.764 [2024-11-19 15:28:36.313177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:37.764 [2024-11-19 15:28:36.313193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:37.764 [2024-11-19 15:28:36.313340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:37.764 [2024-11-19 15:28:36.313496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.764 [2024-11-19 15:28:36.313520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.764 [2024-11-19 15:28:36.313535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.764 [2024-11-19 15:28:36.316004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.023 [2024-11-19 15:28:36.325127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.023 [2024-11-19 15:28:36.325420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.325506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.325530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.023 [2024-11-19 15:28:36.325545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.023 [2024-11-19 15:28:36.325742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.023 [2024-11-19 15:28:36.325887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.023 [2024-11-19 15:28:36.325910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.023 [2024-11-19 15:28:36.325925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.023 [2024-11-19 15:28:36.328245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.023 [2024-11-19 15:28:36.337517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.023 [2024-11-19 15:28:36.337878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.338014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.338042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.023 [2024-11-19 15:28:36.338059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.023 [2024-11-19 15:28:36.338206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.023 [2024-11-19 15:28:36.338410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.023 [2024-11-19 15:28:36.338433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.023 [2024-11-19 15:28:36.338448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.023 [2024-11-19 15:28:36.340830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.023 [2024-11-19 15:28:36.350149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.023 [2024-11-19 15:28:36.350459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.350617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.023 [2024-11-19 15:28:36.350642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.023 [2024-11-19 15:28:36.350658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.023 [2024-11-19 15:28:36.350860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.351012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.351035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.351050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.353439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.362651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.362959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.363097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.363125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.363141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.363343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.363571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.363595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.363610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.365920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.375194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.375547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.375678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.375715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.375733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.375898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.376030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.376053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.376069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.378259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.387606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.387974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.388135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.388163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.388180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.388344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.388531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.388554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.388570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.390816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.400144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.400426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.400576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.400602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.400617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.400742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.400907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.400936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.400953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.403304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.412639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.412963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.413121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.413150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.413166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.413331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.413482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.413505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.413521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.415969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.425215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.425505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.425665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.425700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.425719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.425901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.426124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.426147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.426163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.428466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.437858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.438176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.438318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.438343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.438359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.438506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.438664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.438698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.438721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.441058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.450345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.450626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.450766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.450796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.450813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.450996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.451182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.451205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.451221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.453373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.024 [2024-11-19 15:28:36.462803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.024 [2024-11-19 15:28:36.463127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.463273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.024 [2024-11-19 15:28:36.463298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.024 [2024-11-19 15:28:36.463314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.024 [2024-11-19 15:28:36.463545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.024 [2024-11-19 15:28:36.463744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.024 [2024-11-19 15:28:36.463768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.024 [2024-11-19 15:28:36.463783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.024 [2024-11-19 15:28:36.466099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.475429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.475732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.475862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.475890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.475907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.476090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.476223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.476246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.476261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.478423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.488110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.488454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.488567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.488592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.488607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.488766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.489004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.489027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.489043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.491232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.500527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.500845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.501005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.501033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.501050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.501161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.501348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.501371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.501387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.503893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.513039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.513322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.513473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.513490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.513618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.513800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.513824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.513839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.516262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.525575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.525869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.526027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.526052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.526067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.526250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.526420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.526443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.526458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.528784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.538220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.538569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.538666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.538698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.538715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.538872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.539042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.539065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.539080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.541556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.550765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.551046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.551182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.551211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.551228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.551410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.551597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.551620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.551635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.553996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.563342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.563694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.563856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.563884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.563902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.564084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.564218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.564240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.564255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.566553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.025 [2024-11-19 15:28:36.575850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.025 [2024-11-19 15:28:36.576168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.576301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.025 [2024-11-19 15:28:36.576330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.025 [2024-11-19 15:28:36.576347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.025 [2024-11-19 15:28:36.576475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.025 [2024-11-19 15:28:36.576662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.025 [2024-11-19 15:28:36.576685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.025 [2024-11-19 15:28:36.576715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.025 [2024-11-19 15:28:36.579069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.285 [2024-11-19 15:28:36.588404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.285 [2024-11-19 15:28:36.588737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.588874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.588902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.285 [2024-11-19 15:28:36.588919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.285 [2024-11-19 15:28:36.589084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.285 [2024-11-19 15:28:36.589272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.285 [2024-11-19 15:28:36.589295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.285 [2024-11-19 15:28:36.589310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.285 [2024-11-19 15:28:36.591519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.285 [2024-11-19 15:28:36.601116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.285 [2024-11-19 15:28:36.601478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.601585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.601612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.285 [2024-11-19 15:28:36.601629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.285 [2024-11-19 15:28:36.601860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.285 [2024-11-19 15:28:36.602012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.285 [2024-11-19 15:28:36.602035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.285 [2024-11-19 15:28:36.602050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.285 [2024-11-19 15:28:36.604526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.285 [2024-11-19 15:28:36.613902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.285 [2024-11-19 15:28:36.614254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.614378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.614403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.285 [2024-11-19 15:28:36.614435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.285 [2024-11-19 15:28:36.614617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.285 [2024-11-19 15:28:36.614814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.285 [2024-11-19 15:28:36.614839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.285 [2024-11-19 15:28:36.614855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.285 [2024-11-19 15:28:36.617135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.285 [2024-11-19 15:28:36.626227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.285 [2024-11-19 15:28:36.626527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.626700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.626726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.285 [2024-11-19 15:28:36.626742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.285 [2024-11-19 15:28:36.626857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.285 [2024-11-19 15:28:36.627039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.285 [2024-11-19 15:28:36.627062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.285 [2024-11-19 15:28:36.627077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.285 [2024-11-19 15:28:36.629305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.285 [2024-11-19 15:28:36.638668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.285 [2024-11-19 15:28:36.639014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.639131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.285 [2024-11-19 15:28:36.639160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.285 [2024-11-19 15:28:36.639182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.285 [2024-11-19 15:28:36.639348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.285 [2024-11-19 15:28:36.639534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.285 [2024-11-19 15:28:36.639557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.285 [2024-11-19 15:28:36.639572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.285 [2024-11-19 15:28:36.641702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.651370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.651716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.651898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.651924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.651940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.652072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.652205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.652228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.652243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.654721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.664078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.664399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.664536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.664563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.664579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.664829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.665017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.665041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.665057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.667509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.676389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.676642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.676777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.676802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.676818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.676971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.677134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.677158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.677173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.679477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.689059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.689370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.689529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.689557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.689574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.689765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.689934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.689955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.689968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.692376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.701475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.701820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.701935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.701961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.701976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.702176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.702327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.702350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.702366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.704650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.714030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.714322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.714468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.714496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.714512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.714677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.714849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.714873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.714888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.717260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.726648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.726930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.727078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.727105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.727121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.727282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.727442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.727471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.727486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.729709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.739238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.739521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.739629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.739658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.739674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.739810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.740016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.740039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.740054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.742414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.751520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.751834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.752007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.752035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.286 [2024-11-19 15:28:36.752052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.286 [2024-11-19 15:28:36.752234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.286 [2024-11-19 15:28:36.752439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.286 [2024-11-19 15:28:36.752467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.286 [2024-11-19 15:28:36.752484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.286 [2024-11-19 15:28:36.754920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.286 [2024-11-19 15:28:36.764280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.286 [2024-11-19 15:28:36.764555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.286 [2024-11-19 15:28:36.764698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.764727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.764744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.764927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.765096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.765118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.765134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.767519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.776812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.777176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.777367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.777393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.777410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.777539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.777736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.777761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.777777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.780111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.789497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.789738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.789898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.789926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.789944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.790145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.790296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.790319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.790341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.792701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.802167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.802501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.802633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.802661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.802679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.802839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.803008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.803030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.803045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.805218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.814875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.815169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.815305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.815333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.815351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.815479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.815648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.815670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.815685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.818018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.827530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.827854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.827983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.828011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.828028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.828193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.828380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.828403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.828417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.830699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.287 [2024-11-19 15:28:36.840017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.287 [2024-11-19 15:28:36.840311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.840442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.287 [2024-11-19 15:28:36.840469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.287 [2024-11-19 15:28:36.840486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.287 [2024-11-19 15:28:36.840633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.287 [2024-11-19 15:28:36.840844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.287 [2024-11-19 15:28:36.840864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.287 [2024-11-19 15:28:36.840877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.287 [2024-11-19 15:28:36.843370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.852580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.852909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.853045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.853075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.853092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.853257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.853426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.853449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.853464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.855899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.865275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.865598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.865735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.865764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.865781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.865910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.866115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.866138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.866154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.868667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.877949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.878241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.878400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.878428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.878445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.878628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.878826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.878850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.878866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.880985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.890522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.890804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.890944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.890972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.890989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.891118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.891305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.891328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.891344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.893743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.903150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.903498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.903611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.903636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.903651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.903818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.903988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.904011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.904027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.906323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.915663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.915934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.916101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.916127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.916143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.916308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.916459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.916483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.916499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.918797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.928108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.928411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.928519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.928548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.928566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.928744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.928914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.928938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.928953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.931288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.940851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.547 [2024-11-19 15:28:36.941165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.941295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.547 [2024-11-19 15:28:36.941323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.547 [2024-11-19 15:28:36.941341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.547 [2024-11-19 15:28:36.941523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.547 [2024-11-19 15:28:36.941703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.547 [2024-11-19 15:28:36.941726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.547 [2024-11-19 15:28:36.941742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.547 [2024-11-19 15:28:36.944093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.547 [2024-11-19 15:28:36.953349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:36.953643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.953796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.953822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:36.953838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:36.953971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:36.954213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:36.954236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:36.954251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:36.956532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:36.965896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:36.966151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.966286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.966314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:36.966331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:36.966513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:36.966664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:36.966687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:36.966809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:36.969183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:36.978440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:36.978696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.978833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.978862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:36.978879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:36.979043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:36.979213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:36.979236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:36.979251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:36.981587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:36.990955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:36.991243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.991390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:36.991416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:36.991436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:36.991628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:36.991793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:36.991817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:36.991833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:36.994040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.003506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.003811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.003943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.003971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:37.003988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:37.004170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:37.004322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:37.004344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:37.004360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:37.006705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.016069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.016417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.016542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.016570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:37.016587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:37.016745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:37.016933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:37.016956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:37.016972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:37.019016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.028506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.028825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.028961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.028990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:37.029007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:37.029160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:37.029347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:37.029370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:37.029385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:37.031873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.041252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.041542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.041723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.041749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:37.041765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:37.041928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:37.042091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:37.042114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:37.042130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:37.044447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.053725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.054035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.054171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.054199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.548 [2024-11-19 15:28:37.054216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.548 [2024-11-19 15:28:37.054417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.548 [2024-11-19 15:28:37.054585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.548 [2024-11-19 15:28:37.054608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.548 [2024-11-19 15:28:37.054623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.548 [2024-11-19 15:28:37.056735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.548 [2024-11-19 15:28:37.066249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.548 [2024-11-19 15:28:37.066567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.066676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.548 [2024-11-19 15:28:37.066714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.549 [2024-11-19 15:28:37.066733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.549 [2024-11-19 15:28:37.066867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.549 [2024-11-19 15:28:37.067090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.549 [2024-11-19 15:28:37.067113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.549 [2024-11-19 15:28:37.067128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.549 [2024-11-19 15:28:37.069555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.549 [2024-11-19 15:28:37.078743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.549 [2024-11-19 15:28:37.079038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.079163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.079191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.549 [2024-11-19 15:28:37.079208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.549 [2024-11-19 15:28:37.079372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.549 [2024-11-19 15:28:37.079541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.549 [2024-11-19 15:28:37.079564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.549 [2024-11-19 15:28:37.079580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.549 [2024-11-19 15:28:37.081926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.549 [2024-11-19 15:28:37.091326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.549 [2024-11-19 15:28:37.091678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.091841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.091867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.549 [2024-11-19 15:28:37.091883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.549 [2024-11-19 15:28:37.092058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.549 [2024-11-19 15:28:37.092245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.549 [2024-11-19 15:28:37.092267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.549 [2024-11-19 15:28:37.092283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.549 [2024-11-19 15:28:37.094657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.549 [2024-11-19 15:28:37.103848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.549 [2024-11-19 15:28:37.104162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.104298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.549 [2024-11-19 15:28:37.104326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.549 [2024-11-19 15:28:37.104343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.549 [2024-11-19 15:28:37.104526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.549 [2024-11-19 15:28:37.104713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.549 [2024-11-19 15:28:37.104738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.549 [2024-11-19 15:28:37.104754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.549 [2024-11-19 15:28:37.106981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.808 [2024-11-19 15:28:37.116302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.808 [2024-11-19 15:28:37.116604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.808 [2024-11-19 15:28:37.116763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.808 [2024-11-19 15:28:37.116789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.808 [2024-11-19 15:28:37.116805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.808 [2024-11-19 15:28:37.116980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.808 [2024-11-19 15:28:37.117112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.808 [2024-11-19 15:28:37.117134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.808 [2024-11-19 15:28:37.117150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.808 [2024-11-19 15:28:37.119575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.808 [2024-11-19 15:28:37.128796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.808 [2024-11-19 15:28:37.129115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.808 [2024-11-19 15:28:37.129288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.808 [2024-11-19 15:28:37.129314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.808 [2024-11-19 15:28:37.129329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.129527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.129678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.129713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.129730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.132082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.141383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.141661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.141826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.141852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.141868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.142057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.142244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.142267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.142288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.144531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.154108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.154421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.154527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.154554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.154570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.154744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.154913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.154934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.154948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.157277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.166482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.166790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.166925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.166950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.166965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.167145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.167278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.167301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.167317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.169553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.179033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.179330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.179489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.179518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.179536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.179738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.179924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.179945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.179988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.182303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.191510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.191867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.191993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.192018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.192034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.192223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.192410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.192433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.192448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.194836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.203818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.204115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.204295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.204321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.204336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.204499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.204676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.204710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.204726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.207060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.216320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.216641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.216793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.216818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.216834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.216982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.217163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.217185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.217201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.219556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.228823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.229121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.229257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.229284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.229301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.229429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.229562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.229585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.809 [2024-11-19 15:28:37.229600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.809 [2024-11-19 15:28:37.232125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.809 [2024-11-19 15:28:37.241233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.809 [2024-11-19 15:28:37.241579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.241722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.809 [2024-11-19 15:28:37.241751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.809 [2024-11-19 15:28:37.241769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.809 [2024-11-19 15:28:37.241898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.809 [2024-11-19 15:28:37.242049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.809 [2024-11-19 15:28:37.242072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.242087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.244493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.253771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.254088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.254234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.254259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.254275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.254453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.254583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.254605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.254620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.256896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.266308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.266597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.266707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.266736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.266754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.266883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.267034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.267057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.267073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.269283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.279060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.279415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.279572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.279601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.279618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.279829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.280016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.280040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.280055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.282211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.291739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.292065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.292216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.292242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.292257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.292450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.292591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.292614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.292630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.295222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.304396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.304681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.304841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.304883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.304899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.305029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.305179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.305202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.305218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.307544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.317122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.317419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.317548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.317576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.317593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.317823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.317975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.317998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.318013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.320331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.329795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.330034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.330157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.330184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.330201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.330330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.330482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.330505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.330520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.332828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.342244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.342571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.342710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.342755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.342776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.342960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.343145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.343169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.343184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.345392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.354700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.810 [2024-11-19 15:28:37.354997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.355131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.810 [2024-11-19 15:28:37.355160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.810 [2024-11-19 15:28:37.355177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.810 [2024-11-19 15:28:37.355359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.810 [2024-11-19 15:28:37.355529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.810 [2024-11-19 15:28:37.355551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.810 [2024-11-19 15:28:37.355566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.810 [2024-11-19 15:28:37.357913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.810 [2024-11-19 15:28:37.367261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.811 [2024-11-19 15:28:37.367542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.811 [2024-11-19 15:28:37.367708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.811 [2024-11-19 15:28:37.367741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:38.811 [2024-11-19 15:28:37.367758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:38.811 [2024-11-19 15:28:37.367904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:38.811 [2024-11-19 15:28:37.368127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.811 [2024-11-19 15:28:37.368150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.811 [2024-11-19 15:28:37.368165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.070 [2024-11-19 15:28:37.370612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.070 [2024-11-19 15:28:37.379727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.070 [2024-11-19 15:28:37.379985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.380147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.380173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.070 [2024-11-19 15:28:37.380194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.070 [2024-11-19 15:28:37.380400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.070 [2024-11-19 15:28:37.380587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.070 [2024-11-19 15:28:37.380609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.070 [2024-11-19 15:28:37.380624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.070 [2024-11-19 15:28:37.382997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.070 [2024-11-19 15:28:37.392147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.070 [2024-11-19 15:28:37.392470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.392599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.392624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.070 [2024-11-19 15:28:37.392639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.070 [2024-11-19 15:28:37.392828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.070 [2024-11-19 15:28:37.393016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.070 [2024-11-19 15:28:37.393039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.070 [2024-11-19 15:28:37.393054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.070 [2024-11-19 15:28:37.395502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.070 [2024-11-19 15:28:37.404847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.070 [2024-11-19 15:28:37.405129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.405235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.405262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.070 [2024-11-19 15:28:37.405279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.070 [2024-11-19 15:28:37.405461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.070 [2024-11-19 15:28:37.405613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.070 [2024-11-19 15:28:37.405636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.070 [2024-11-19 15:28:37.405650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.070 [2024-11-19 15:28:37.407994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.070 [2024-11-19 15:28:37.417503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.070 [2024-11-19 15:28:37.417812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.417940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.417969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.070 [2024-11-19 15:28:37.417986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.070 [2024-11-19 15:28:37.418121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.070 [2024-11-19 15:28:37.418309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.070 [2024-11-19 15:28:37.418333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.070 [2024-11-19 15:28:37.418348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.070 [2024-11-19 15:28:37.420539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.070 [2024-11-19 15:28:37.430238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.070 [2024-11-19 15:28:37.430537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.430674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.070 [2024-11-19 15:28:37.430714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.070 [2024-11-19 15:28:37.430732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.430879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.431066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.431090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.431105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.433499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.442735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.443107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.443206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.443232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.443248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.443412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.443599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.443622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.443636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.445926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.455185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.455466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.455627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.455655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.455673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.455809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.455967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.455990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.456005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.458381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.467685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.467987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.468176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.468218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.468235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.468364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.468497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.468520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.468535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.470917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.480287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.480631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.480795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.480825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.480843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.480990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.481159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.481182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.481198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.483414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.492907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.493254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.493367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.493411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.493426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.493618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.493770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.493800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.493816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.496115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.505424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.505724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.505858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.505887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.505904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.506051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.506238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.506261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.506277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.508610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.517982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.518308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.518432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.518457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.518473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.518687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.518922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.518945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.518960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.521257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.530502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.530852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.530961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.530988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.531003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.531227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.531361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.071 [2024-11-19 15:28:37.531383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.071 [2024-11-19 15:28:37.531404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.071 [2024-11-19 15:28:37.533750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.071 [2024-11-19 15:28:37.543289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.071 [2024-11-19 15:28:37.543589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.543727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.071 [2024-11-19 15:28:37.543756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.071 [2024-11-19 15:28:37.543774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.071 [2024-11-19 15:28:37.543939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.071 [2024-11-19 15:28:37.544126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.544149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.544165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.546392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.555923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.556277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.556416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.556444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.556461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.556643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.556804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.556828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.556843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.559197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.568424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.568730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.568831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.568859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.568876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.569113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.569264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.569287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.569303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.571512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.580925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.581220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.581357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.581385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.581402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.581567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.581730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.581754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.581769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.584269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.593623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.594075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.594105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.594122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.594269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.594383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.594406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.594421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.596801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.606207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.606512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.606629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.606657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.606674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.606902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.607061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.607097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.607113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.609501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.072 [2024-11-19 15:28:37.618922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.072 [2024-11-19 15:28:37.619263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.619416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.072 [2024-11-19 15:28:37.619442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.072 [2024-11-19 15:28:37.619457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.072 [2024-11-19 15:28:37.619618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.072 [2024-11-19 15:28:37.619857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.072 [2024-11-19 15:28:37.619881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.072 [2024-11-19 15:28:37.619896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.072 [2024-11-19 15:28:37.622088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.631498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.631804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.631974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.631999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.632015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.632191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.632396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.632419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.632434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.634759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.644086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.644392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.644552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.644580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.644598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.644810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.644998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.645021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.645036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.647369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.656564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.656868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.657001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.657043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.657059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.657191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.657364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.657387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.657402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.659895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.669047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.669324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.669473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.669499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.669514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.669670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.669869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.669890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.669904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.672373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.681474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.681786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.681887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.681914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.681930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.682140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.682291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.682314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.682329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.684562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.694056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.694314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.694452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.694486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.694504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.694718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.694906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.694929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.694944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.697420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.706764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.707084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.707244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.707273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.707290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.707454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.707659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.707682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.332 [2024-11-19 15:28:37.707709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.332 [2024-11-19 15:28:37.710098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.332 [2024-11-19 15:28:37.719442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.332 [2024-11-19 15:28:37.719733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.719871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.332 [2024-11-19 15:28:37.719901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.332 [2024-11-19 15:28:37.719918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.332 [2024-11-19 15:28:37.720065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.332 [2024-11-19 15:28:37.720270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.332 [2024-11-19 15:28:37.720293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.720308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.722676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.731837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.732109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.732294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.732320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.732341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.732485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.732618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.732642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.732658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.734937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.744513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.744870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.745006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.745034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.745051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.745198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.745349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.745371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.745387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.747635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.757223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.757569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.757731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.757761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.757778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.757962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.758167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.758190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.758206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.760463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.769742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.770143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.770290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.770315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.770331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.770503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.770729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.770755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.770770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.772960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.782349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.782752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.782870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.782896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.782915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.783101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.783289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.783312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.783327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.785830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.794828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.795163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.795306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.795335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.795352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.795480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.795667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.795697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.795715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.798069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.807363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.807664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.807806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.807835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.807852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.808017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.808210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.808234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.808248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.810533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.819889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.820185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.820321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.820364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.820380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.820512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.820682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.820716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.820732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.822993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.832257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.832538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.832671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.333 [2024-11-19 15:28:37.832708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.333 [2024-11-19 15:28:37.832728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.333 [2024-11-19 15:28:37.832910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.333 [2024-11-19 15:28:37.833097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.333 [2024-11-19 15:28:37.833120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.333 [2024-11-19 15:28:37.833135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.333 [2024-11-19 15:28:37.835613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.333 [2024-11-19 15:28:37.844993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.333 [2024-11-19 15:28:37.845314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.845457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.845485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.334 [2024-11-19 15:28:37.845502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.334 [2024-11-19 15:28:37.845649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.334 [2024-11-19 15:28:37.845790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.334 [2024-11-19 15:28:37.845819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.334 [2024-11-19 15:28:37.845835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.334 [2024-11-19 15:28:37.848320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.334 [2024-11-19 15:28:37.857458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.334 [2024-11-19 15:28:37.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.857865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.857890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.334 [2024-11-19 15:28:37.857906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.334 [2024-11-19 15:28:37.858094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.334 [2024-11-19 15:28:37.858263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.334 [2024-11-19 15:28:37.858285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.334 [2024-11-19 15:28:37.858300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.334 [2024-11-19 15:28:37.860653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.334 [2024-11-19 15:28:37.870029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.334 [2024-11-19 15:28:37.870360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.870485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.870510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.334 [2024-11-19 15:28:37.870526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.334 [2024-11-19 15:28:37.870658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.334 [2024-11-19 15:28:37.870805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.334 [2024-11-19 15:28:37.870827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.334 [2024-11-19 15:28:37.870841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.334 [2024-11-19 15:28:37.872999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.334 [2024-11-19 15:28:37.882556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.334 [2024-11-19 15:28:37.882846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.882982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.334 [2024-11-19 15:28:37.883013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.334 [2024-11-19 15:28:37.883030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.334 [2024-11-19 15:28:37.883178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.334 [2024-11-19 15:28:37.883347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.334 [2024-11-19 15:28:37.883370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.334 [2024-11-19 15:28:37.883391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.334 [2024-11-19 15:28:37.885706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.895328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.593 [2024-11-19 15:28:37.895659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.895796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.895822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.593 [2024-11-19 15:28:37.895837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.593 [2024-11-19 15:28:37.895996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.593 [2024-11-19 15:28:37.896183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.593 [2024-11-19 15:28:37.896206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.593 [2024-11-19 15:28:37.896221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.593 [2024-11-19 15:28:37.898578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.907840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.593 [2024-11-19 15:28:37.908154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.908262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.908289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.593 [2024-11-19 15:28:37.908306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.593 [2024-11-19 15:28:37.908488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.593 [2024-11-19 15:28:37.908657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.593 [2024-11-19 15:28:37.908680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.593 [2024-11-19 15:28:37.908706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.593 [2024-11-19 15:28:37.911026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.920355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.593 [2024-11-19 15:28:37.920675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.920854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.920880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.593 [2024-11-19 15:28:37.920896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.593 [2024-11-19 15:28:37.921042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.593 [2024-11-19 15:28:37.921188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.593 [2024-11-19 15:28:37.921211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.593 [2024-11-19 15:28:37.921227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.593 [2024-11-19 15:28:37.923760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.933064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.593 [2024-11-19 15:28:37.933399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.933531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.933559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.593 [2024-11-19 15:28:37.933576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.593 [2024-11-19 15:28:37.933736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.593 [2024-11-19 15:28:37.933853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.593 [2024-11-19 15:28:37.933875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.593 [2024-11-19 15:28:37.933890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.593 [2024-11-19 15:28:37.936172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.945643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.593 [2024-11-19 15:28:37.945976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.946110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.593 [2024-11-19 15:28:37.946138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.593 [2024-11-19 15:28:37.946155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.593 [2024-11-19 15:28:37.946320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.593 [2024-11-19 15:28:37.946524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.593 [2024-11-19 15:28:37.946547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.593 [2024-11-19 15:28:37.946562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.593 [2024-11-19 15:28:37.948924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.593 [2024-11-19 15:28:37.958572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:37.958912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.959048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.959075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:37.959092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:37.959221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:37.959426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:37.959449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:37.959464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:37.961795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:37.971099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:37.971425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.971600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.971625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:37.971641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:37.971767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:37.971964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:37.971987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:37.972002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:37.974300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:37.983797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:37.984081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.984214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.984243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:37.984260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:37.984389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:37.984558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:37.984581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:37.984596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:37.987015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:37.996317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:37.996639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:37.996855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:37.996870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:37.997019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:37.997248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:37.997271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:37.997286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:37.999831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.008788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.009076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.009225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.009251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:38.009266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:38.009414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:38.009570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:38.009594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:38.009609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:38.011903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.021385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.021707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.021840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.021868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:38.021886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:38.022069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:38.022292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:38.022315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:38.022331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:38.024579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.034066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.034376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.034502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.034530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:38.034548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:38.034760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:38.034912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:38.034934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:38.034949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:38.037339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.046533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.046799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.046896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.046929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:38.046947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:38.047075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:38.047227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:38.047250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:38.047266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:38.049460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.059149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.059479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.059606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.059635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.594 [2024-11-19 15:28:38.059652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.594 [2024-11-19 15:28:38.059830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.594 [2024-11-19 15:28:38.060019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.594 [2024-11-19 15:28:38.060041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.594 [2024-11-19 15:28:38.060056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.594 [2024-11-19 15:28:38.062247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.594 [2024-11-19 15:28:38.071857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.594 [2024-11-19 15:28:38.072184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.072332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.594 [2024-11-19 15:28:38.072359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.072376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.072541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.072721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.072745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.072761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.075059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.084446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.084787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.084960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.084985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.085006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.085122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.085303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.085327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.085342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.087776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.096797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.097080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.097170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.097195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.097210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.097354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.097531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.097554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.097570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.099805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.109217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.109508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.109613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.109640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.109657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.109797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.110004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.110027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.110042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.112450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.121841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.122176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.122311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.122340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.122357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.122599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.122725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.122749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.122764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.125209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.134351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.134670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.134779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.134806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.134823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.134951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.135102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.135124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.135140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.137529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.595 [2024-11-19 15:28:38.147020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.595 [2024-11-19 15:28:38.147338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.147499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.595 [2024-11-19 15:28:38.147526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.595 [2024-11-19 15:28:38.147543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.595 [2024-11-19 15:28:38.147737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.595 [2024-11-19 15:28:38.147924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.595 [2024-11-19 15:28:38.147947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.595 [2024-11-19 15:28:38.147963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.595 [2024-11-19 15:28:38.150438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.159831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.160171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.160271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.160295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.160311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.160447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.160603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.160626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.160641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.162985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.172381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.172743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.172864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.172890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.172905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.173054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.173236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.173259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.173275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.175491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.184782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.185079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.185206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.185231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.185246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.185398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.185568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.185591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.185606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.187893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.197543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.197921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.198019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.198043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.198058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.198235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.198417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.198445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.198461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.200699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.210127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.210459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.210604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.210619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.210762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.210932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.210955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.210970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.213302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.223006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.223341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.223476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.223505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.223522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.223715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.223831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.223854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.855 [2024-11-19 15:28:38.223869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.855 [2024-11-19 15:28:38.226363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.855 [2024-11-19 15:28:38.235622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.855 [2024-11-19 15:28:38.235913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.236055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.855 [2024-11-19 15:28:38.236080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.855 [2024-11-19 15:28:38.236096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.855 [2024-11-19 15:28:38.236243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.855 [2024-11-19 15:28:38.236407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.855 [2024-11-19 15:28:38.236429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.236450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.238830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.248350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.248612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.248755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.248786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.248803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.248987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.249155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.249178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.249193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.251330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.260954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.261313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.261418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.261445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.261463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.261628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.261826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.261850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.261865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.264289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.273763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.274083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.274217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.274247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.274265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.274448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.274616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.274639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.274654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.277093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.286521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.286818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.286909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.286937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.286954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.287100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.287252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.287275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.287290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.289464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.299166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.299469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.299629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.299658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.299674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.299830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.300018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.300041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.300056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.302353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.311793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.312104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.312262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.312287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.312319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.312465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.312651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.312674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.312697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.314801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.324437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.324720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.324854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.324884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.324901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.325048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.325199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.325222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.325237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.327445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.337208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.337562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.337723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.337752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.337770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.337970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.338194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.338217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.338232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.340510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.349837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.350155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.350257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.856 [2024-11-19 15:28:38.350285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.856 [2024-11-19 15:28:38.350302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.856 [2024-11-19 15:28:38.350449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.856 [2024-11-19 15:28:38.350619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.856 [2024-11-19 15:28:38.350641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.856 [2024-11-19 15:28:38.350656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.856 [2024-11-19 15:28:38.353035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.856 [2024-11-19 15:28:38.362473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.856 [2024-11-19 15:28:38.362822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.362933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.362961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.857 [2024-11-19 15:28:38.362979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.857 [2024-11-19 15:28:38.363126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.857 [2024-11-19 15:28:38.363277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.857 [2024-11-19 15:28:38.363300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.857 [2024-11-19 15:28:38.363315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.857 [2024-11-19 15:28:38.365821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.857 [2024-11-19 15:28:38.374961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.857 [2024-11-19 15:28:38.375327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.375504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.375545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.857 [2024-11-19 15:28:38.375562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.857 [2024-11-19 15:28:38.375738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.857 [2024-11-19 15:28:38.375907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.857 [2024-11-19 15:28:38.375930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.857 [2024-11-19 15:28:38.375945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.857 [2024-11-19 15:28:38.378096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.857 [2024-11-19 15:28:38.387420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.857 [2024-11-19 15:28:38.387707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.387840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.387868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.857 [2024-11-19 15:28:38.387886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.857 [2024-11-19 15:28:38.388069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.857 [2024-11-19 15:28:38.388255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.857 [2024-11-19 15:28:38.388278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.857 [2024-11-19 15:28:38.388294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.857 [2024-11-19 15:28:38.390523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.857 [2024-11-19 15:28:38.399864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.857 [2024-11-19 15:28:38.400183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.400317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.400350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.857 [2024-11-19 15:28:38.400368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.857 [2024-11-19 15:28:38.400515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.857 [2024-11-19 15:28:38.400665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.857 [2024-11-19 15:28:38.400700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.857 [2024-11-19 15:28:38.400718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.857 [2024-11-19 15:28:38.403321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:39.857 [2024-11-19 15:28:38.412161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:39.857 [2024-11-19 15:28:38.412499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.412659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:39.857 [2024-11-19 15:28:38.412687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:39.857 [2024-11-19 15:28:38.412715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:39.857 [2024-11-19 15:28:38.412917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:39.857 [2024-11-19 15:28:38.413086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:39.857 [2024-11-19 15:28:38.413108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:39.857 [2024-11-19 15:28:38.413123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:39.857 [2024-11-19 15:28:38.415293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.116 [2024-11-19 15:28:38.424896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.425234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.425369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.425395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.425411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.425572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.425754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.425778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.425794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.428112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.437527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.437851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.437962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.437991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.438015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.438199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.438368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.438390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.438407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.440702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.450294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.450586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.450698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.450728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.450745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.450893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.451062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.451085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.451100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.453433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.462728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.463053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.463207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.463232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.463248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.463412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.463611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.463634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.463649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.465813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.475318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.475647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.475766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.475808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.475825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.475995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.476171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.476193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.476209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.478255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.487996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.488274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.488446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.488471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.488486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.488680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.488813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.488836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.488851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.491042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.500683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.501014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.501151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.501179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.501197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.501398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.501566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.501589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.501604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.503881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.513213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.513524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.513685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.513723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.513740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.513923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.514097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.514120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.514135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.516586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.525781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.526090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.526251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.526279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.117 [2024-11-19 15:28:38.526296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.117 [2024-11-19 15:28:38.526478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.117 [2024-11-19 15:28:38.526647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.117 [2024-11-19 15:28:38.526670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.117 [2024-11-19 15:28:38.526685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.117 [2024-11-19 15:28:38.529212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.117 [2024-11-19 15:28:38.538470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.117 [2024-11-19 15:28:38.538759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.117 [2024-11-19 15:28:38.538861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.538886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.538902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.539092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.539244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.539266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.539282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.541472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.550849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.551164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.551264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.551291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.551307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.551505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.551701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.551730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.551747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.554189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.563392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.563772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.563921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.563946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.563961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.564121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.564236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.564258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.564274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.566444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.576053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.576394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.576570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.576598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.576615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.576811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.576964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.576987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.577002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.579475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.588515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.588794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.588932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.588960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.588977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.589106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.589292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.589315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.589336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.591531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.601128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.601459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.601609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.601635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.601650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.601777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.601959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.601982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.601998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.604311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.613569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.613868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.614035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.614061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.614077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.614208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.614371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.614395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.614410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.616825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.626190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.626523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.626709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.626736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.626751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.626899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.627064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.627087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.627102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.629496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 [2024-11-19 15:28:38.638591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.118 [2024-11-19 15:28:38.638948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.639093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.118 [2024-11-19 15:28:38.639119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.118 [2024-11-19 15:28:38.639135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.118 [2024-11-19 15:28:38.639279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.118 [2024-11-19 15:28:38.639430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.118 [2024-11-19 15:28:38.639453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.118 [2024-11-19 15:28:38.639468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.118 [2024-11-19 15:28:38.641704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.118 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2883806 Killed "${NVMF_APP[@]}" "$@" 00:27:40.118 15:28:38 -- host/bdevperf.sh@36 -- # tgt_init 00:27:40.118 15:28:38 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:40.118 15:28:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:40.118 15:28:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:40.118 15:28:38 -- common/autotest_common.sh@10 -- # set +x 00:27:40.118 15:28:38 -- nvmf/common.sh@469 -- # nvmfpid=2884863 00:27:40.118 15:28:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:40.118 15:28:38 -- nvmf/common.sh@470 -- # waitforlisten 2884863 00:27:40.119 15:28:38 -- common/autotest_common.sh@829 -- # '[' -z 2884863 ']' 00:27:40.119 15:28:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:40.119 15:28:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:40.119 15:28:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:40.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:40.119 15:28:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:40.119 15:28:38 -- common/autotest_common.sh@10 -- # set +x 00:27:40.119 [2024-11-19 15:28:38.651398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.119 [2024-11-19 15:28:38.651666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.651840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.651866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.119 [2024-11-19 15:28:38.651882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.119 [2024-11-19 15:28:38.652066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.119 [2024-11-19 15:28:38.652217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.119 [2024-11-19 15:28:38.652240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.119 [2024-11-19 15:28:38.652255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.119 [2024-11-19 15:28:38.654739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.119 [2024-11-19 15:28:38.663951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.119 [2024-11-19 15:28:38.664321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.664439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.664467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.119 [2024-11-19 15:28:38.664485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.119 [2024-11-19 15:28:38.664668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.119 [2024-11-19 15:28:38.664911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.119 [2024-11-19 15:28:38.664932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.119 [2024-11-19 15:28:38.664946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.119 [2024-11-19 15:28:38.667205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.119 [2024-11-19 15:28:38.676608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.119 [2024-11-19 15:28:38.676915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.677103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.119 [2024-11-19 15:28:38.677128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.119 [2024-11-19 15:28:38.677152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.119 [2024-11-19 15:28:38.677317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.119 [2024-11-19 15:28:38.677483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.119 [2024-11-19 15:28:38.677505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.119 [2024-11-19 15:28:38.677521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.680075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.689234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.689500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.689634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.689661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.689677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.689819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.689971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.690007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.690023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.692126] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:40.379 [2024-11-19 15:28:38.692191] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:40.379 [2024-11-19 15:28:38.692235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.701752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.702064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.702202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.702230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.702253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.702400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.702569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.702592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.702606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.704993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.714151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.714456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.714571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.714598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.714615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.714783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.714980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.715000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.715013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.717288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.726511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.726866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.726997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.727022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.727038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.727186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.727315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.727337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.727353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.729851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.379 [2024-11-19 15:28:38.739159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.739490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.739589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.739617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.739634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.739818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.739980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.740017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.740033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.742245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.751771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.752191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.752293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.752318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.752334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.379 [2024-11-19 15:28:38.752513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.379 [2024-11-19 15:28:38.752664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.379 [2024-11-19 15:28:38.752687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.379 [2024-11-19 15:28:38.752714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.379 [2024-11-19 15:28:38.755070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.379 [2024-11-19 15:28:38.764382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.379 [2024-11-19 15:28:38.764673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.764825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.379 [2024-11-19 15:28:38.764851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.379 [2024-11-19 15:28:38.764866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.765036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.765223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.765246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.765261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.766172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:40.380 [2024-11-19 15:28:38.767529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.776984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.777457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.777605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.777631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.777649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.777870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.778038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.778063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.778081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.780471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.789675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.790007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.790188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.790214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.790230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.790379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.790564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.790587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.790603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.793069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.802125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.802465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.802611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.802638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.802656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.802809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.802994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.803015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.803028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.805428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.814802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.815134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.815245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.815273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.815290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.815419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.815553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.815576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.815592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.817894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.827551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.828001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.828186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.828212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.828229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.828363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.828533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.828557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.828574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.830901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.840144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.840551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.840704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.840748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.840766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.840937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.841148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.841172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.841190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.843529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.852801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.853095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.853239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.853278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.853296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.853443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.853594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.853617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.853633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.856023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.865219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.865540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.865671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.865705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.865723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.380 [2024-11-19 15:28:38.865872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.380 [2024-11-19 15:28:38.865995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.380 [2024-11-19 15:28:38.866019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.380 [2024-11-19 15:28:38.866034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.380 [2024-11-19 15:28:38.868367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.380 [2024-11-19 15:28:38.877793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.380 [2024-11-19 15:28:38.878069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.878208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.380 [2024-11-19 15:28:38.878235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.380 [2024-11-19 15:28:38.878252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.381 [2024-11-19 15:28:38.878417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.381 [2024-11-19 15:28:38.878532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.381 [2024-11-19 15:28:38.878555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.381 [2024-11-19 15:28:38.878570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.381 [2024-11-19 15:28:38.880781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.381 [2024-11-19 15:28:38.881220] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:40.381 [2024-11-19 15:28:38.881361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:40.381 [2024-11-19 15:28:38.881381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:40.381 [2024-11-19 15:28:38.881396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:40.381 [2024-11-19 15:28:38.881458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:40.381 [2024-11-19 15:28:38.881522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:40.381 [2024-11-19 15:28:38.881525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:40.381 [2024-11-19 15:28:38.890211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.381 [2024-11-19 15:28:38.890625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.890779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.890806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.381 [2024-11-19 15:28:38.890823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.381 [2024-11-19 15:28:38.890964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.381 [2024-11-19 15:28:38.891145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.381 [2024-11-19 15:28:38.891166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.381 [2024-11-19 15:28:38.891183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.381 [2024-11-19 15:28:38.893516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.381 [2024-11-19 15:28:38.902618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.381 [2024-11-19 15:28:38.903003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.903147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.903172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.381 [2024-11-19 15:28:38.903191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.381 [2024-11-19 15:28:38.903333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.381 [2024-11-19 15:28:38.903503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.381 [2024-11-19 15:28:38.903525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.381 [2024-11-19 15:28:38.903541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.381 [2024-11-19 15:28:38.905558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.381 [2024-11-19 15:28:38.914984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.381 [2024-11-19 15:28:38.915408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.915565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.915591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.381 [2024-11-19 15:28:38.915610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.381 [2024-11-19 15:28:38.915822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.381 [2024-11-19 15:28:38.915988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.381 [2024-11-19 15:28:38.916010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.381 [2024-11-19 15:28:38.916027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.381 [2024-11-19 15:28:38.918118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.381 [2024-11-19 15:28:38.927322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.381 [2024-11-19 15:28:38.927776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.927889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.381 [2024-11-19 15:28:38.927916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.381 [2024-11-19 15:28:38.927936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.381 [2024-11-19 15:28:38.928062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.381 [2024-11-19 15:28:38.928232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.381 [2024-11-19 15:28:38.928254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.381 [2024-11-19 15:28:38.928270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.381 [2024-11-19 15:28:38.930452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-19 15:28:38.939881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-19 15:28:38.940222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.940348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.940375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-19 15:28:38.940393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.641 [2024-11-19 15:28:38.940547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.641 [2024-11-19 15:28:38.940636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-19 15:28:38.940657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-19 15:28:38.940674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-19 15:28:38.942801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-19 15:28:38.952415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-19 15:28:38.952801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.952946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.952973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-19 15:28:38.952992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.641 [2024-11-19 15:28:38.953150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.641 [2024-11-19 15:28:38.953350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-19 15:28:38.953371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-19 15:28:38.953387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-19 15:28:38.955388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-19 15:28:38.964911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-19 15:28:38.965249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.965376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.965403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-19 15:28:38.965420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.641 [2024-11-19 15:28:38.965573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.641 [2024-11-19 15:28:38.965734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-19 15:28:38.965756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-19 15:28:38.965771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-19 15:28:38.967663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-19 15:28:38.977311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.641 [2024-11-19 15:28:38.977600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.977730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.641 [2024-11-19 15:28:38.977757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.641 [2024-11-19 15:28:38.977773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.641 [2024-11-19 15:28:38.977873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.641 [2024-11-19 15:28:38.978009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.641 [2024-11-19 15:28:38.978044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.641 [2024-11-19 15:28:38.978058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.641 [2024-11-19 15:28:38.980063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.641 [2024-11-19 15:28:38.989538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:38.989880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:38.990013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:38.990037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:38.990053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:38.990219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:38.990371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:38.990392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:38.990406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:38.992315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.001775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.002038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.002156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.002181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.002196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.002361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.002561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.002582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.002595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.004507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.014056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.014363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.014465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.014490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.014505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.014654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.014843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.014866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.014879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.016947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.026555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.026892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.027024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.027050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.027065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.027197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.027413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.027434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.027447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.029475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.038774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.039132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.039261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.039291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.039308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.039424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.039575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.039596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.039609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.041730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.051215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.051493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.051600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.051625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.051641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.051814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.051951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.051972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.051985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.054107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.063504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.063807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.063938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.063963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.063978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.064110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.064276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.064296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.064310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.066412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.075923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.076243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.076338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.076365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.642 [2024-11-19 15:28:39.076386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.642 [2024-11-19 15:28:39.076520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.642 [2024-11-19 15:28:39.076653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.642 [2024-11-19 15:28:39.076697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.642 [2024-11-19 15:28:39.076714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.642 [2024-11-19 15:28:39.078724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.642 [2024-11-19 15:28:39.088201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.642 [2024-11-19 15:28:39.088515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.088638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.642 [2024-11-19 15:28:39.088663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.088678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.088850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.089001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.089021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.089034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.091158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.100575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.100910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.101014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.101039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.101054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.101186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.101336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.101355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.101369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.103382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.112829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.113135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.113260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.113285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.113301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.113470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.113649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.113669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.113682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.115739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.125025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.125302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.125398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.125424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.125439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.125571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.125778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.125798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.125811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.127845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.137228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.137518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.137610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.137636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.137651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.137807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.137990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.138010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.138023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.140306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.149360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.149653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.149792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.149817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.149834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.149982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.150153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.150173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.150187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.152199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.161595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.161957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.162076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.162102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.162117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.162281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.643 [2024-11-19 15:28:39.162415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.643 [2024-11-19 15:28:39.162435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.643 [2024-11-19 15:28:39.162449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.643 [2024-11-19 15:28:39.164568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.643 [2024-11-19 15:28:39.173812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.643 [2024-11-19 15:28:39.174140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.174257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.643 [2024-11-19 15:28:39.174282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.643 [2024-11-19 15:28:39.174297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.643 [2024-11-19 15:28:39.174461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.644 [2024-11-19 15:28:39.174697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.644 [2024-11-19 15:28:39.174719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.644 [2024-11-19 15:28:39.174733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.644 [2024-11-19 15:28:39.176869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.644 [2024-11-19 15:28:39.186097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.644 [2024-11-19 15:28:39.186392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.644 [2024-11-19 15:28:39.186511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.644 [2024-11-19 15:28:39.186536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.644 [2024-11-19 15:28:39.186552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.644 [2024-11-19 15:28:39.186727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.644 [2024-11-19 15:28:39.186886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.644 [2024-11-19 15:28:39.186912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.644 [2024-11-19 15:28:39.186927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.644 [2024-11-19 15:28:39.189055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.644 [2024-11-19 15:28:39.198640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.644 [2024-11-19 15:28:39.198867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.644 [2024-11-19 15:28:39.198973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.644 [2024-11-19 15:28:39.199000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.644 [2024-11-19 15:28:39.199016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.644 [2024-11-19 15:28:39.199181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.644 [2024-11-19 15:28:39.199363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.644 [2024-11-19 15:28:39.199385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.644 [2024-11-19 15:28:39.199399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.644 [2024-11-19 15:28:39.201471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.902 [2024-11-19 15:28:39.211108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.902 [2024-11-19 15:28:39.211369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.902 [2024-11-19 15:28:39.211492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.902 [2024-11-19 15:28:39.211517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.902 [2024-11-19 15:28:39.211533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.902 [2024-11-19 15:28:39.211681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.902 [2024-11-19 15:28:39.211857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.902 [2024-11-19 15:28:39.211878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.902 [2024-11-19 15:28:39.211891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.902 [2024-11-19 15:28:39.213926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.902 [2024-11-19 15:28:39.223193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.902 [2024-11-19 15:28:39.223499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.902 [2024-11-19 15:28:39.223626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.902 [2024-11-19 15:28:39.223652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.902 [2024-11-19 15:28:39.223667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.223855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.223990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.224010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.224028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.226194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.235463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.235805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.235955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.235981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.235996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.236145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.236279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.236298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.236311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.238344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.247814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.248124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.248212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.248238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.248253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.248401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.248535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.248555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.248569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.250602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.260353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.260639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.260743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.260770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.260785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.260934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.261099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.261119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.261132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.263437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.272494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.272761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.272912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.272938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.272954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.273086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.273239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.273260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.273273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.275484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.284786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.285068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.285192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.285217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.285233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.285365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.285530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.285550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.285563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.287616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.296972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.297302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.297426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.297452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.297467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.297599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.297774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.297795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.297808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.299907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.309119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.309407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.309496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.309522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.309537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.309685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.309860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.309880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.309893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.311978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.321461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.321782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.321876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.321901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.321916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.322097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.322309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.322329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.322342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.324433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.333753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.334046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.334166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.334191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.334207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.334387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.334582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.334603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.903 [2024-11-19 15:28:39.334616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.903 [2024-11-19 15:28:39.336726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.903 [2024-11-19 15:28:39.346218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.903 [2024-11-19 15:28:39.346502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.346624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.903 [2024-11-19 15:28:39.346650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.903 [2024-11-19 15:28:39.346665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.903 [2024-11-19 15:28:39.346854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.903 [2024-11-19 15:28:39.347007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.903 [2024-11-19 15:28:39.347027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.347040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.348996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.358543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.358867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.358968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.358994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.359009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.359158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.359324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.359344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.359357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.361476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.371014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.371324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.371418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.371444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.371460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.371592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.371798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.371820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.371834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.373803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.383369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.383656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.383784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.383810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.383826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.383942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.384108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.384128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.384141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.386218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.395818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.396146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.396271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.396296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.396311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.396477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.396656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.396701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.396717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.398778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.408146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.408394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.408511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.408537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.408552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.408758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.408911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.408931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.408945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.411253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.420303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.420597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.420722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.420748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.420769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.420869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.421036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.421057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.421070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.423238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.432720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.433028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.433150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.433176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.433192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.433324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.433442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.433462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.433475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.435410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.904 [2024-11-19 15:28:39.444891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.904 [2024-11-19 15:28:39.445157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.445309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.904 [2024-11-19 15:28:39.445334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.904 [2024-11-19 15:28:39.445349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.904 [2024-11-19 15:28:39.445465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.904 [2024-11-19 15:28:39.445633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.904 [2024-11-19 15:28:39.445653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.904 [2024-11-19 15:28:39.445666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.904 [2024-11-19 15:28:39.447983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:40.905 [2024-11-19 15:28:39.457174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:40.905 [2024-11-19 15:28:39.457480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-19 15:28:39.457600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:40.905 [2024-11-19 15:28:39.457625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:40.905 [2024-11-19 15:28:39.457641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:40.905 [2024-11-19 15:28:39.457837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:40.905 [2024-11-19 15:28:39.457991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:40.905 [2024-11-19 15:28:39.458011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:40.905 [2024-11-19 15:28:39.458025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:40.905 [2024-11-19 15:28:39.460469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.163 [2024-11-19 15:28:39.469593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.163 [2024-11-19 15:28:39.469868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.469959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.469983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.163 [2024-11-19 15:28:39.469998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.163 [2024-11-19 15:28:39.470130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.163 [2024-11-19 15:28:39.470282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.163 [2024-11-19 15:28:39.470303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.163 [2024-11-19 15:28:39.470316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.163 [2024-11-19 15:28:39.472405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.163 [2024-11-19 15:28:39.482023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.163 [2024-11-19 15:28:39.482292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.482413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.482437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.163 [2024-11-19 15:28:39.482452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.163 [2024-11-19 15:28:39.482617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.163 [2024-11-19 15:28:39.482859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.163 [2024-11-19 15:28:39.482881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.163 [2024-11-19 15:28:39.482895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.163 [2024-11-19 15:28:39.484985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.163 [2024-11-19 15:28:39.494273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.163 [2024-11-19 15:28:39.494537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.494632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.494657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.163 [2024-11-19 15:28:39.494672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.163 [2024-11-19 15:28:39.494828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.163 [2024-11-19 15:28:39.494970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.163 [2024-11-19 15:28:39.495005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.163 [2024-11-19 15:28:39.495018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.163 [2024-11-19 15:28:39.497047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.163 [2024-11-19 15:28:39.506581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.163 [2024-11-19 15:28:39.506879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.507026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.507050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.163 [2024-11-19 15:28:39.507065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.163 [2024-11-19 15:28:39.507246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.163 [2024-11-19 15:28:39.507427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.163 [2024-11-19 15:28:39.507447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.163 [2024-11-19 15:28:39.507461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.163 [2024-11-19 15:28:39.509729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.163 [2024-11-19 15:28:39.518941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.163 [2024-11-19 15:28:39.519256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.519352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.163 [2024-11-19 15:28:39.519376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.519391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.519555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.519717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.519739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.519752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.521883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.531063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.531370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.531459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.531484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.531500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.531631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.531809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.531835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.531850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.533993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.543379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.543696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.543846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.543871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.543886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.544019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.544187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.544222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.544236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.546257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.555661] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.555966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.556090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.556114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.556129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.556260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.556461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.556481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.556494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.558504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.568022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.568292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.568440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.568466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.568481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.568629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.568824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.568846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.568867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.570982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.580095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.580428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.580523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.580548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.580563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.580736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.580920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.580941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.580955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.583047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.592404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.592660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.592805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.592830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.592845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.593026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.593207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.593227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.593240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.595338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.604724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.604978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.605069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.605094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.605109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.164 [2024-11-19 15:28:39.605241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.164 [2024-11-19 15:28:39.605425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.164 [2024-11-19 15:28:39.605446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.164 [2024-11-19 15:28:39.605475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.164 [2024-11-19 15:28:39.607533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.164 [2024-11-19 15:28:39.616906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.164 [2024-11-19 15:28:39.617220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.617317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.164 [2024-11-19 15:28:39.617342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.164 [2024-11-19 15:28:39.617357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.617506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.617643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.617663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.617701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.619939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.629295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.629604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.629717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.629743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.629760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.629909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.630061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.630082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.630095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.631990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.641459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.641785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.641904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.641929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.641944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.642093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.642261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.642282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.642295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.644436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.653774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.654031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.654155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.654180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.654195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.654311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.654464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.654498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.654511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.656742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.666277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.666544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.666698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.666725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.666740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.666937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.667102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.667123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.667136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.669457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.678408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.678697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.678798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.678822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.678838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.678986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.679138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.679159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.679173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.681177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 15:28:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:41.165 15:28:39 -- common/autotest_common.sh@862 -- # return 0 00:27:41.165 15:28:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:41.165 15:28:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:41.165 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.165 [2024-11-19 15:28:39.690525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.690832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.690956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.690981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.690997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.691130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.691266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.691303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.691317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.693368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 [2024-11-19 15:28:39.702969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.165 [2024-11-19 15:28:39.703264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.703378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.165 [2024-11-19 15:28:39.703403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.165 [2024-11-19 15:28:39.703420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.165 [2024-11-19 15:28:39.703568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.165 [2024-11-19 15:28:39.703781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.165 [2024-11-19 15:28:39.703803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.165 [2024-11-19 15:28:39.703817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.165 [2024-11-19 15:28:39.705942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.165 15:28:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:41.165 15:28:39 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:41.166 15:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:41.166 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.166 [2024-11-19 15:28:39.712266] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:41.166 [2024-11-19 15:28:39.715411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.166 [2024-11-19 15:28:39.715659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.166 [2024-11-19 15:28:39.715769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.166 [2024-11-19 15:28:39.715793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.166 [2024-11-19 15:28:39.715808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.166 [2024-11-19 15:28:39.715973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.166 [2024-11-19 15:28:39.716109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.166 [2024-11-19 15:28:39.716135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.166 [2024-11-19 15:28:39.716164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.166 15:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:41.166 15:28:39 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:41.166 [2024-11-19 15:28:39.718224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.166 15:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:41.166 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.425 [2024-11-19 15:28:39.727645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.727933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.728077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.728102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.425 [2024-11-19 15:28:39.728117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.425 [2024-11-19 15:28:39.728282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.425 [2024-11-19 15:28:39.728461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.425 [2024-11-19 15:28:39.728480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.425 [2024-11-19 15:28:39.728493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.425 [2024-11-19 15:28:39.730746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.425 [2024-11-19 15:28:39.740112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.740419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.740524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.740549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.425 [2024-11-19 15:28:39.740564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.425 [2024-11-19 15:28:39.740759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.425 [2024-11-19 15:28:39.740929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.425 [2024-11-19 15:28:39.740949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.425 [2024-11-19 15:28:39.740963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.425 [2024-11-19 15:28:39.743237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.425 [2024-11-19 15:28:39.752432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.752869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.752994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.753023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.425 [2024-11-19 15:28:39.753042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.425 [2024-11-19 15:28:39.753215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.425 [2024-11-19 15:28:39.753363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.425 [2024-11-19 15:28:39.753384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.425 [2024-11-19 15:28:39.753400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.425 [2024-11-19 15:28:39.755699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.425 Malloc0 00:27:41.425 15:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:41.425 15:28:39 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:41.425 15:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:41.425 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.425 [2024-11-19 15:28:39.764853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.765158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.765286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.765311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1676160 with addr=10.0.0.2, port=4420 00:27:41.425 [2024-11-19 15:28:39.765326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1676160 is same with the state(5) to be set 00:27:41.425 [2024-11-19 15:28:39.765459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.425 15:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:41.425 [2024-11-19 15:28:39.765676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.425 [2024-11-19 15:28:39.765713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.425 [2024-11-19 15:28:39.765728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.425 15:28:39 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:41.425 15:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:41.425 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.425 [2024-11-19 15:28:39.767804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.425 15:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:41.425 15:28:39 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:41.425 15:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:41.425 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:27:41.425 [2024-11-19 15:28:39.777200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.777518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.425 [2024-11-19 15:28:39.777648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:41.425 [2024-11-19 15:28:39.779950] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:27:41.425 [2024-11-19 15:28:39.780020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (107): Transport endpoint is not connected 00:27:41.425 [2024-11-19 15:28:39.780233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1676160 (9): Bad file descriptor 00:27:41.425 [2024-11-19 15:28:39.780405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.425 [2024-11-19 15:28:39.780427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.425 [2024-11-19 15:28:39.780442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.425 15:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:41.425 15:28:39 -- host/bdevperf.sh@38 -- # wait 2884171 00:27:41.425 [2024-11-19 15:28:39.782594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.425 [2024-11-19 15:28:39.789439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.425 [2024-11-19 15:28:39.863293] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:51.398 00:27:51.398 Latency(us) 00:27:51.398 [2024-11-19T14:28:49.961Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:51.398 [2024-11-19T14:28:49.961Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:51.398 Verification LBA range: start 0x0 length 0x4000 00:27:51.398 Nvme1n1 : 15.05 9368.22 36.59 16066.84 0.00 5004.85 640.19 41360.50 00:27:51.398 [2024-11-19T14:28:49.961Z] =================================================================================================================== 00:27:51.398 [2024-11-19T14:28:49.961Z] Total : 9368.22 36.59 16066.84 0.00 5004.85 640.19 41360.50 00:27:51.398 15:28:48 -- host/bdevperf.sh@39 -- # sync 00:27:51.398 15:28:48 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:51.398 15:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:51.398 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:27:51.398 15:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:51.398 15:28:48 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:51.398 15:28:48 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:51.398 15:28:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:51.398 15:28:48 -- nvmf/common.sh@116 -- # sync 00:27:51.398 15:28:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:51.398 15:28:48 -- nvmf/common.sh@119 -- # set +e 00:27:51.398 15:28:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:51.398 15:28:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:51.398 rmmod nvme_tcp 00:27:51.398 rmmod nvme_fabrics 00:27:51.398 rmmod nvme_keyring 00:27:51.398 15:28:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:51.398 15:28:48 -- nvmf/common.sh@123 -- # set -e 00:27:51.398 15:28:48 -- nvmf/common.sh@124 -- # return 0 00:27:51.398 15:28:48 -- nvmf/common.sh@477 -- # '[' -n 2884863 ']' 00:27:51.398 15:28:48 -- nvmf/common.sh@478 -- # killprocess 2884863 00:27:51.398 15:28:48 -- common/autotest_common.sh@936 -- # '[' -z 2884863 ']' 00:27:51.398 15:28:48 -- common/autotest_common.sh@940 -- # kill -0 2884863 00:27:51.398 15:28:48 -- common/autotest_common.sh@941 -- # uname 00:27:51.398 15:28:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:51.398 15:28:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2884863 00:27:51.398 15:28:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:51.398 15:28:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:51.398 15:28:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2884863' 00:27:51.398 killing process with pid 2884863 00:27:51.398 15:28:48 -- common/autotest_common.sh@955 -- # kill 2884863 00:27:51.398 15:28:48 -- common/autotest_common.sh@960 -- # wait 2884863 00:27:51.398 15:28:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:51.398 15:28:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:51.398 15:28:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:51.398 15:28:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:51.398 15:28:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:51.398 15:28:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:51.398 15:28:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:51.398 15:28:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.777 15:28:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:52.777 00:27:52.777 real 0m23.324s 00:27:52.777 user 1m3.488s 00:27:52.777 sys 0m4.029s 00:27:52.777 15:28:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:52.777 15:28:50 -- common/autotest_common.sh@10 -- # set +x 00:27:52.777 ************************************ 00:27:52.777 END TEST nvmf_bdevperf 00:27:52.777 ************************************ 00:27:52.777 15:28:50 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:52.777 15:28:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:52.777 15:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:52.777 15:28:50 -- common/autotest_common.sh@10 -- # set +x 00:27:52.777 ************************************ 00:27:52.777 START TEST nvmf_target_disconnect 00:27:52.777 ************************************ 00:27:52.777 15:28:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:52.777 * Looking for test storage... 00:27:52.777 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:52.777 15:28:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:52.777 15:28:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:52.777 15:28:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:52.777 15:28:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:52.777 15:28:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:52.777 15:28:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:52.777 15:28:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:52.777 15:28:51 -- scripts/common.sh@335 -- # IFS=.-: 00:27:52.777 15:28:51 -- scripts/common.sh@335 -- # read -ra ver1 00:27:52.777 15:28:51 -- scripts/common.sh@336 -- # IFS=.-: 00:27:52.777 15:28:51 -- scripts/common.sh@336 -- # read -ra ver2 00:27:52.777 15:28:51 -- scripts/common.sh@337 -- # local 'op=<' 00:27:52.777 15:28:51 -- scripts/common.sh@339 -- # ver1_l=2 00:27:52.777 15:28:51 -- scripts/common.sh@340 -- # ver2_l=1 00:27:52.777 15:28:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:52.777 15:28:51 -- scripts/common.sh@343 -- # case "$op" in 00:27:52.777 15:28:51 -- scripts/common.sh@344 -- # : 1 00:27:52.777 15:28:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:52.777 15:28:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:52.777 15:28:51 -- scripts/common.sh@364 -- # decimal 1 00:27:52.777 15:28:51 -- scripts/common.sh@352 -- # local d=1 00:27:52.777 15:28:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:52.777 15:28:51 -- scripts/common.sh@354 -- # echo 1 00:27:52.777 15:28:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:52.777 15:28:51 -- scripts/common.sh@365 -- # decimal 2 00:27:52.777 15:28:51 -- scripts/common.sh@352 -- # local d=2 00:27:52.777 15:28:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:52.777 15:28:51 -- scripts/common.sh@354 -- # echo 2 00:27:52.777 15:28:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:52.777 15:28:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:52.777 15:28:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:52.777 15:28:51 -- scripts/common.sh@367 -- # return 0 00:27:52.777 15:28:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:52.777 15:28:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:52.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.777 --rc genhtml_branch_coverage=1 00:27:52.777 --rc genhtml_function_coverage=1 00:27:52.777 --rc genhtml_legend=1 00:27:52.777 --rc geninfo_all_blocks=1 00:27:52.777 --rc geninfo_unexecuted_blocks=1 00:27:52.777 00:27:52.777 ' 00:27:52.777 15:28:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:52.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.777 --rc genhtml_branch_coverage=1 00:27:52.777 --rc genhtml_function_coverage=1 00:27:52.777 --rc genhtml_legend=1 00:27:52.777 --rc geninfo_all_blocks=1 00:27:52.777 --rc geninfo_unexecuted_blocks=1 00:27:52.777 00:27:52.777 ' 00:27:52.777 15:28:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:52.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.777 --rc genhtml_branch_coverage=1 00:27:52.777 --rc genhtml_function_coverage=1 00:27:52.777 --rc genhtml_legend=1 00:27:52.777 --rc geninfo_all_blocks=1 00:27:52.777 --rc geninfo_unexecuted_blocks=1 00:27:52.777 00:27:52.777 ' 00:27:52.777 15:28:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:52.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:52.777 --rc genhtml_branch_coverage=1 00:27:52.777 --rc genhtml_function_coverage=1 00:27:52.777 --rc genhtml_legend=1 00:27:52.777 --rc geninfo_all_blocks=1 00:27:52.777 --rc geninfo_unexecuted_blocks=1 00:27:52.777 00:27:52.777 ' 00:27:52.777 15:28:51 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:52.777 15:28:51 -- nvmf/common.sh@7 -- # uname -s 00:27:52.777 15:28:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:52.777 15:28:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:52.777 15:28:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:52.777 15:28:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:52.777 15:28:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:52.777 15:28:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:52.777 15:28:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:52.777 15:28:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:52.777 15:28:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:52.777 15:28:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:52.777 15:28:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.777 15:28:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:52.777 15:28:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:52.777 15:28:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:52.777 15:28:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:52.777 15:28:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:52.777 15:28:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:52.777 15:28:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:52.777 15:28:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:52.777 15:28:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.777 15:28:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.778 15:28:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.778 15:28:51 -- paths/export.sh@5 -- # export PATH 00:27:52.778 15:28:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:52.778 15:28:51 -- nvmf/common.sh@46 -- # : 0 00:27:52.778 15:28:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:52.778 15:28:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:52.778 15:28:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:52.778 15:28:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:52.778 15:28:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:52.778 15:28:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:52.778 15:28:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:52.778 15:28:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:52.778 15:28:51 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:52.778 15:28:51 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:52.778 15:28:51 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:52.778 15:28:51 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:52.778 15:28:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:52.778 15:28:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:52.778 15:28:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:52.778 15:28:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:52.778 15:28:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:52.778 15:28:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:52.778 15:28:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:52.778 15:28:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:52.778 15:28:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:52.778 15:28:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:52.778 15:28:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:52.778 15:28:51 -- common/autotest_common.sh@10 -- # set +x 00:27:54.681 15:28:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:54.681 15:28:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:54.681 15:28:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:54.681 15:28:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:54.681 15:28:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:54.681 15:28:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:54.681 15:28:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:54.681 15:28:53 -- nvmf/common.sh@294 -- # net_devs=() 00:27:54.681 15:28:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:54.681 15:28:53 -- nvmf/common.sh@295 -- # e810=() 00:27:54.681 15:28:53 -- nvmf/common.sh@295 -- # local -ga e810 00:27:54.681 15:28:53 -- nvmf/common.sh@296 -- # x722=() 00:27:54.681 15:28:53 -- nvmf/common.sh@296 -- # local -ga x722 00:27:54.681 15:28:53 -- nvmf/common.sh@297 -- # mlx=() 00:27:54.681 15:28:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:54.681 15:28:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:54.681 15:28:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:54.681 15:28:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:54.681 15:28:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:54.681 15:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.681 15:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:54.681 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:54.681 15:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.681 15:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:54.682 15:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:54.682 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:54.682 15:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:54.682 15:28:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.682 15:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.682 15:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.682 15:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.682 15:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:54.682 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:54.682 15:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.682 15:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:54.682 15:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:54.682 15:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:54.682 15:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:54.682 15:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:54.682 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:54.682 15:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:54.682 15:28:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:54.682 15:28:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:54.682 15:28:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:54.682 15:28:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:54.682 15:28:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:54.682 15:28:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:54.682 15:28:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:54.682 15:28:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:54.682 15:28:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:54.682 15:28:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:54.682 15:28:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:54.682 15:28:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:54.682 15:28:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:54.682 15:28:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:54.682 15:28:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:54.682 15:28:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:54.682 15:28:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:54.941 15:28:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:54.941 15:28:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:54.941 15:28:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:54.941 15:28:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:54.941 15:28:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:54.941 15:28:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:54.941 15:28:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:54.941 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:54.941 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:27:54.941 00:27:54.941 --- 10.0.0.2 ping statistics --- 00:27:54.941 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.941 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:27:54.941 15:28:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:54.941 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:54.941 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:27:54.941 00:27:54.941 --- 10.0.0.1 ping statistics --- 00:27:54.941 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:54.941 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:27:54.941 15:28:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:54.941 15:28:53 -- nvmf/common.sh@410 -- # return 0 00:27:54.941 15:28:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:54.941 15:28:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:54.941 15:28:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:54.941 15:28:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:54.941 15:28:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:54.941 15:28:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:54.941 15:28:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:54.941 15:28:53 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:54.941 15:28:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:54.941 15:28:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:54.941 15:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:54.941 ************************************ 00:27:54.941 START TEST nvmf_target_disconnect_tc1 00:27:54.941 ************************************ 00:27:54.941 15:28:53 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:54.941 15:28:53 -- host/target_disconnect.sh@32 -- # set +e 00:27:54.941 15:28:53 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:54.941 EAL: No free 2048 kB hugepages reported on node 1 00:27:54.941 [2024-11-19 15:28:53.427651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-11-19 15:28:53.427880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-11-19 15:28:53.427908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xce1b40 with addr=10.0.0.2, port=4420 00:27:54.941 [2024-11-19 15:28:53.427938] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:54.941 [2024-11-19 15:28:53.427957] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:54.941 [2024-11-19 15:28:53.427970] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:54.941 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:54.941 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:54.941 Initializing NVMe Controllers 00:27:54.941 15:28:53 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:54.941 15:28:53 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:54.941 15:28:53 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:54.941 15:28:53 -- common/autotest_common.sh@1142 -- # return 0 00:27:54.941 15:28:53 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:54.941 15:28:53 -- host/target_disconnect.sh@41 -- # set -e 00:27:54.941 00:27:54.941 real 0m0.081s 00:27:54.941 user 0m0.034s 00:27:54.941 sys 0m0.047s 00:27:54.941 15:28:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:54.941 15:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:54.941 ************************************ 00:27:54.941 END TEST nvmf_target_disconnect_tc1 00:27:54.941 ************************************ 00:27:54.941 15:28:53 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:54.941 15:28:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:54.941 15:28:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:54.941 15:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:54.941 ************************************ 00:27:54.941 START TEST nvmf_target_disconnect_tc2 00:27:54.941 ************************************ 00:27:54.941 15:28:53 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:54.941 15:28:53 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:54.941 15:28:53 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:54.941 15:28:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:54.941 15:28:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:54.942 15:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:54.942 15:28:53 -- nvmf/common.sh@469 -- # nvmfpid=2888066 00:27:54.942 15:28:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:54.942 15:28:53 -- nvmf/common.sh@470 -- # waitforlisten 2888066 00:27:54.942 15:28:53 -- common/autotest_common.sh@829 -- # '[' -z 2888066 ']' 00:27:54.942 15:28:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:54.942 15:28:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:54.942 15:28:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:54.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:54.942 15:28:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:54.942 15:28:53 -- common/autotest_common.sh@10 -- # set +x 00:27:55.200 [2024-11-19 15:28:53.504549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:55.200 [2024-11-19 15:28:53.504631] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:55.200 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.200 [2024-11-19 15:28:53.566950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:55.200 [2024-11-19 15:28:53.670407] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:55.200 [2024-11-19 15:28:53.670545] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:55.200 [2024-11-19 15:28:53.670568] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:55.200 [2024-11-19 15:28:53.670582] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:55.200 [2024-11-19 15:28:53.670816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:55.201 [2024-11-19 15:28:53.670841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:55.201 [2024-11-19 15:28:53.670888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:55.201 [2024-11-19 15:28:53.670892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:56.134 15:28:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:56.134 15:28:54 -- common/autotest_common.sh@862 -- # return 0 00:27:56.134 15:28:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:56.134 15:28:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 15:28:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:56.134 15:28:54 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 Malloc0 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 [2024-11-19 15:28:54.599844] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 [2024-11-19 15:28:54.628112] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:56.134 15:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.134 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:27:56.134 15:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.134 15:28:54 -- host/target_disconnect.sh@50 -- # reconnectpid=2888228 00:27:56.134 15:28:54 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:56.135 15:28:54 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:56.135 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.690 15:28:56 -- host/target_disconnect.sh@53 -- # kill -9 2888066 00:27:58.690 15:28:56 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.690 starting I/O failed 00:27:58.690 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 [2024-11-19 15:28:56.651490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 [2024-11-19 15:28:56.651818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Write completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 Read completed with error (sct=0, sc=8) 00:27:58.691 starting I/O failed 00:27:58.691 [2024-11-19 15:28:56.652110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:58.691 [2024-11-19 15:28:56.652266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.691 qpair failed and we were unable to recover it. 00:27:58.691 [2024-11-19 15:28:56.652570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.691 qpair failed and we were unable to recover it. 00:27:58.691 [2024-11-19 15:28:56.652863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.652983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.691 qpair failed and we were unable to recover it. 00:27:58.691 [2024-11-19 15:28:56.653112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.653283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.653310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.691 qpair failed and we were unable to recover it. 00:27:58.691 [2024-11-19 15:28:56.653468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.653608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.691 [2024-11-19 15:28:56.653637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.653773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.653868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.653892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.653996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.654295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.654599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.654862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.654977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.655164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.655530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.655798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.655920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.656071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.656371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.656620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.656865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.656988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.657103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.657323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.657596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.657867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.657981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.658104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.658370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.658692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.658842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.658930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.659194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.659484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.659774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.659893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.660008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.660251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.660561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.660814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.660936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.692 [2024-11-19 15:28:56.661024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.661115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.692 [2024-11-19 15:28:56.661139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.692 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.661259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.661550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.661769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.661890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.662023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.662310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.662556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.662870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.662987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.663082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.663410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.663700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.663851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.663948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.664144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.664448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.664763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.664882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.664981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.665195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.665491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.665804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.665947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.666096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.666383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.666650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.666862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.666977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.667066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.667324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.667580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.667848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.667971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.668062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.668207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.668232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.668350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.668444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.668470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.693 qpair failed and we were unable to recover it. 00:27:58.693 [2024-11-19 15:28:56.668589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.693 [2024-11-19 15:28:56.668671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.668712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.668808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.668899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.668924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.669019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.669317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.669565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.669860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.669975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.670122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.670390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.670652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.670803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.670922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.671161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.671424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.671702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.671841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.671989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.672288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.672521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.672723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.672858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.672982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.673278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.673532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.673836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.673977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.674103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.674391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.674606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.674754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.674876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.675180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.675477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.675722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.675892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.694 [2024-11-19 15:28:56.675984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.676107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.694 [2024-11-19 15:28:56.676133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.694 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.676233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.676550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.676806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.676957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.677102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.677338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.677600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.677815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.677933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.678060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.678377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.678668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.678790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.678945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.679212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.679468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.679716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.679829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.679971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.680200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.680442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.680681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.680835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.680954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.681267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.681532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.681795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.681934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.695 qpair failed and we were unable to recover it. 00:27:58.695 [2024-11-19 15:28:56.682049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.682196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.695 [2024-11-19 15:28:56.682222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.682346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.682627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.682848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.682958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.683050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.683330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.683594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.683810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.683919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.684011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.684269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.684497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.684769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.684910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.685054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.685337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.685659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.685780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.685907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.686344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.686614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.686907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.686988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.687138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.687432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.687773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.687923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.688043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.688304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.688600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.688871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.688981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.689123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.689388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.689683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.696 [2024-11-19 15:28:56.689855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.696 qpair failed and we were unable to recover it. 00:27:58.696 [2024-11-19 15:28:56.689982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.690227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.690468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.690709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.690852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.690958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.691338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.691578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.691874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.691995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.692163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.692429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.692682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.692859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.692944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.693253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.693512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.693781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.693933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.694061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.694351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.694626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.694797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.694958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.695219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.695464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.695701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.695839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.695998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.696281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.696573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.696889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.696984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.697093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.697310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.697 qpair failed and we were unable to recover it. 00:27:58.697 [2024-11-19 15:28:56.697513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.697 [2024-11-19 15:28:56.697637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.697662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.697780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.697927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.697953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.698061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.698383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.698701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.698820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.698955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.699184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.699441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.699724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.699859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.699998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.700190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.700421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.700683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.700834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.700953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.701153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.701418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.701776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.701918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.702086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.702331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.702582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.702891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.702977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.703119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.703367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.703607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.703840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.703983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.704130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.704415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.704684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.704840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.704936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.705032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.698 [2024-11-19 15:28:56.705062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.698 qpair failed and we were unable to recover it. 00:27:58.698 [2024-11-19 15:28:56.705158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.705426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.705699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.705816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.705932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.706173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.706464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.706726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.706864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.706952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.707247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.707569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.707819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.707953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.708095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.708424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.708712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.708896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.709017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.709231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.709492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.709749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.709905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.710068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.710309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.710588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.710843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.710961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.711057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.711291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.711608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.711874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.711995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.712020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.712113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.712260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.712285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.699 [2024-11-19 15:28:56.712449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.712529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.699 [2024-11-19 15:28:56.712554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.699 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.712643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.712759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.712785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.712935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.713261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.713482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.713769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.713937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.714036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.714298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.714654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.714826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.714920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.715217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.715456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.715740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.715888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.715982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.716242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.716531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.716986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.717154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.717453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.717735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.717905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.718051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.718355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.718665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.718836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.718965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.719107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.719132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.719273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.719443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.719468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.700 qpair failed and we were unable to recover it. 00:27:58.700 [2024-11-19 15:28:56.719613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.700 [2024-11-19 15:28:56.719758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.719787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.719901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.719996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.720160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.720448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.720677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.720799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.720917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.721247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.721481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.721723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.721865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.722012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.722227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.722445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.722780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.722947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.723058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.723300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.723597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.723838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.723986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.724148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.724436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.724700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.724816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.724976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.725200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.725463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.725765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.725910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.726063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.726409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.726685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.726819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.726917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.727020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.727049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.701 qpair failed and we were unable to recover it. 00:27:58.701 [2024-11-19 15:28:56.727162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.701 [2024-11-19 15:28:56.727261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.727285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.727385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.727477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.727501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.727587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.727742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.727772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.727939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.728198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.728462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.728725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.728867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.728962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.729299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.729576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.729709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.729834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.730153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.730457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.730663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.730816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.730942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.731195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.731492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.731804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.731990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.732158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.732413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.732724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.732906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.733031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.733300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.733623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.733763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.733901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.734141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.734485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.734782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.734928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.735051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.735191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.702 [2024-11-19 15:28:56.735220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.702 qpair failed and we were unable to recover it. 00:27:58.702 [2024-11-19 15:28:56.735317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.735416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.735444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.735615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.735753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.735779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.735944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.736228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.736463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.736732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.736927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.737020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.737258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.737502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.737732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.737850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.737938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.738204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.738449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.738744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.738857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.738960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.739219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.739455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.739802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.739951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.740126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.740369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.740566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.740904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.740990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.741144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.741463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.741724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.741882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.742030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.742308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.742555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.703 [2024-11-19 15:28:56.742848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.703 [2024-11-19 15:28:56.742963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.703 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.743098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.743337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.743554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.743803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.743911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.744044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.744309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.744585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.744747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.745179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.745484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.745781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.745947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.746057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.746331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.746686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.746810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.746929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.747230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.747556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.747834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.747984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.748125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.748346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.748602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.748777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.748972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.749227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.749507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-19 15:28:56.749761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.704 [2024-11-19 15:28:56.749939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.704 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.750032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.750267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.750501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.750698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.750814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.750996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.751313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.751589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.751887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.751982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.752137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.752411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.752744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.752882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.753014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.753299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.753600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.753742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.753852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.754198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.754459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.754674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.754801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.754947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.755218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.755545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.755845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.755975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.756089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.756350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.756579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.756824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.756975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.757151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.757398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-19 15:28:56.757659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.705 [2024-11-19 15:28:56.757761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.757786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.757907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.758160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.758355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.758657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.758802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.758961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.759216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.759482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.759829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.759974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.760345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.760698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.760845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.760970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.761196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.761428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.761713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.761856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.761955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.762245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.762488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.762752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.762915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.763084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.763370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.763611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.763845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.763993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.764159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.764487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.764745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.764886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.765006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.765121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.765146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-19 15:28:56.765322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.765454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.706 [2024-11-19 15:28:56.765481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.765616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.765757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.765782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.765903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.765997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.766189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.766496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.766781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.766892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.767021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.767310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.767601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.767772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.767883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.768154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.768383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.768605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.768778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.768899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.769254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.769562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.769826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.769988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.770112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.770388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.770658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.770817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.770950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.771213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.771516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.771716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.771837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.771937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.772238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.772512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.772776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.772893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.773041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.773159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.773184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-19 15:28:56.773307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.773391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.707 [2024-11-19 15:28:56.773417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.773528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.773644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.773669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.773771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.773862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.773885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.774032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.774292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.774530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.774806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.774950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.775092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.775305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.775566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.775854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.775993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.776158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.776396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.776657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.776829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.776925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.777184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.777421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.777759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.777885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.778030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.778330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.778591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.778780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.778922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.779217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.779503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.779740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.779855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.780013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.780253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.780513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.780789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.780917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.708 qpair failed and we were unable to recover it. 00:27:58.708 [2024-11-19 15:28:56.781043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.708 [2024-11-19 15:28:56.781185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.781210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.781324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.781469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.781494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.781611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.781793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.781821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.781947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.782265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.782547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.782851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.782979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.783147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.783411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.783711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.783879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.784000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.784287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.784547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.784745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.784867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.785200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.785543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.785829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.785973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.786117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.786408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.786715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.786886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.787030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.787294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.787556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.787831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.787983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.709 [2024-11-19 15:28:56.788009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.709 qpair failed and we were unable to recover it. 00:27:58.709 [2024-11-19 15:28:56.788127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.788332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.788565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.788837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.788978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.789174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.789460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.789722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.789854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.790012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.790286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.790550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.790823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.790944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.791066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.791304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.791620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.791791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.791892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.792192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.792517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.792821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.792999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.793095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.793356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.793592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.793853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.793981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.794069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.794390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.794657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.794807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.794979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.795255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.795544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.710 [2024-11-19 15:28:56.795799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.710 [2024-11-19 15:28:56.795942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.710 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.796097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.796345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.796755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.796870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.797162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.797497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.797807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.797936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.798077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.798383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.798636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.798809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.798956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.799187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.799448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.799748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.799894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.800007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.800242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.800537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.800807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.800948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.801072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.801329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.801585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.801850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.801978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.802134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.802460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.802822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.802951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.803046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.803260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.803533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.711 [2024-11-19 15:28:56.803776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.711 qpair failed and we were unable to recover it. 00:27:58.711 [2024-11-19 15:28:56.803929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.804181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.804435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.804730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.804893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.805014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.805262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.805526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.805813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.805951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.806084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.806274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.806515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.806794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.806990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.807162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.807435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.807719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.807875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.808023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.808306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.808576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.808843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.808960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.809145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.809387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.809648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.809893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.809991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.810139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.810459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.810696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.810858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.810966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.811133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.811158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.811277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.811378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.811405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.712 qpair failed and we were unable to recover it. 00:27:58.712 [2024-11-19 15:28:56.811553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.712 [2024-11-19 15:28:56.811677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.811707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.811825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.811924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.811951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.812083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.812367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.812706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.812889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.813026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.813298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.813590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.813735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.813883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.814118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.814400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.814634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.814799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.814916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.815164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.815423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.815735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.815884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.816005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.816294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.816589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.816751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.816863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.817139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.817462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.817711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.817870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.817970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.818304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.818739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.818874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.819163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.713 qpair failed and we were unable to recover it. 00:27:58.713 [2024-11-19 15:28:56.819444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.713 [2024-11-19 15:28:56.819615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.819744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.819877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.819919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.820037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.820348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.820594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.820863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.820994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.821091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.821371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.821651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.821871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.821990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.822102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.822386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.822657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.822803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.822930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.823166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.823419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.823669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.823815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.823965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.824254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.824593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.824873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.824999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.825134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.825452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.825734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.825853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.825980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.826125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.826150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.714 qpair failed and we were unable to recover it. 00:27:58.714 [2024-11-19 15:28:56.826287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.714 [2024-11-19 15:28:56.826435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.826459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.826576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.826719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.826747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.826876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.826981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.827183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.827503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.827780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.827897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.828041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.828269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.828515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.828715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.828865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.829186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.829518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.829730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.829869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.829967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.830293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.830542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.830858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.830992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.831152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.831445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.831717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.831833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.831923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.832217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.832498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.832844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.832954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.833086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.833490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.833758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.833881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.834054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.834165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.834189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.715 qpair failed and we were unable to recover it. 00:27:58.715 [2024-11-19 15:28:56.834301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.834416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.715 [2024-11-19 15:28:56.834440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.834588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.834695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.834737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.834834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.834949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.834990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.835090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.835387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.835698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.835840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.835951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.836235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.836469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.836846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.836989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.837145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.837378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.837695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.837850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.837998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.838260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.838538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.838859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.838984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.839175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.839458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.839760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.839901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.840050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.840304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.840547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.840887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.840973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.841149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.841536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.841883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.841976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.842000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.842127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.842244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.842269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.716 qpair failed and we were unable to recover it. 00:27:58.716 [2024-11-19 15:28:56.842393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.716 [2024-11-19 15:28:56.842543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.842568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.842668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.842804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.842828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.842972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.843237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.843505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.843787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.843930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.844047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.844291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.844493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.844849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.844994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.845104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.845400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.845635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.845881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.845995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.846150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.846401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.846706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.846892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.847039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.847351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.847614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.847762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.847868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.848174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.848433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.848787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.848986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.849139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.849436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.849720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.849913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.850053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.850150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.850174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.850327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.850407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.717 [2024-11-19 15:28:56.850432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.717 qpair failed and we were unable to recover it. 00:27:58.717 [2024-11-19 15:28:56.850526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.850668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.850700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.850808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.850908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.850935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.851103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.851391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.851670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.851823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.851945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.852216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.852447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.852732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.852892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.853007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.853286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.853601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.853765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.853895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.854192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.854466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.854697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.854829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.854989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.855288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.855518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.855750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.855884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.856213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.856523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.856789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.856966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.857148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.857315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.857358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.857510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.857653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.857678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.718 qpair failed and we were unable to recover it. 00:27:58.718 [2024-11-19 15:28:56.857790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.718 [2024-11-19 15:28:56.857879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.857910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.858012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.858261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.858526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.858809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.858930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.859052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.859311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.859546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.859840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.859991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.860108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.860338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.860609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.860750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.860901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.861176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.861447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.861674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.861857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.861942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.862209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.862483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.862745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.862901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.863023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.863301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.863532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.863799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.863981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.864121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.864439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.864751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.864957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.865050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.865218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.865260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.719 qpair failed and we were unable to recover it. 00:27:58.719 [2024-11-19 15:28:56.865380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.719 [2024-11-19 15:28:56.865477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.865503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.865624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.865742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.865768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.865871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.865995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.866112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.866400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.866664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.866861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.866988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.867367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.867667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.867854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.867966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.868311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.868591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.868733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.868827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.869200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.869446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.869657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.869811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.869931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.870232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.870523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.870821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.870930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.871052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.871276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.871530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.871843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.871964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.872111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.872341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.872571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.872876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.872995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.873020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.873138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.873223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.720 [2024-11-19 15:28:56.873249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.720 qpair failed and we were unable to recover it. 00:27:58.720 [2024-11-19 15:28:56.873374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.873495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.873522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.873655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.873755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.873782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.873905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.874147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.874418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.874669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.874790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.874945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.875213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.875460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.875740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.875882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.876027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.876252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.876528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.876777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.876913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.877017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.877288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.877497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.877776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.877929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.878050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.878293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.878530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.878838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.878984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.879115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.879411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.879680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.879824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.879972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.880272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.880517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.721 qpair failed and we were unable to recover it. 00:27:58.721 [2024-11-19 15:28:56.880771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.721 [2024-11-19 15:28:56.880923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.880948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.881077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.881397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.881639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.881811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.881961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.882243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.882523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.882824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.882960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.883092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.883382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.883667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.883799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.883964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.884225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.884511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.884874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.884998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.885128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.885462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.885763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.885923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.886055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.886314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.886598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.886739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.886891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.887211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.887501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.887799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.887911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.888093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.888457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.888746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.888862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.722 qpair failed and we were unable to recover it. 00:27:58.722 [2024-11-19 15:28:56.888970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.722 [2024-11-19 15:28:56.889130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.889157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.889318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.889473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.889500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.889609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.889701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.889726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.889875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.890199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.890525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.890825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.890975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.891125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.891462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.891806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.891929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.892056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.892330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.892663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.892812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.892903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.893220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.893532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.893697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.893858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.894169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.894440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.894784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.894928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.895047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.895328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.895644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.895834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.895928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.896037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.896063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.723 [2024-11-19 15:28:56.896210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.896387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.723 [2024-11-19 15:28:56.896414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.723 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.896543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.896685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.896722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.896868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.896954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.896979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.897117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.897382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.897753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.897901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.898020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.898334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.898594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.898789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.898914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.899209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.899507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.899809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.899926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.900047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.900278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.900574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.900771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.900891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.901194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.901433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.901727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.901882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.902026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.902334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.902619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.902770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.902894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.903195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.903461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.903708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.903854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.903940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.904057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.904090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.724 [2024-11-19 15:28:56.904247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.904347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.724 [2024-11-19 15:28:56.904374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.724 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.904492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.904577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.904604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.904752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.904906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.904931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.905064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.905328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.905556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.905724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.905890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.906162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.906431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.906669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.906893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.907035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.907289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.907574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.907851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.907971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.908191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.908500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.908744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.908929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.909093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.909396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.909663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.909848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.910020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.910288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.910580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.910845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.910960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.911094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.911375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.911652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.911876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.911975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.912001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.912091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.912184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.912210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.725 qpair failed and we were unable to recover it. 00:27:58.725 [2024-11-19 15:28:56.912332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.725 [2024-11-19 15:28:56.912503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.912530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.912712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.912827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.912853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.912936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.913141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.913414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.913686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.913888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.913978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.914230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.914498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.914768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.914893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.914987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.915178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.915424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.915720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.915853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.916010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.916290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.916561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.916842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.916976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.917138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.917436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.917701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.917819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.918007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.918251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.918548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.918817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.918989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.919133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.919463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.919735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.919905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.726 [2024-11-19 15:28:56.920034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.920166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.726 [2024-11-19 15:28:56.920195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.726 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.920320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.920457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.920485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.920616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.920731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.920757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.920902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.921176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.921474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.921781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.921919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.922025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.922313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.922632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.922782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.922878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.923149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.923505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.923758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.923916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.924064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.924353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.924652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.924823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.925005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.925304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.925620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.925753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.925897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.926187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.926439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.926725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.926852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.926982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.927251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.927517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.927746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.927865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.928001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.928129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.928158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.727 qpair failed and we were unable to recover it. 00:27:58.727 [2024-11-19 15:28:56.928289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.727 [2024-11-19 15:28:56.928440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.928482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.928592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.928716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.928742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.928841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.928989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.929152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.929452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.929727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.929853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.929939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.930216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.930506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.930794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.930934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.931069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.931373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.931604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.931771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.931890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.932184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.932448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.932710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.932889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.933036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.933280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.933546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.933824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.933986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.934131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.934409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.934733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.934876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.935026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.935160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.935187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.728 qpair failed and we were unable to recover it. 00:27:58.728 [2024-11-19 15:28:56.935296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.728 [2024-11-19 15:28:56.935406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.935430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.935569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.935711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.935739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.935915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.936212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.936489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.936718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.936856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.936984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.937305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.937591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.937889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.937983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.938158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.938484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.938773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.938886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.939053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.939355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.939669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.939817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.939937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.940219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.940453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.940767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.940954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.941071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.941349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.941615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.941742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.941875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.942176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.942458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.942731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.942873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.943020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.943175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.943200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.729 qpair failed and we were unable to recover it. 00:27:58.729 [2024-11-19 15:28:56.943289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.943378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.729 [2024-11-19 15:28:56.943404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.943522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.943634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.943663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.943785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.943874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.943899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.944206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.944445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.944761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.944947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.945060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.945331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.945586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.945749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.945879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.946139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.946382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.946587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.946713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.946862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.947179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.947451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.947670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.947852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.947987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.948316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.948586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.948768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.948856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.949169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.949458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.949740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.949852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.949980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.950217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.950493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.950798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.730 [2024-11-19 15:28:56.950946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.730 qpair failed and we were unable to recover it. 00:27:58.730 [2024-11-19 15:28:56.951084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.951343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.951581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.951904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.951999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.952024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.952156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.952297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.952322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.952474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.952638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.952666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Write completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 Read completed with error (sct=0, sc=8) 00:27:58.731 starting I/O failed 00:27:58.731 [2024-11-19 15:28:56.953048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.731 [2024-11-19 15:28:56.953231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.953391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.953423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.953553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.953673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.953709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.953832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.953974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.954167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.954487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.954732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.954908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.955069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.955404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.955695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.955872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.955964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.956207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.956448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.956726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.956846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.957006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.957140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.957166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.957291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.957429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.957455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.731 qpair failed and we were unable to recover it. 00:27:58.731 [2024-11-19 15:28:56.957548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.731 [2024-11-19 15:28:56.957633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.957659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.957768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.957862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.957891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.958025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.958305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.958520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.958812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.958999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.959116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.959402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.959648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.959766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.959894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.960148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.960409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.960651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.960802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.960929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.961192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.961435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.961678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.961813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.961914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.962118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.962347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.962604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.962881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.962997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.963157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.963382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.963615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.963774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.963924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.964007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.964032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.964154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.964243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.964268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.732 qpair failed and we were unable to recover it. 00:27:58.732 [2024-11-19 15:28:56.964403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.732 [2024-11-19 15:28:56.964492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.964518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.964609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.964703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.964729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.964874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.964983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.965103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.965348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.965622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.965803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.965896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.966195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.966442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.966706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.966879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.967067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.967358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.967594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.967850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.967976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.968069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.968277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.968516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.968803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.968927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.969054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.969311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.969563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.969796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.969968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.970091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.970370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.970670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.970794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.970904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.971166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.971444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.971681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.971803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.971903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.972027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.972052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.733 qpair failed and we were unable to recover it. 00:27:58.733 [2024-11-19 15:28:56.972171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.972266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.733 [2024-11-19 15:28:56.972291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.972439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.972564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.972589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.972731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.972850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.972876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.972990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.973224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.973447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.973684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.973813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.973954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.974187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.974432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.974709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.974904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.975024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.975288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.975524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.975826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.975948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.976044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.976331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.976604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.976861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.976975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.977083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.977386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.977654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.977917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.977999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.978182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.978418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.978663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.978814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.978939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.979162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.979376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.979601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.979830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.979969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.980113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.980224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.980249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.980392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.980485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.734 [2024-11-19 15:28:56.980510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.734 qpair failed and we were unable to recover it. 00:27:58.734 [2024-11-19 15:28:56.980641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.980764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.980791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.980915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.981206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.981466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.981765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.981926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.982080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.982311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.982580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.982826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.982990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.983158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.983438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.983697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.983816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.983931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.984167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.984397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.984618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.984856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.984971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.985054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.985315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.985561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.985769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.985941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.986056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.986322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.986532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.986815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.986966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.987095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.987340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.987608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.987813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.987960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.988085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.988365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.988592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.988737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.988836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.989000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.989025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.735 qpair failed and we were unable to recover it. 00:27:58.735 [2024-11-19 15:28:56.989110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.735 [2024-11-19 15:28:56.989241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.989267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.989391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.989510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.989541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.989658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.989771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.989797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.989915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.990169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.990414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.990677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.990909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.990990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.991129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.991345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.991627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.991872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.991989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.992091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.992294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.992533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.992808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.992964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.993085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.993325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.993621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.993844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.993994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.994111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.994352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.994576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.994875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.994991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.995108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.995381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.995672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.995818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.995967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.996287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.736 [2024-11-19 15:28:56.996545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.736 [2024-11-19 15:28:56.996685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.736 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.996834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.996949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.996975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.997073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.997288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.997486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.997720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.997836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.997938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.998174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.998457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.998737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.998891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.998984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.999278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.999570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:56.999875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:56.999992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.000084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.000312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.000615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.000832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.000980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.001099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.001370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.001611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.001892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.001994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.737 [2024-11-19 15:28:57.002019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.737 qpair failed and we were unable to recover it. 00:27:58.737 [2024-11-19 15:28:57.002139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.002405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.002620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.002857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.002969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.003085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.003323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.003594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.003894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.003975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.004146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.004391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.004701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.004886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.005007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.005213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.005468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.005707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.005832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.005954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.006160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.006432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.006674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.006821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.006925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.007158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.007431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.007731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.007877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.007996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.008230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.008473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.008762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.008923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.738 qpair failed and we were unable to recover it. 00:27:58.738 [2024-11-19 15:28:57.009065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.738 [2024-11-19 15:28:57.009192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.009217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.009367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.009463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.009488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.009636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.009772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.009815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.009954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.010191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.010425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.010665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.010888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.011052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.011313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.011530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.011797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.011918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.012044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.012334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.012576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.012848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.012998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.013151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.013421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.013717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.013840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.013970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.014228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.014490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.014768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.014958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.015104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.015352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.015595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.015729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.015897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.016229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.016500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.016844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.016997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.739 [2024-11-19 15:28:57.017046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.739 qpair failed and we were unable to recover it. 00:27:58.739 [2024-11-19 15:28:57.017195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.017430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.017702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.017846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.017948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.018175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.018422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.018706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.018831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.018924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.019143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.019411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.019680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.019829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.019911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.020138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.020391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.020702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.020826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.020928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.021232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.021544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.021794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.021914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.022024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.022276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.022560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.022837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.022957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.023136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.023403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.023700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.023851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.023948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.024245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.740 [2024-11-19 15:28:57.024569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.740 [2024-11-19 15:28:57.024713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.740 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.024820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.024968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.025134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.025423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.025682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.025817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.025957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.026188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.026455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.026758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.026864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.027000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.027254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.027521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.027800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.027913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.028050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.028309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.028591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.028849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.028984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.029140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.029411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.029699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.029860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.030001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.030289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.030577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.030876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.030999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.741 [2024-11-19 15:28:57.031095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.031242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.741 [2024-11-19 15:28:57.031269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.741 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.031396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.031563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.031588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.031683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.031781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.031806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.031896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.032200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.032528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.032854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.032993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.033101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.033390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.033697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.033812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.033907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.034159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.034476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.034743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.034889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.034989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.035288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.035573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.035867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.035987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.036102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.036379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.036672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.036847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.036959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.037233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.037483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.037653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.037770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf93600 is same with the state(5) to be set 00:27:58.742 [2024-11-19 15:28:57.037899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.038188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.038526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.038837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.038994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.039151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.039313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.742 [2024-11-19 15:28:57.039357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.742 qpair failed and we were unable to recover it. 00:27:58.742 [2024-11-19 15:28:57.039456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.039575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.039600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.039722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.039840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.039864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.039982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.040298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.040558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.040834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.040980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.041079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.041375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.041703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.041845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.041937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.042218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.042505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.042748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.042919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.043049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.043301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.043567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.043876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.043961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.044100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.044345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.044608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.044854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.044967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.045058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.045318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.045540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.045844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.045983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.046121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.046422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.046716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.046906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.743 qpair failed and we were unable to recover it. 00:27:58.743 [2024-11-19 15:28:57.046992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.743 [2024-11-19 15:28:57.047112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.047137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.047303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.047432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.047459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.047557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.047652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.047682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.047864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.048149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.048433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.048707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.048883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.049024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.049300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.049595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.049843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.049954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.050046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.050347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.050577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.050848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.050976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.051073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.051312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.051604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.051787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.051904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.052129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.052401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.052645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.052832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.052922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.053013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.053037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.053150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.054513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.054549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.054668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.054872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.054899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.055047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.055386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.055706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.055821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.744 [2024-11-19 15:28:57.055916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.056034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.744 [2024-11-19 15:28:57.056058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.744 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.056217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.056512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.056777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.056907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.057038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.057323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.057616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.057757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.057860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.058219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.058542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.058821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.058993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.059112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.059404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.059646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.059807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.059919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.060175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.060420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.060707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.060907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.061007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.061296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.061630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.061829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.061960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.062177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.062466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.062804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.062951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.063252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.063475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.063751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.063878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.064001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.064146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.064171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.745 qpair failed and we were unable to recover it. 00:27:58.745 [2024-11-19 15:28:57.064272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.745 [2024-11-19 15:28:57.064380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.064404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.064532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.064617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.064642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.064769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.064865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.064889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.065036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.065312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.065622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.065837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.065958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.066130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.066464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.066709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.066899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.067051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.067299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.067603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.067758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.067868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.068169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.068483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.068779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.068931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.069091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.069369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.069647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.069787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.069879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.070129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.070365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.070637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.070807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.070924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.071092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.746 [2024-11-19 15:28:57.071118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.746 qpair failed and we were unable to recover it. 00:27:58.746 [2024-11-19 15:28:57.071265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.071526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.071803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.071985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.072132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.072436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.072755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.072906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.073002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.073310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.073628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.073820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.073943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.074198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.074470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.074767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.074885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.074984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.075290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.075534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.075713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.075894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.076217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.076492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.076736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.076869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.077013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.077240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.077513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.077746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.077904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.078049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.078296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.078547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.078805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.078921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.747 [2024-11-19 15:28:57.079073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.079185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.747 [2024-11-19 15:28:57.079212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.747 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.079340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.079631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.079872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.079980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.080080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.080292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.080599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.080844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.080966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.081074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.081404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.081676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.081848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.081940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.082258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.082580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.082809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.082931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.083045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.083317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.083595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.083865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.083998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.084141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.084418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.084641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.084897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.084986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.085149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.085397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.085644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.085805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.085904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.086142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.086406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.748 [2024-11-19 15:28:57.086543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.748 qpair failed and we were unable to recover it. 00:27:58.748 [2024-11-19 15:28:57.086672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.086779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.086803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.086892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.087179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.087503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.087756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.087871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.087952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.088263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.088478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.088735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.088850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.088947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.089069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.089094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.089263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.089399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.089428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.089547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.090357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.090391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.090590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.090709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.090753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.090852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.090985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.091124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.091395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.091655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.091841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.091941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.092059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.092086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.092239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.092381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.092406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.092551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.093378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.093412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.093553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.093717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.093752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.093902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.093997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.094160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.094442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.094758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.094869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.094967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.095290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.095526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.749 [2024-11-19 15:28:57.095785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.749 [2024-11-19 15:28:57.095911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.749 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.096062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.096321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.096683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.096828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.096955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.097247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.097505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.097759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.097878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.097981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.098218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.098548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.098848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.098965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.099089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.099308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.099602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.099837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.099946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.100084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.100395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.100707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.100823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.100926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.101204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.101447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.101681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.101827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.101965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.102078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.102106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.102230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.102336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.102377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.750 qpair failed and we were unable to recover it. 00:27:58.750 [2024-11-19 15:28:57.102517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.750 [2024-11-19 15:28:57.102624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.102651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.102773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.102861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.102885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.102979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.103245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.103518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.103793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.103917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.104013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.104314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.104569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.104858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.104989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.105091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.105366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.105662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.105807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.105912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.106154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.106483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.106702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.106851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.106953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.107192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.107511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.107796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.107942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.108088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.108363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.108577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.108839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.108958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.109151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.109407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.109699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.109851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.751 qpair failed and we were unable to recover it. 00:27:58.751 [2024-11-19 15:28:57.109980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.110083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.751 [2024-11-19 15:28:57.110108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.110235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.110538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.110766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.110886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.110979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.111215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.111455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.111657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.111825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.111935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.112166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.112416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.112731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.112880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.112971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.113242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.113551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.113843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.113988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.114090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.114408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.114678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.114805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.114893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.115198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.115496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.115717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.115839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.115932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.116179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.116407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.116706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.116848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.116937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.117058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.117084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.117183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.117277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.117303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.752 qpair failed and we were unable to recover it. 00:27:58.752 [2024-11-19 15:28:57.117421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.752 [2024-11-19 15:28:57.117530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.117559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.117677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.117778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.117805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.117903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.117999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.118142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.118410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.118644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.118851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.118967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.119096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.119321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.119651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.119889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.119979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.120099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.120325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.120605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.120853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.120968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.121094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.121359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.121593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.121831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.121935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.122033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.122233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.122470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.122680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.122829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.122931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.123166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.123389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.123631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.123852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.123967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.124001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.124087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.124170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.753 [2024-11-19 15:28:57.124195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.753 qpair failed and we were unable to recover it. 00:27:58.753 [2024-11-19 15:28:57.124316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.124529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.124758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.124898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.125003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.125272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.125500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.125736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.125855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.125944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.126168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.126444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.126664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.126788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.127557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.127682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.127713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.127820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.127909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.127934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.128030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.128314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.128635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.128896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.128985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.129099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.129315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.129537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.129774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.129915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.130009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.130297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.130565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.130830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.130952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.131036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.131265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.131527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.754 [2024-11-19 15:28:57.131747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.754 [2024-11-19 15:28:57.131855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.754 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.131949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.132188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.132438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.132743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.132865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.132953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.133159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.133401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.133655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.133886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.133990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.134082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.134386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.134636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.134808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.134937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.135190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.135472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.135706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.135850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.135958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.136267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.136598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.136845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.136993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.137143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.137384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.137600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.137839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.137955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.755 qpair failed and we were unable to recover it. 00:27:58.755 [2024-11-19 15:28:57.138104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.138245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.755 [2024-11-19 15:28:57.138271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.138369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.138637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.138866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.138988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.139136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.139248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.139273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.140050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.140384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.140660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.140905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.140990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.141104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.141388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.141664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.141834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.141943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.142168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.142447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.142719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.142843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.142932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.143184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.143434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.143700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.143837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.143927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.144142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.144389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.144676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.144807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.144905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.145164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.145442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.145713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.145827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.145946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.146066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.756 [2024-11-19 15:28:57.146092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.756 qpair failed and we were unable to recover it. 00:27:58.756 [2024-11-19 15:28:57.146186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.146398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.146718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.146866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.146981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.147195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.147430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.147658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.147786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.147884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.148218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.148439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.148683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.148897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.148987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.149113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.149373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.149585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.149826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.149966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.150054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.150138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.150173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.150318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.150414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.150440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.151207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.151510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.151782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.151902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.152020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.152273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.152525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.152778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.152900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.152995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.153275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.153547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.757 qpair failed and we were unable to recover it. 00:27:58.757 [2024-11-19 15:28:57.153825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.757 [2024-11-19 15:28:57.153918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.153944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.154098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.154349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.154577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.154843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.154960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.155087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.155316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.155527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.155756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.155869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.155967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.156211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.156422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.156698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.156821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.156915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.157169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.157381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.157589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.157837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.157957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.158093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.158336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.158545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.158802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.158922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.159048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.159309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.159640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.159858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.159993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.160121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.160396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.758 [2024-11-19 15:28:57.160607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.758 [2024-11-19 15:28:57.160735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.758 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.160829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.160925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.160950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.161104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.161360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.161643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.161895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.161989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.162114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.162365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.162622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.162843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.162962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.163060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.163301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.163541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.163774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.163890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.164017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.164253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.164480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.164743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.164868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.164959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.165204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.165422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.165667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.165810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.165909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.166123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.166392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.166663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.166895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.166986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.167011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.759 qpair failed and we were unable to recover it. 00:27:58.759 [2024-11-19 15:28:57.167111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.759 [2024-11-19 15:28:57.167231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.167397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.167681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.167889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.167989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.168137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.168382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.168601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.168861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.168987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.169117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.169325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.169601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.169745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.169848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.170564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.170592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.170748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.170852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.170878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.170976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.171206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.171482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.171726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.171843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.171935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.172170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.172455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.172684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.172816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.172919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.173027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.173053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.173146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.173263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.760 [2024-11-19 15:28:57.173290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.760 qpair failed and we were unable to recover it. 00:27:58.760 [2024-11-19 15:28:57.173436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.173546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.173572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.173712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.173815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.173840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.173937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.174185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.174424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.174673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.174804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.174899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.175304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.175578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.175801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.175915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.176057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.176271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.176577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.176838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.176955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.177076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.177361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.177628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.177862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.177981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.178078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.178314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.178534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.178751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.178875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.178973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.179202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.179433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.761 [2024-11-19 15:28:57.179674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.761 [2024-11-19 15:28:57.179807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.761 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.179900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.179991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.180116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.180441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.180685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.180805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.180905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.181705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.181736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.181842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.181946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.181971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.182110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.182398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.182626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.182867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.182989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.183088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.183293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.183531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.183771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.183895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.183985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.184209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.184488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.184751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.184863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.184944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.185259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.185550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.185783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.185901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.186065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.186360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.186591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.186837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.186986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.187091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.187177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.187202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.762 [2024-11-19 15:28:57.187329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.187441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.762 [2024-11-19 15:28:57.187467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.762 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.187564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.187666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.187735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.187828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.187951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.187977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.188103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.188331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.188621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.188887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.188992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.189115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.189350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.189584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.189829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.189955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.190072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.190275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.190468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.190685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.190804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.190904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.191116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.191348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.191610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.191835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.191956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.192044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.192315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.192516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.192784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.192898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.193020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.193281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.763 qpair failed and we were unable to recover it. 00:27:58.763 [2024-11-19 15:28:57.193488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.763 [2024-11-19 15:28:57.193608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.193822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.193847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.193938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.194179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.194440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.194704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.194834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.194925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.195194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.195478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.195718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.195848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.195947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.196159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.196426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.196645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.196821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.196916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.197213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.197449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.197672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.197806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.197901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.198115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.198385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.198708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.198886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.198973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.199209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.199526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.199837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.199975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.200071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.200165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.200190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.764 qpair failed and we were unable to recover it. 00:27:58.764 [2024-11-19 15:28:57.200278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.200399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.764 [2024-11-19 15:28:57.200425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.200519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.200668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.200701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.200833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.200970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.201164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.201421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.201737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.201880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.202012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.202255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.202549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.202813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.202957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.203076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.203310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.203522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.203858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.203976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.204126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.204337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.204562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.204821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.204934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.205059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.205323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.205553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.205804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.205949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.765 [2024-11-19 15:28:57.206074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.206195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.765 [2024-11-19 15:28:57.206226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.765 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.206315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.206557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.206806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.206947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.207065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.207304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.207543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.207842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.207978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.208110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.208462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.208707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.208860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.208982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.209259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.209591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.209883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.209986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.210147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.210386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.210718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.210845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.210987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.211249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.211559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.211860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.211980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.212114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.212468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.212787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.212909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.213044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.213365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.213642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.213772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.213921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.214040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.766 [2024-11-19 15:28:57.214069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.766 qpair failed and we were unable to recover it. 00:27:58.766 [2024-11-19 15:28:57.214209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.214523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.214804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.214989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.215163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.215392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.215629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.215780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.215897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.216238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.216547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.216824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.216964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.217099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.217329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.217700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.217845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.218013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.218262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.218555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.218820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.218954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.219087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.219379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.219664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.219822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.219957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.220246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.220505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.220782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.220925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.221046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.221279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.221565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.221746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.221896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.222024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.222051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.767 qpair failed and we were unable to recover it. 00:27:58.767 [2024-11-19 15:28:57.222172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.222318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.767 [2024-11-19 15:28:57.222344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.222476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.222604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.222632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.222781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.222901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.222925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.223010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.223342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.223608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.223779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.223897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.224159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.224477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.224763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.224878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.225025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.225362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.225640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.225869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.225979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.226101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.226371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.226676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.226848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.226985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.227326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.227529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:58.768 [2024-11-19 15:28:57.227839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.768 [2024-11-19 15:28:57.227988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:58.768 qpair failed and we were unable to recover it. 00:27:59.051 [2024-11-19 15:28:57.228084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.051 [2024-11-19 15:28:57.228220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.051 [2024-11-19 15:28:57.228247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.051 qpair failed and we were unable to recover it. 00:27:59.051 [2024-11-19 15:28:57.228368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.051 [2024-11-19 15:28:57.228460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.051 [2024-11-19 15:28:57.228485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.051 qpair failed and we were unable to recover it. 00:27:59.051 [2024-11-19 15:28:57.228570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.051 [2024-11-19 15:28:57.228685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.228735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.228860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.228953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.228979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.229112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.229346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.229607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.229778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.229962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.230281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.230519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.230820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.230957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.231121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.231434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.231678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.231828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.231953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.232178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.232407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.232700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.232841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.232966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.233199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.233466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.233702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.233831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.233964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.234237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.234495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.234750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.234926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.235025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.235140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.235164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.052 qpair failed and we were unable to recover it. 00:27:59.052 [2024-11-19 15:28:57.235258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.052 [2024-11-19 15:28:57.235346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.235371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.235462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.235622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.235647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.235777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.235918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.235946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.236055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.236342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.236600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.236771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.236886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.237184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.237519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.237799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.237909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.238034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.238291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.238527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.238780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.238900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.239038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.239314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.239542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.239762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.239921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.240076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.240346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.240575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.240819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.240933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.241074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.241342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.241668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.241794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.241923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.242214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.242498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.053 [2024-11-19 15:28:57.242643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.053 qpair failed and we were unable to recover it. 00:27:59.053 [2024-11-19 15:28:57.242738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.242831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.242857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.242950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.243175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.243481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.243737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.243883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.243972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.244232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.244532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.244878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.244976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.245124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.245386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.245713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.245865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.245964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.246220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.246487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.246727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.246845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.246934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.247208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.247525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.247792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.247962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.248079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.248297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.248591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.248801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.248919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.249041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.249318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.249620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.249783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.249904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.250061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.250089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.054 qpair failed and we were unable to recover it. 00:27:59.054 [2024-11-19 15:28:57.250227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.250348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.054 [2024-11-19 15:28:57.250377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.250466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.250557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.250582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.250679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.250871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.250896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.250980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.251222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.251479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.251758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.251885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.252059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.252344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.252640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.252881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.252989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.253164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.253435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.253699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.253869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.254017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.254306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.254586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.254892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.254977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.255148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.255458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.255778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.255901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.256002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.256260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.256523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.256815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.256962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.257062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.257158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.257183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.257281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.257378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.055 [2024-11-19 15:28:57.257402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.055 qpair failed and we were unable to recover it. 00:27:59.055 [2024-11-19 15:28:57.257525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.257646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.257671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.257780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.257878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.257903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.258014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.258338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.258648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.258894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.258988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.259136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.259423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.259623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.259867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.259985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.260142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.260407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.260676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.260830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.260978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.261201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.261487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.261786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.261930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.262100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.262393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.262749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.262904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.263048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.263352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.263586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.263739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.056 qpair failed and we were unable to recover it. 00:27:59.056 [2024-11-19 15:28:57.263885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.056 [2024-11-19 15:28:57.264004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.264140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.264452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.264698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.264808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.264899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.265182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.265442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.265739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.265914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.266008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.266263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.266589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.266752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.266888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.267209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.267504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.267833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.267947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.268039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.268312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.268576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.268841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.268992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.269163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.269499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.269734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.269880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.269975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.270272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.270535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.270814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.057 [2024-11-19 15:28:57.270948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.057 qpair failed and we were unable to recover it. 00:27:59.057 [2024-11-19 15:28:57.271139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.271429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.271730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.271894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.272004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.272283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.272608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.272745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.272895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.273148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.273468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.273786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.273897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.274038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.274281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.274586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.274857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.274989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.275131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.275426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.275647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.275840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.275976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.276219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.276483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.276794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.276908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.276998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.277254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.277520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.277820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.277972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.278065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.278344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.278646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.278774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.058 qpair failed and we were unable to recover it. 00:27:59.058 [2024-11-19 15:28:57.278889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.279048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.058 [2024-11-19 15:28:57.279075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.279204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.279538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.279769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.279905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.280005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.280300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.280542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.280701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.280846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.281184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.281432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.281686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.281839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.281937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.282303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.282603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.282893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.282983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.283128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.283398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.283748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.283861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.283996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.284240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.284495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.284857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.284994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.285102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.285400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.285658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.285817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.285949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.286240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.286525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.059 qpair failed and we were unable to recover it. 00:27:59.059 [2024-11-19 15:28:57.286854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.059 [2024-11-19 15:28:57.286989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.287160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.287385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.287675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.287852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.287986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.288254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.288550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.288881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.288985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.289136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.289454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.289760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.289935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.290047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.290305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.290626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.290800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.290990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.291272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.291561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.291709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.291875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.292164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.292430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.292703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.292872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.293012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.293269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.293517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.293799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.293917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.294003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.294264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.060 qpair failed and we were unable to recover it. 00:27:59.060 [2024-11-19 15:28:57.294587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.060 [2024-11-19 15:28:57.294766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.294884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.295199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.295471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.295777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.295898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.296014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.296299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.296578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.296825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.296994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.297151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.297438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.297685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.297853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.297936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.298151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.298440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.298726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.298882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.299029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.299290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.299604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.299775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.299865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.300177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.300425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.300720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.300871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.301051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.301188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.301216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.301372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.301504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.061 [2024-11-19 15:28:57.301532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.061 qpair failed and we were unable to recover it. 00:27:59.061 [2024-11-19 15:28:57.301673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.301769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.301796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.301935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.302217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.302481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.302771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.302913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.303059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.303321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.303646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.303819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.303950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.304237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.304493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.304818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.304943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.305078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.305341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.305605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.305856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.305977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.306147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.306464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.306739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.306860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.306946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.307235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.307492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.307741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.307885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.307980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.308242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.308533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.062 [2024-11-19 15:28:57.308701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.062 qpair failed and we were unable to recover it. 00:27:59.062 [2024-11-19 15:28:57.308867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.308989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.309128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.309405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.309672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.309869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.310009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.310328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.310625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.310799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.310967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.311252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.311546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.311842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.311953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.312073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.312396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.312634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.312780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.312960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.313237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.313508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.313760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.313982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.314110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.314417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.314714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.314884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.315006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.315350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.315651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.315814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.315945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.316235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.316487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.316790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.316914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.063 [2024-11-19 15:28:57.317043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.317188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.063 [2024-11-19 15:28:57.317212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.063 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.317376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.317522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.317547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.317686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.317825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.317850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.317995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.318233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.318503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.318814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.318963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.319079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.319294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.319592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.319827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.319995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.320163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.320466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.320710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.320880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.321042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.321338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.321624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.321757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.321893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.322120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.322360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.322677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.322849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.322939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.323160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.323390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.323614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.323865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.323975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.324067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.324156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.324180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.064 [2024-11-19 15:28:57.324309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.324418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.064 [2024-11-19 15:28:57.324442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.064 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.324578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.324737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.324765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.324900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.325185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.325440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.325685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.325830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.325975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.326277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.326591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.326831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.326948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.327072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.327305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.327659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.327805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.327921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.328238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.328490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.328716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.328884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.329007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.329261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.329525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.329792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.329913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.330007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.330324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.330604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.330872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.330992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.331135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.331422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.331715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.331871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.332053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.332242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.065 [2024-11-19 15:28:57.332276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.065 qpair failed and we were unable to recover it. 00:27:59.065 [2024-11-19 15:28:57.332383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.332508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.332533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.332641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.332798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.332825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.332952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.333198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.333488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.333726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.333895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.334044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.334361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.334657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.334838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.334963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.335235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.335582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.335795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.335917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.336011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.336283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.336577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.336792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.336931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.337045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.337378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.337659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.337841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.066 [2024-11-19 15:28:57.337991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.338135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.066 [2024-11-19 15:28:57.338162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.066 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.338289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.338428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.338456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.338599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.338749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.338775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.338915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.339185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.339446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.339779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.339928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.340076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.340327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.340595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.340874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.340996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.341118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.341352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.341707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.341893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.342006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.342258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.342576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.342839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.342965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.343105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.343370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.343632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.343786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.343938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.344183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.344452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.344731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.344897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.344989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.345221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.345449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.345724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.067 [2024-11-19 15:28:57.345897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.067 qpair failed and we were unable to recover it. 00:27:59.067 [2024-11-19 15:28:57.346014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.346223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.346508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.346787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.346931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.347112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.347425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.347709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.347883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.348029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.348364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.348639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.348815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.348965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.349256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.349632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.349805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.349897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.350129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.350409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.350613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.350852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.350972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.351145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.351475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.351761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.351934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.352078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.352376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.352744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.068 [2024-11-19 15:28:57.352868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.068 qpair failed and we were unable to recover it. 00:27:59.068 [2024-11-19 15:28:57.352951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.353234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.353557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.353896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.353989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.354132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.354425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.354755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.354878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.354998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.355255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.355593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.355768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.355890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.356184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.356471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.356828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.356999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.357146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.357449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.357753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.357939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.358073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.358371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.358663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.358832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.358959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.359248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.359541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.359731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.359889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.360190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.069 [2024-11-19 15:28:57.360460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.069 [2024-11-19 15:28:57.360573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.069 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.360699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.360847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.360872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.360962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.361244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.361498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.361836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.361985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.362096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.362423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.362729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.362878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.363044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.363360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.363632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.363779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.363887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.364222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.364497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.364746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.364912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.365055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.365311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.365639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.365774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.365898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.366196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.366457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.366794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.366949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.367036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.367339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.367613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.367767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.367892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.368037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.368061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.070 qpair failed and we were unable to recover it. 00:27:59.070 [2024-11-19 15:28:57.368202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.368336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.070 [2024-11-19 15:28:57.368365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.368502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.368631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.368672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.368804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.368916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.368941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.369032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.369354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.369646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.369800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.369926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.370175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.370472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.370700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.370815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.370902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.371191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.371420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.371674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.371840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.371928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.372136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.372405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.372683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.372814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.372909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.373191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.373476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.373727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.373894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.071 qpair failed and we were unable to recover it. 00:27:59.071 [2024-11-19 15:28:57.373981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.071 [2024-11-19 15:28:57.374087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.374255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.374589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.374842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.374993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.375134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.375386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.375618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.375808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.375921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.376154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.376453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.376721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.376866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.376979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.377244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.377504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.377744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.377886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.377977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.378215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.378476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.378739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.378863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.378996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.379322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.379579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.379729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.379861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.380210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.380494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.380747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.380919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.381037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.381276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.381546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.072 [2024-11-19 15:28:57.381700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.072 qpair failed and we were unable to recover it. 00:27:59.072 [2024-11-19 15:28:57.381837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.381992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.382143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.382426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.382732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.382878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.383013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.383360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.383648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.383796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.383888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.384249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.384533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.384839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.384996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.385116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.385400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.385673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.385810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.385929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.386250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.386538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.386834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.386965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.387059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.387349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.387591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.387828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.387991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.388150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.388452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.388765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.388879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.388991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.389094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.389121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.073 qpair failed and we were unable to recover it. 00:27:59.073 [2024-11-19 15:28:57.389238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.073 [2024-11-19 15:28:57.389367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.389391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.389497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.389624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.389651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.389798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.389887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.389912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.390025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.390279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.390534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.390710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.390882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.391171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.391464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.391760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.391881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.392020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.392325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.392590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.392732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.392874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.393197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.393560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.393832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.393996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.394154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.394465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.394760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.394916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.395036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.395333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.395588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.395785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.395903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.396158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.396406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.396707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.396845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.396944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.397073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.397098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.397246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.397347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.397374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.074 qpair failed and we were unable to recover it. 00:27:59.074 [2024-11-19 15:28:57.397533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.074 [2024-11-19 15:28:57.397661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.397709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.397866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.397983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.398129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.398401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.398703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.398848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.398983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.399270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.399574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.399850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.399977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.400136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.400393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.400680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.400811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.400935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.401207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.401537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.401850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.401996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.402174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.402459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.402804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.402930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.403036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.403273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.403506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.403737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.403883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.403973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.404211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.404449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.404687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.404858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.075 qpair failed and we were unable to recover it. 00:27:59.075 [2024-11-19 15:28:57.404981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.405075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.075 [2024-11-19 15:28:57.405100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.405193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.405440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.405710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.405823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.405909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.406173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.406467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.406755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.406868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.406989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.407415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.407683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.407821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.407940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.408225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.408438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.408649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.408857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.408983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.409204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.409485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.409773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.409913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.410005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.410247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.410457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.410742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.410877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.410972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.411109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.411136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.411243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.411378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.411406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.076 qpair failed and we were unable to recover it. 00:27:59.076 [2024-11-19 15:28:57.411578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.076 [2024-11-19 15:28:57.411667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.411698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.411808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.411886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.411911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.412014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.412388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.412596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.412835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.412958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.413153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.413412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.413702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.413829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.413923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.414200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.414473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.414725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.414853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.414948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.415253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.415534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.415813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.415963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.416117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.416500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.416767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.416886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.416982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.417263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.417543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.417849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.417967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.418089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.418301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.418540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.077 qpair failed and we were unable to recover it. 00:27:59.077 [2024-11-19 15:28:57.418786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.077 [2024-11-19 15:28:57.418882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.418906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.418997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.419264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.419572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.419821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.419968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.420148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.420486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.420767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.420886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.421007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.421355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.421633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.421823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.421908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.422181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.422463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.422861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.422948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.423205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.423439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.423660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.423812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.423930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.424172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.424493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.424777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.424892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.425039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.425294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.425580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.425847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.425992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.426077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.426183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.426211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.078 [2024-11-19 15:28:57.426348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.426490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.078 [2024-11-19 15:28:57.426518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.078 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.426695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.426797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.426821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.426947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.427188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.427506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.427822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.427941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.428105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.428377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.428649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.428884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.428980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.429127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.429406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.429660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.429819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.429949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.430240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.430508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.430745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.430870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.430989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.431254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.431503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.431778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.431891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.432025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.432285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.432585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.432843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.432979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.433073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.433191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.433216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.079 qpair failed and we were unable to recover it. 00:27:59.079 [2024-11-19 15:28:57.433312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.433401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.079 [2024-11-19 15:28:57.433427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.433577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.433682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.433714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.433836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.433940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.433977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.434076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.434352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.434665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.434811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.434963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.435201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.435448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.435679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.435843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.435935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.436144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.436375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.436660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.436841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.437009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.437299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.437572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.437855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.437969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.438091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.438328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.438649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.438814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.438934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.439202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.439434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.439640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.439799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.439912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.440173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.440451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.440743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.440859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.441026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.441257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.441553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.441845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.441958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.442072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.442279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.442510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.442728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.442844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.442936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.443244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.443522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.443808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.443926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.080 [2024-11-19 15:28:57.444078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.444232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.080 [2024-11-19 15:28:57.444257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.080 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.444354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.444618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.444841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.444959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.445055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.445302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.445606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.445784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.445910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.446209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.446471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.446720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.446861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.446983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.447253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.447527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.447799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.447936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.448028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.448221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.448508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.448786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.448936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.449101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.449438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.449749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.449866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.449958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.450199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.450520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.450845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.450973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.451062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.451342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.451603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.451860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.451980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.452079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.452339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.452574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.452840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.452991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.453084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.453305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.453603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.453783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.453903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.454172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.454518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.454786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.454925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.455017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.455247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.455505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.455766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.455987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.456252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.456539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.456802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.456932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.457076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.457346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.081 [2024-11-19 15:28:57.457591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.081 [2024-11-19 15:28:57.457749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.081 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.457869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.457988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.458134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.458340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.458636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.458799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.458921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.459219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.459448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.459707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.459866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.460009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.460270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.460514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.460762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.460914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.461006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.461257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.461496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.461779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.461920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.462016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.462299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.462556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.462832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.462950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.463071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.463343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.463610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.463866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.463998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.464136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.464383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.464631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.464787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.464888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.465010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.465035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.082 qpair failed and we were unable to recover it. 00:27:59.082 [2024-11-19 15:28:57.465178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.465326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.082 [2024-11-19 15:28:57.465351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.465468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.465559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.465583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.465780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.465900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.465924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.466050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.466345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.466633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.466747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.466871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.467132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.467423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.467712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.467899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.468019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.468288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.468587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.468840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.468985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.469097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.469382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.469624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.469877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.469991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.470151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.470387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.470623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.470768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.470880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.471169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.471410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.471669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.471862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.472009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.472205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.472518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.472720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.472847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.473014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.473042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.083 qpair failed and we were unable to recover it. 00:27:59.083 [2024-11-19 15:28:57.473186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.083 [2024-11-19 15:28:57.473275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.473299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.473411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.473525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.473549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.473675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.473825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.473853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.473967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.474292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.474574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.474847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.474990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.475116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.475365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.475568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.475719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.475861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.476178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.476440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.476730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.476915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.477058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.477327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.477620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.477879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.477994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.478111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.478411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.478653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.478816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.084 qpair failed and we were unable to recover it. 00:27:59.084 [2024-11-19 15:28:57.478962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.479077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.084 [2024-11-19 15:28:57.479101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.479231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.479493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.479766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.479880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.480001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.480300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.480569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.480771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.480875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.481126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.481392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.481649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.481816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.481949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.482217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.482452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.482668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.482873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.482994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.483232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.483509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.483801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.483941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.484060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.484285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.484568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.484834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.484990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.485132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.485439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.485653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.485806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.485938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.486228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.486429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.085 qpair failed and we were unable to recover it. 00:27:59.085 [2024-11-19 15:28:57.486725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.085 [2024-11-19 15:28:57.486862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.486889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.486999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.487299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.487588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.487871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.487992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.488085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.488322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.488586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.488832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.488974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.489086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.489342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.489595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.489787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.489899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.490143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.490403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.490717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.490860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.490980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.491238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.491542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.491802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.491949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.492050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.492300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.492678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.492875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.492987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.493282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.493515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.086 [2024-11-19 15:28:57.493790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.086 [2024-11-19 15:28:57.493930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.086 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.494077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.494330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.494642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.494845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.494947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.495210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.495468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.495749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.495907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.496049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.496371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.496660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.496863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.496984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.497221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.497426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.497781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.497920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.498023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.498291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.498605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.498752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.498933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.499177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.499414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.499635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.499835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.499938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.500253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.500510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.500804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.500941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.501055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.501358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.501639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.087 [2024-11-19 15:28:57.501761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.087 qpair failed and we were unable to recover it. 00:27:59.087 [2024-11-19 15:28:57.501878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.502144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.502440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.502704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.502860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.502983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.503238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.503569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.503880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.503990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.504112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.504350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.504584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.504749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.504881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.505193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.505433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.505675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.505850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.505967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.506179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.506468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.506777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.506893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.507013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.507300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.507593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.507844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.507973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.508106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.508407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.508651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.508857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.508988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.509090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.509117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.088 qpair failed and we were unable to recover it. 00:27:59.088 [2024-11-19 15:28:57.509280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.088 [2024-11-19 15:28:57.509425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.509449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.509576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.509739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.509765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.509862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.509956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.509981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.510101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.510362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.510674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.510846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.510941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.511183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.511482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.511700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.511870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.512009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.512267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.512517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.512760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.512932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.513040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.513277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.513597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.513839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.513960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.514077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.514333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.514619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.514881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.514977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.515144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.515336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.515580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.089 qpair failed and we were unable to recover it. 00:27:59.089 [2024-11-19 15:28:57.515866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.089 [2024-11-19 15:28:57.515964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.515996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.516087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.516378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.516631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.516816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.516947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.517246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.517500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.517804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.517969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.518076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.518449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.518760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.518902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.519030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.519256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.519556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.519842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.519989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.520133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.520399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.520728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.520870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.521057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.521262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.521552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.521901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.521992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.522143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.522435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.522751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.522921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.090 [2024-11-19 15:28:57.523022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.523155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.090 [2024-11-19 15:28:57.523180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.090 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.523272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.523376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.523401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.523525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.523647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.523674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.523838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.523958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.524115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.524397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.524632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.524863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.524976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.525144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.525430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.525696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.525814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.525928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.526201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.526464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.526709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.526844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.526944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.527259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.527544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.527858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.527988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.528133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.528411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.528671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.528872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.528966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.529277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.529573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.529881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.529993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.530117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.530341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.530609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.530866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.530981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.531009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.091 [2024-11-19 15:28:57.531133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.531262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.091 [2024-11-19 15:28:57.531291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.091 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.531396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.531489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.531530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.531634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.531777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.531803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.531921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.532187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.532427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.532745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.532865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.532975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.533277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.533538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.533814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.533925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.534008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.534313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.534596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.534842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.534971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.535129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.535403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.535655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.535781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.535914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.536227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.536474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.536697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.536832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.536929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.537185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.537446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.537797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.537941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.538081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.538371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.538719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.538890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.539067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.539206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.539248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.092 qpair failed and we were unable to recover it. 00:27:59.092 [2024-11-19 15:28:57.539346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.539464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.092 [2024-11-19 15:28:57.539489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.539638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.539752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.539777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.539921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.540174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.540440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.540635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.540858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.540974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.541098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.541394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.541701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.541862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.542028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.542324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.542520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.542768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.542886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.542980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.543190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.543416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.543667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.543796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.543897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.544205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.544484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.544779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.544939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.545088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.545332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.545617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.545759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.545908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.546064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.546088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.093 qpair failed and we were unable to recover it. 00:27:59.093 [2024-11-19 15:28:57.546261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.093 [2024-11-19 15:28:57.546389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.546415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.546545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.546660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.546686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.546822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.546911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.546936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.547038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.547338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.547587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.547837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.547982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.548120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.548389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.548644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.548852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.548959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.549262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.549518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.549853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.549988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.550080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.550357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.550654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.550820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.550970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.551206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.551472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.551721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.551886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.551974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.552221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.552510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.552786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.552974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.553116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.553408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.553666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.553813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.553947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.554247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.554574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.094 qpair failed and we were unable to recover it. 00:27:59.094 [2024-11-19 15:28:57.554807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.094 [2024-11-19 15:28:57.554941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.555055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.555300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.555506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.555776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.555895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.555997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.556251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.556570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.556847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.556968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.557061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.557394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.557640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.557828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.557979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.558233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.558444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.558669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.558817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.558914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.559175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.559379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.559702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.559897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.560029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.560289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.560525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.560785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.560952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.561076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.561389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.561729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.561903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.562054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.562214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.562241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.562387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.562472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.562496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.095 qpair failed and we were unable to recover it. 00:27:59.095 [2024-11-19 15:28:57.562622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.095 [2024-11-19 15:28:57.562749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.562777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.562907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.563219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.563454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.563721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.563838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.564143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.564412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.564642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.564909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.564994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.565117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.565389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.565657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.565788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.565944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.566173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.566412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.566757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.566881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.566969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.567266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.567500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.567811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.567936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.568029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.568301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.568561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.568869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.568993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.569087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.569323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.569615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.569791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.569907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.570210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.570470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.570787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.570904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.570997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.571112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.571135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.096 [2024-11-19 15:28:57.571285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.571377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.096 [2024-11-19 15:28:57.571402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.096 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.571568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.571702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.571744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.571867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.571958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.571999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.572144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.572404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.572705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.572870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.573022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.573341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.573621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.573758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.573858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.574146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.574456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.574743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.574911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.575004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.575298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.575616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.575799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.575891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.576170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.576397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.576662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.576859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.576971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.577262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.577479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.577727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.577847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.577972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.578210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.578486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.578766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.578973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.579111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.579369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.097 qpair failed and we were unable to recover it. 00:27:59.097 [2024-11-19 15:28:57.579583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.097 [2024-11-19 15:28:57.579733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.579850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.579996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.580140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.580448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.580713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.580864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.580967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.581195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.581433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.581705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.581821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.581910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.582206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.582417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.582675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.582833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.582992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.583236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.583503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.583811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.583988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.584080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.584317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.584579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.584854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.584994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.585024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.098 qpair failed and we were unable to recover it. 00:27:59.098 [2024-11-19 15:28:57.585205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.098 [2024-11-19 15:28:57.585345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.585373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.585470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.585591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.585617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.585755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.585873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.585898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.586009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.586265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.586557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.586760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.586896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.587354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.587616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.587785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.587884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.588173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.588418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.099 [2024-11-19 15:28:57.588711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.099 [2024-11-19 15:28:57.588889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.099 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.589042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.589437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.589686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.589837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.589945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.590229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.590467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.590781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.590908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.591035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.591279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.591563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.591810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.591929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.592043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.592258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.592491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.592749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.592870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.592996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.593206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.378 qpair failed and we were unable to recover it. 00:27:59.378 [2024-11-19 15:28:57.593497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.378 [2024-11-19 15:28:57.593620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.593766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.593892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.593917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.594006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.594248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.594514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.594774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.594889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.595015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.595252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.595492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.595752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.595873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.595993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.596226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.596503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.596769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.596895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.597034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.597260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.597580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.597783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.597941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.598277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.598577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.598757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.598924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.599208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.599469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.599719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.599869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.599975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.600290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.600576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.600774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.600896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.601011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.601036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.601186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.601297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.379 [2024-11-19 15:28:57.601324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.379 qpair failed and we were unable to recover it. 00:27:59.379 [2024-11-19 15:28:57.601423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.601527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.601554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.601670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.601798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.601823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.601943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.602208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.602509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.602786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.602930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.603032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.603328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.603629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.603794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.603890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.604176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.604467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.604725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.604843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.604985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.605268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.605559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.605894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.605990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.606138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.606342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.606588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.606852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.606985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.607160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.607421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.607702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.607828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.607972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.608264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.608505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.608723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.380 [2024-11-19 15:28:57.608874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.380 qpair failed and we were unable to recover it. 00:27:59.380 [2024-11-19 15:28:57.608972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.609292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.609508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.609811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.609945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.610074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.610334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.610639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.610862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.610998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.611156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.611424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.611681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.611815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.611981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.612242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.612505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.612768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.612918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.613013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.613319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.613660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.613867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.614017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.614253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.614479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.614764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.614941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.615083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.615352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.615610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.615866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.615983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.616008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.616096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.616211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.616236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.616363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.616510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.381 [2024-11-19 15:28:57.616535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.381 qpair failed and we were unable to recover it. 00:27:59.381 [2024-11-19 15:28:57.616681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.616797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.616821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.616916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.617184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.617432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.617702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.617835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.617959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.618231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.618533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.618864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.618980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.619136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.619429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.619699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.619853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.619987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.620332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.620605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.620757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.620899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.621224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.621509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.621832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.621993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.622122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.622368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.622633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.622885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.622998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.623158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.623445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.382 qpair failed and we were unable to recover it. 00:27:59.382 [2024-11-19 15:28:57.623712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.382 [2024-11-19 15:28:57.623817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.623844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.623969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.624267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.624604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.624855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.624997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.625122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.625432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.625699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.625818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.625912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.626151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.626414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.626728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.626891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.627049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.627343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.627548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.627813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.627982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.628098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.628347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.628601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.628789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.628885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.629174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.629447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.629696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.629842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.629976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.630272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.630548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.383 qpair failed and we were unable to recover it. 00:27:59.383 [2024-11-19 15:28:57.630830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.383 [2024-11-19 15:28:57.630991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.631111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.631329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.631625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.631817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.631913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.632175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.632387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.632671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.632816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.632953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.633276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.633539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.633710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.633879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.634187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.634416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.634715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.634854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.634989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.635311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.635765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.635907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.636055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.636325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.636597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.636767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.636916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.637213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.637516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.637810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.637930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.638096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.638397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.638735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.638878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.638963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.639076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.384 [2024-11-19 15:28:57.639104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.384 qpair failed and we were unable to recover it. 00:27:59.384 [2024-11-19 15:28:57.639239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.639491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.639803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.639953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.640078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.640346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.640563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.640746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.640882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.641169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.641439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.641700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.641874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.641980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.642314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.642581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.642825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.642991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.643112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.643323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.643603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.643863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.643996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.644130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.644397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.644719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.644849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.644967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.645167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.645454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.645705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.645821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.645948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.646232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.646490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.385 qpair failed and we were unable to recover it. 00:27:59.385 [2024-11-19 15:28:57.646753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.385 [2024-11-19 15:28:57.646937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.647061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.647267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.647498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.647751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.647878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.647999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.648283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.648577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.648850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.648976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.649111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.649414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.649709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.649828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.649922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.650192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.650488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.650829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.650960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.651093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.651398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.651649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.651868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.651986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.652118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.652382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.652670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.652831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.652927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.653137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.653376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.653649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.653818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.653918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.654024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.654053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.386 [2024-11-19 15:28:57.654156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.654282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.386 [2024-11-19 15:28:57.654309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.386 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.654480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.654604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.654628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.654757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.654853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.654877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.655007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.655278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.655561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.655870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.655988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.656132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.656394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.656670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.656821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.656968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.657258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.657517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.657716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.657836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.657958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.658256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.658577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.658836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.658992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.659151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.659390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.659675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.659815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.659974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.660228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.660539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.387 [2024-11-19 15:28:57.660814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.387 [2024-11-19 15:28:57.660922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.387 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.661003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.661080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.661110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.661270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.661415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.661440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.664867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.665228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.665554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.665711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.665862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.666122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.666344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.666632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.666797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.666921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.667253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.667599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.667816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.667993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.668182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.668504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.668833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.668951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.669040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.669347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.669709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.669901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.670005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.670315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.670615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.670791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.670902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.671211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.671501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.671838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.671969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.672134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.672236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.672267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.672391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.672510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.672542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.388 qpair failed and we were unable to recover it. 00:27:59.388 [2024-11-19 15:28:57.672652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.388 [2024-11-19 15:28:57.672796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.672824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.672913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.673236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.673558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.673736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.673911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.674216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.674471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.674730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.674901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.675073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.675431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.675749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.675892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.675977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.676242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.676534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.676856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.676977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.677097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.677377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.677666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.677817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.677966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.678250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.678541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.678705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.678855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.679182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.679438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.679685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.679840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.679991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.680280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.680553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.389 [2024-11-19 15:28:57.680806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.389 [2024-11-19 15:28:57.680968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.389 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.681090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.681339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.681639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.681816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.681906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.682260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.682558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.682817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.682971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.683111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.683390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.683703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.683828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.683931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.684185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.684463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.684757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.684907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.685089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.685331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.685659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.685854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.685983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.686314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.686589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.686892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.686993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.687146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.687463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.687863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.688012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.688334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.688637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.688844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.688964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.689110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.689137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.390 qpair failed and we were unable to recover it. 00:27:59.390 [2024-11-19 15:28:57.689282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.390 [2024-11-19 15:28:57.689371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.689398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.689490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.689615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.689658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.689816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.689911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.689938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.690031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.690383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.690584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.690858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.690985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.691085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.691385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.691704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.691899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.692073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.692364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.692677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.692824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.692973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.693306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.693554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.693731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.693885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.694184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.694515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.694796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.694965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.695109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.695388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.695720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.695914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.696063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.696306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.696607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.696786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.696902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.697168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.391 [2024-11-19 15:28:57.697475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.391 [2024-11-19 15:28:57.697641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.391 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.697801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.697952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.697980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.698149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.698419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.698702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.698815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.698938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.699202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.699503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.699809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.699989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.700117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.700426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.700717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.700920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.701069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.701371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.701680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.701831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.701941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.702241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.702530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.702830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.702976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.703108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.703451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.703791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.703967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.704129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.704463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.704786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.704943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.392 qpair failed and we were unable to recover it. 00:27:59.392 [2024-11-19 15:28:57.705100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.392 [2024-11-19 15:28:57.705215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.705324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.705563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.705869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.705989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.706107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.706370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.706683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.706850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.706935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.707212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.707516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.707660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.707856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.708154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.708426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.708639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.708831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.708962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.709280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.709511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.709751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.709941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.710060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.710382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.710649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.710808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.710929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.711199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.711463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.711727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.711896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.711995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.712290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.712647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.712822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.393 [2024-11-19 15:28:57.712985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.713115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.393 [2024-11-19 15:28:57.713145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.393 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.713243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.713391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.713419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.713542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.713701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.713730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.713845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.713996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.714173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.714445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.714679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.714854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.714979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.715259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.715562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.715749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.715878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.716215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.716516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.716809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.716984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.717107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.717474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.717738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.717890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.717984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.718294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.718581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.718846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.718973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.719119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.719418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.719726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.719848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.719957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.720325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.720600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.720836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.720983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.721123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.721257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.721287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.394 qpair failed and we were unable to recover it. 00:27:59.394 [2024-11-19 15:28:57.721423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.394 [2024-11-19 15:28:57.721546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.721572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.721767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.721892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.721918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.722064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.722419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.722762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.722912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.723009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.723248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.723508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.723799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.723943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.724044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.724407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.724774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.724905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.725023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.725324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.725587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.725768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.725911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.726201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.726460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.726777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.726900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.727019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.727333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.727716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.727890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.728001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.728299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.728622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.728858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.728994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.729182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.729466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.395 [2024-11-19 15:28:57.729699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.395 [2024-11-19 15:28:57.729846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.395 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.729998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.730327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.730617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.730769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.730894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.731247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.731534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.731825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.731941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.732032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.732269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.732501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.732753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.732895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.733046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.733331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.733629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.733805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.733903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.734228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.734543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.734729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.734875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.735139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.735468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.735704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.735847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.735930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.736139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.736456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.736723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.736878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.396 qpair failed and we were unable to recover it. 00:27:59.396 [2024-11-19 15:28:57.736977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.396 [2024-11-19 15:28:57.737065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.737216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.737514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.737854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.737976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.738129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.738507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.738810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.738964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.739106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.739367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.739669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.739822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.739919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.740244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.740524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.740790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.740981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.741156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.741399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.741700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.741864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.741999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.742368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.742682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.742889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.743019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.743338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.743599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.743794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.743885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.744188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.744417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.744707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.744840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.745010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.745133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.745160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.397 qpair failed and we were unable to recover it. 00:27:59.397 [2024-11-19 15:28:57.745335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.745469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.397 [2024-11-19 15:28:57.745498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.745672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.745804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.745832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.745965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.746214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.746496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.746769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.746925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.747096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.747387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.747718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.747924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.748073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.748391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.748712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.748871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.748993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.749321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.749557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.749840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.749968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.750114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.750368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.750628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.750785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.750894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.751152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.751408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.751726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.751905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.751990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.752259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.752572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.752777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.752904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.753146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.398 [2024-11-19 15:28:57.753392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.398 [2024-11-19 15:28:57.753534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.398 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.753701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.753844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.753872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.754037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.754368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.754648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.754816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.754953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.755260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.755509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.755732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.755867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.756018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.756294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.756621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.756807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.756909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.757160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.757424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.757743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.757938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.758085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.758405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.758699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.758846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.758972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.759236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.759528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.759822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.759949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.760091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.760341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.760675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.760857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.760996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.761313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.761610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.761785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.399 qpair failed and we were unable to recover it. 00:27:59.399 [2024-11-19 15:28:57.761936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.399 [2024-11-19 15:28:57.762064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.762094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.762254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.762388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.762417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.762588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.762718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.762745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.762899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.763215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.763572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.763772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.763947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.764241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.764488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.764736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.764867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.765043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.765257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.765547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.765850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.765999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.766127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.766359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.766599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.766767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.766944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.767160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.767415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.767707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.767862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.767997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.768272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.768593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.768887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.768974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.769159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.769499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.769787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.769907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.400 qpair failed and we were unable to recover it. 00:27:59.400 [2024-11-19 15:28:57.770057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.770206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.400 [2024-11-19 15:28:57.770232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.770383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.770484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.770511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.770631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.770782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.770811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.770924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.771212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.771538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.771856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.771995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.772146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.772358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.772635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.772781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.772913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.773141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.773452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.773779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.773899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.773991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.774286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.774641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.774826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.774952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.775275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.775556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.775859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.775982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.776153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.776461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.776752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.776878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.777022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.777111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.777137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.401 qpair failed and we were unable to recover it. 00:27:59.401 [2024-11-19 15:28:57.777261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.401 [2024-11-19 15:28:57.777376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.777404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.777526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.777669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.777707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.777843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.777949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.777978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.778128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.778381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.778664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.778841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.778987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.779217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.779537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.779818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.779945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.780089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.780366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.780648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.780805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.780935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.781236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.781493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.781810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.781958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.782148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.782424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.782671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.782807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.782914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.783174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.783454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.783753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.783923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.784041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.784279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.784549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.784727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.784877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.785005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.785031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.402 [2024-11-19 15:28:57.785156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.785325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.402 [2024-11-19 15:28:57.785353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.402 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.785452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.785615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.785644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.785795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.785926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.785953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.786129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.786421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.786725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.786879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.786983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.787207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.787517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.787797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.787993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.788125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.788478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.788739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.788896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.789024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.789326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.789619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.789781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.789942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.790243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.790493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.790761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.790903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.791043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.791384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.791696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.791862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.791987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.792205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.792556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.792776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.792902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.793225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.793516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.403 qpair failed and we were unable to recover it. 00:27:59.403 [2024-11-19 15:28:57.793811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.403 [2024-11-19 15:28:57.793912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.793938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.794060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.794370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.794644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.794772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.794890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.795200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.795509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.795784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.795954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.796068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.796389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.796735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.796871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.797006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.797307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.797556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.797841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.797996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.798149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.798432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.798740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.798938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.799078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.799357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.799676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.799842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.800013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.800316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.800613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.800768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.800921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.801215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.801526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.801849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.801972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.802000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.404 [2024-11-19 15:28:57.802173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.802301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.404 [2024-11-19 15:28:57.802344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.404 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.802493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.802593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.802620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.802741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.802864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.802892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.803080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.803340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.803603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.803762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.803864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.804186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.804454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.804763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.804944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.805062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.805347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.805556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.805905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.805996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.806150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.806380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.806715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.806879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.806971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.807298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.807598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.807842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.807991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.808111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.808349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.808673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.808881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.809026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.809323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.809633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.809778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.405 qpair failed and we were unable to recover it. 00:27:59.405 [2024-11-19 15:28:57.809955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.810091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.405 [2024-11-19 15:28:57.810120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.810216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.810507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.810750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.810896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.810990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.811315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.811641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.811816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.811914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.812155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.812406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.812719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.812910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.813035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.813343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.813591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.813850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.813974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.814148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.814442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.814718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.814891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.815013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.815262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.815596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.815853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.815982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.816159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.816427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.816734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.816923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.817089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.817197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.817240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.817384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.817471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.817498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.406 qpair failed and we were unable to recover it. 00:27:59.406 [2024-11-19 15:28:57.817674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.406 [2024-11-19 15:28:57.817802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.817831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.817982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.818278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.818582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.818751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.818892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.819209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.819417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.819669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.819802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.819923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.820159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.820399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.820640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.820816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.820904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.821230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.821528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.821847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.821974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.822067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.822399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.822721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.822842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.822930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.823232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.823524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.823808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.823980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.824080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.824318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.824615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.824756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.824902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.825197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.407 [2024-11-19 15:28:57.825477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.407 [2024-11-19 15:28:57.825631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.407 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.825783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.825872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.825900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.826017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.826319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.826609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.826853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.826975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.827116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.827400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.827657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.827832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.827924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.828186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.828488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.828797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.828925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.829024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.829302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.829567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.829755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.829921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.830251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.830560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.830857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.830983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.831131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.831424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.831795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.831914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.832083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.832399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.832654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.832821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.832911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.833179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.833447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.408 qpair failed and we were unable to recover it. 00:27:59.408 [2024-11-19 15:28:57.833685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.408 [2024-11-19 15:28:57.833773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.833800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.833923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.834249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.834539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.834707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.834873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.835144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.835393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.835686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.835848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.835990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.836336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.836668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.836876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.837042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.837332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.837599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.837798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.837948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.838283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.838522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.838844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.838984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.839162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.839502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.839808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.839924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.840092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.840437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.840770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.840962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.841093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.841417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.841701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.841840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.841960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.842099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.842130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.409 [2024-11-19 15:28:57.842258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.842426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.409 [2024-11-19 15:28:57.842456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.409 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.842598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.842748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.842777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.842956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.843258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.843529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.843769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.843884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.843980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.844287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.844611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.844895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.844988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.845141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.845400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.845732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.845851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.845980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.846275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.846515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.846789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.846907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.847059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.847353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.847654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.847785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.847923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.848280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.848560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.848678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.848864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.849210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.410 [2024-11-19 15:28:57.849543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.410 [2024-11-19 15:28:57.849697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.410 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.849784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.849938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.849964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.850086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.850405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.850646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.850799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.850963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.851236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.851479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.851685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.851845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.851967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.852291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.852604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.852771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.852904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.853179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.853505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.853797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.853977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.854129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.854682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.854854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.854985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.855321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.855660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.855861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.855987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.856282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.856568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.856841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.856993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.857088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.857361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.857636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.857760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.411 qpair failed and we were unable to recover it. 00:27:59.411 [2024-11-19 15:28:57.857905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.411 [2024-11-19 15:28:57.858034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.858211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.858505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.858793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.858934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.859050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.859267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.859497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.859833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.859959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.860080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.860404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.860706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.860881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.861004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.861332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.861606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.861866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.861999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.862149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.862459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.862775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.862893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.862994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.863273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.863549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.863861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.863996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.864168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.864507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.864798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.864984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.865108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.865328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.865648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.865797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.865953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.866076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.412 [2024-11-19 15:28:57.866104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.412 qpair failed and we were unable to recover it. 00:27:59.412 [2024-11-19 15:28:57.866189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.866489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.866776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.866926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.867111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.867383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.867705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.867846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.867937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.868289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.868550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.868791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.868933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.869023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.869277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.869548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.869835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.869978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.870101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.870376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.870716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.870878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.870999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.871333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.871630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.871788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.871912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.872198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.872535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.872813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.872963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.873124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.873438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.873761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.873916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.874028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.874172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.874215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.413 qpair failed and we were unable to recover it. 00:27:59.413 [2024-11-19 15:28:57.874312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.413 [2024-11-19 15:28:57.874423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.874454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.874596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.874701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.874730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.874854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.874946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.874987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.875085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.875409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.875715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.875883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.876051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.876316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.876633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.876814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.876910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.877194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.877480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.877767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.877913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.878063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.878326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.878616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.878778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.878949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.879220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.879566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.879841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.879951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.880042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.880331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.880683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.880887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.881039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.881360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.881712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.881909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.882065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.882372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.882682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.414 [2024-11-19 15:28:57.882844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.414 qpair failed and we were unable to recover it. 00:27:59.414 [2024-11-19 15:28:57.882990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.883253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.883490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.883780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.883944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.884078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.884389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.884664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.884821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.884940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.885177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.885465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.885766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.885935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.886061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.886292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.886606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.886783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.886931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.887227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.887530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.887862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.887977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.888115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.888343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.888632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.888777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.888892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.889170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.889478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.889813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.415 [2024-11-19 15:28:57.889958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.415 qpair failed and we were unable to recover it. 00:27:59.415 [2024-11-19 15:28:57.890066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.890401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.890686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.890915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.891061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.891364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.891681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.891851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.891985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.892318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.892617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.892779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.892897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.893184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.893434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.893652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.893843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.893935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.894187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.894497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.894782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.894983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.895143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.895378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.895651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.895813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.895922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.896209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.896555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.896739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.896859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.897181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.897491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.897774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.897948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.898090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.898179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.898207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.416 qpair failed and we were unable to recover it. 00:27:59.416 [2024-11-19 15:28:57.898308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.898434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.416 [2024-11-19 15:28:57.898461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.898641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.898794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.898822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.898993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.899263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.899548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.899806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.899951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.900123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.900450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.900789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.900957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.901053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.901369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.901602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.901768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.901915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.902163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.902478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.902820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.902984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.903153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.903462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.903821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.903947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.904111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.904461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.904777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.904951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.905222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.905515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.905833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.905972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.906114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.906410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.906725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.906871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.907018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.907207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.417 [2024-11-19 15:28:57.907238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.417 qpair failed and we were unable to recover it. 00:27:59.417 [2024-11-19 15:28:57.907363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.907451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.907478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.907573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.907699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.907726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.907862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.908181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.908418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.908657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.908785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.908903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.909196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.909439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.909703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.909835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.909937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.910192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.910449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.910753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.910870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.910989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.911256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.911523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.911835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.911980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.912248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.912521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.912808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.912978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.913068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.913376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.913667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.913805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.913955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.914243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.914480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.914802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.914943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.418 [2024-11-19 15:28:57.915059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.915180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.418 [2024-11-19 15:28:57.915206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.418 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.915344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.915472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.915502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.915654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.915824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.915859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.915987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.916223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.916536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.916713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.916877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.917199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.917492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.917843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.917967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.918087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.918396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.918626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.918869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.918990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.919095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.919215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.419 [2024-11-19 15:28:57.919257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.419 qpair failed and we were unable to recover it. 00:27:59.419 [2024-11-19 15:28:57.919426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.919549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.919576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.919695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.919816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.919843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.919966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.920268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.920517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.920846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.920991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.921089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.921359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.921643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.921779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.921905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.922218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.922461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.922716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.922892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.923023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.923172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.923198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.923324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.923444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.923470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.702 qpair failed and we were unable to recover it. 00:27:59.702 [2024-11-19 15:28:57.923600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.702 [2024-11-19 15:28:57.923696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.923724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.923820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.923946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.923973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.924123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.924434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.924653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.924810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.924962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.925231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.925459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.925718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.925829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.925951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.926195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.926495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.926767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.926954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.927051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.927350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.927637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.927810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.927903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.928145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.928385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.928702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.928847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.928945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.929176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.929382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.929654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.929794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.929947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.930224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.930498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.930791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.930969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.703 qpair failed and we were unable to recover it. 00:27:59.703 [2024-11-19 15:28:57.931117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.931229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.703 [2024-11-19 15:28:57.931255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.931377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.931524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.931550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.931668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.931786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.931813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.931931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.932167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.932435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.932760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.932904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.933001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.933216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.933508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.933792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.933936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.934079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.934345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.934615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.934787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.934930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.935328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.935606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.935771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.935927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.936221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.936462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.936721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.936874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.936968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.937218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.937433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.937710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.937861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.937961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.938200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.938497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.938832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.704 [2024-11-19 15:28:57.938986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.704 qpair failed and we were unable to recover it. 00:27:59.704 [2024-11-19 15:28:57.939102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.939329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.939589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.939818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.939995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.940117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.940390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.940697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.940810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.940945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.941192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.941462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.941729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.941882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.942040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.942315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.942581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.942850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.942999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.943145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.943448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.943706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.943822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.943924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.944163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.944405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.944707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.944888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.945003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.945249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.945524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.945763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.945872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.945967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.946208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.705 qpair failed and we were unable to recover it. 00:27:59.705 [2024-11-19 15:28:57.946432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.705 [2024-11-19 15:28:57.946584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.946714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.946811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.946838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.946962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.947241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.947477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.947756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.947906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.948061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.948368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.948659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.948878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.949004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.949266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.949573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.949854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.949979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.950129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.950428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.950702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.950855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.950952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.951167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.951371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.951653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.951797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.951957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.952197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.952459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.952736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.952886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.953049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.953298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.953640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.953816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.706 qpair failed and we were unable to recover it. 00:27:59.706 [2024-11-19 15:28:57.953966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.954057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.706 [2024-11-19 15:28:57.954084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.954199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.954439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.954707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.954869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.954992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.955228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.955496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.955775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.955921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.956020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.956286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.956538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.956842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.956975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.957151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.957446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.957730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.957858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.957955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.958160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.958397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.958710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.958855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.958955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.959225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.959442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.959719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.959879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.959981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.960250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.707 qpair failed and we were unable to recover it. 00:27:59.707 [2024-11-19 15:28:57.960515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.707 [2024-11-19 15:28:57.960704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.960807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.960938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.960965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.961046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.961368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.961676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.961831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.961929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.962178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.962451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.962717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.962849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.962940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.963211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.963453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.963698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.963822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.963975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.964252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.964498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.964753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.964934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.965072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.965368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.965581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.965810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.965936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.966054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.966358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.966596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.966867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.966995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.967121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.967351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.967620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.967781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.967869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.968024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.708 [2024-11-19 15:28:57.968051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.708 qpair failed and we were unable to recover it. 00:27:59.708 [2024-11-19 15:28:57.968169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.968442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.968666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.968818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.968943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.969186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.969500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.969872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.969994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.970141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.970449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.970747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.970889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.970983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.971225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.971489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.971701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.971844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.971998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.972290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.972567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.972851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.972998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.973156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.973434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.973705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.973833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.973983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.974282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.974525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.974774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.974925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.975091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.975330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.975560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-11-19 15:28:57.975849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.975975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.709 [2024-11-19 15:28:57.976003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.976102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.976373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.976673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.976844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.976968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.977517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.977843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.977997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.978046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.978223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.978410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.978439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.978580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.978732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.978760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.978911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.979277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.979552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.979818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.979942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.980058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.980300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.980571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.980824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.980980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.981174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.981432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.981687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.981816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.981949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.982220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.982431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.982680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.982837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.982926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.983235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.983456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.983734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.983851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-11-19 15:28:57.984006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.710 [2024-11-19 15:28:57.984104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.984230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.984467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.984736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.984911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.985033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.985309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.985575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.985858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.985980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.986100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.986361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.986597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.986759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.986901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.987212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.987513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.987801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.987939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.988077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.988342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.988635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.988760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.988875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.989174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.989496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.989750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.989932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.990044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.990152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.990178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.990329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.990488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.990517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-11-19 15:28:57.990655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.711 [2024-11-19 15:28:57.990807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.990835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.990922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.991208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.991534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.991807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.991919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.992079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.992400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.992719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.992885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.992997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.993317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.993620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.993824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.993992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.994289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.994571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.994777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.994916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.995210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.995433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.995738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.995891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.996046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.996319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.996612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.996851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.996998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.997127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.997404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.997707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.997912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.998033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.998311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.998632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.998792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.712 qpair failed and we were unable to recover it. 00:27:59.712 [2024-11-19 15:28:57.998912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.712 [2024-11-19 15:28:57.999031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:57.999223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:57.999564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:57.999834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:57.999979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.000155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.000447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.000799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.000953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.001108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.001369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.001679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.001865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.001987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.002282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.002554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.002872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.002989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.003140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.003428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.003634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.003906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.003987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.004105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.004406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.004695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.004821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.004918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.005151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.005666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.005792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.005920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.006192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.006436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.713 [2024-11-19 15:28:58.006732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.713 [2024-11-19 15:28:58.006843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.713 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.006965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.007178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.007423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.007661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.007845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.007990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.008232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.008440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.008711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.008864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.009013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.009281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.009520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.009783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.009911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.010061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.010311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.010575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.010850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.010975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.011148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.011418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.011750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.011903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.012021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.012338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.012571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.012747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.012898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.013152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.013446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.013717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.013895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.013984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.014126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.014152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.014280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.014434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.014461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.714 qpair failed and we were unable to recover it. 00:27:59.714 [2024-11-19 15:28:58.014611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.714 [2024-11-19 15:28:58.014705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.014742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.014845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.014929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.014955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.015072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.015366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.015598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.015771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.015888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.016130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.016389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.016650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.016913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.016994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.017143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.017374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.017675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.017858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.017983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.018224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.018523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.018804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.018923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.019040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.019304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.019578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.019870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.019989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.020115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.020411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.020736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.020854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.020944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.021250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.021548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.021808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.021984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.715 [2024-11-19 15:28:58.022128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.022253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.715 [2024-11-19 15:28:58.022280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.715 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.022384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.022505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.022531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.022704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.022848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.022875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.022995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.023240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.023503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.023802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.023952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.024115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.024332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.024633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.024794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.024889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.025214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.025458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.025720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.025874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.025991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.026209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.026507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.026731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.026876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.026991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.027265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.027594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.027846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.027956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.028077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.028343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.028648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.028815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.716 [2024-11-19 15:28:58.028945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.029033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.716 [2024-11-19 15:28:58.029059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.716 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.029177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.029441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.029721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.029896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.030041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.030352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.030625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.030800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.030899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.031210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.031478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.031736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.031865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.032126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.032449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.032727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.032849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.032997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.033263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.033567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.033746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.033900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.034217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.034486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.034721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.034849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.034966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.035207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.035483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.035787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.035926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.036074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.036297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.036594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.036889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.036983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.037026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.717 qpair failed and we were unable to recover it. 00:27:59.717 [2024-11-19 15:28:58.037157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.717 [2024-11-19 15:28:58.037300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.037326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.037413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.037545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.037571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.037671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.037858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.037884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.038018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.038316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.038609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.038801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.038929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.039241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.039516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.039829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.039985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.040122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.040436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.040676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.040805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.040897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.041170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.041403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.041713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.041899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.042030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.042297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.042567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.042837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.042986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.043164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.043431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.043758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.043908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.044062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.044381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.044686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.044815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.044911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.045004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.045030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.718 [2024-11-19 15:28:58.045152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.045243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.718 [2024-11-19 15:28:58.045270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.718 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.045416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.045506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.045532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.045628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.045757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.045784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.045907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.046198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.046474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.046671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.046828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.047122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.047427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.047714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.047867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.047961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.048205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.048445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.048758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.048877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.049006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.049319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.049623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.049791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.049940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.050204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.050479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.050751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.050918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.051083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.051373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.051662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.051824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.051919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.052176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.052425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.052698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.052858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.052974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.053107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.053133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.719 qpair failed and we were unable to recover it. 00:27:59.719 [2024-11-19 15:28:58.053251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.719 [2024-11-19 15:28:58.053375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.053401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.053549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.053636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.053663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.053796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.053911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.053936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.054079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.054344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.054624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.054822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.054951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.055222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.055513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.055779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.055941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.056042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.056296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.056553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.056745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.056927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.057241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.057548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.057727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.057855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.058118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.058353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.058578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.058841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.058975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.059100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.059417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.059739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.059907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.060047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.060173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.060201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.720 [2024-11-19 15:28:58.060328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.060445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.720 [2024-11-19 15:28:58.060472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.720 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.060600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.060687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.060721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.060854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.061124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.061423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.061770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.061888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.061981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.062195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.062490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.062940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.063135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.063349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.063614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.063777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.063916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.064132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.064463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.064708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.064905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.065057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.065297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.065571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.065758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.065893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.066166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.066458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.066749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.066890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.066986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.067256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.067550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.067870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.067984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.068014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.721 qpair failed and we were unable to recover it. 00:27:59.721 [2024-11-19 15:28:58.068153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.721 [2024-11-19 15:28:58.068312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.068341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.068460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.068617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.068645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.068784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.068886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.068912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.069002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.069274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.069519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.069814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.069927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.070026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.070270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.070592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.070897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.070994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.071156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.071489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.071757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.071908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.072041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.072368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.072666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.072828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.072943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.073218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.073513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.073819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.073945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.074096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.074349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.074578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.074883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.074980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.075154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.075426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.075696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.075824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.075916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.076066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.722 [2024-11-19 15:28:58.076094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.722 qpair failed and we were unable to recover it. 00:27:59.722 [2024-11-19 15:28:58.076189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.076432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.076703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.076865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.076978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.077189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.077395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.077666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.077859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.078038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.078314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.078642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.078870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.078995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.079143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.079383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.079633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.079850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.079994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.080140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.080421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.080661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.080843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.080961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.081231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.081529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.081838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.081959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.082101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.082427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.082699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.082852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.082950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.083252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.083542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.723 [2024-11-19 15:28:58.083660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.723 qpair failed and we were unable to recover it. 00:27:59.723 [2024-11-19 15:28:58.083825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.083954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.083981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.084102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.084443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.084783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.084961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.085089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.085372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.085698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.085821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.085963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.086278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.086599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.086768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.086908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.087177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.087434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.087715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.087904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.088065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.088366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.088672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.088800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.088897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.089121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.089338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.089583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.089831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.089977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.090102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.090367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.090611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.090883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.090977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.091134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.091489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.724 qpair failed and we were unable to recover it. 00:27:59.724 [2024-11-19 15:28:58.091773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.724 [2024-11-19 15:28:58.091886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.091913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.092040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.092277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.092530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.092771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.092924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.093040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.093309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.093601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.093775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.093915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.094233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.094505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.094833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.094992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.095131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.095420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.095743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.095927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.096037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.096373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.096619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.096792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.096928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.097197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.097434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.097673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.097846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.097982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.098328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.098576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.725 qpair failed and we were unable to recover it. 00:27:59.725 [2024-11-19 15:28:58.098849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.725 [2024-11-19 15:28:58.098939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.098966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.099052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.099305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.099611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.099867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.099993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.100147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.100437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.100760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.100938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.101071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.101366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.101621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.101786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.101924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.102191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.102524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.102857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.102999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.103115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.103361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.103611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.103843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.103995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.104141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.104398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.104720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.104875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.105026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.105369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.105684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.105850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.105999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.106318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.106669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.106841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.726 [2024-11-19 15:28:58.106969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.107068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.726 [2024-11-19 15:28:58.107094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.726 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.107192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.107531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.107816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.107965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.108081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.108348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.108867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.108990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.109106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.109323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.109617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.109818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.109961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.110109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.110374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.110648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.110805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.110931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.111197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.111439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.111704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.111849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.111943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.112214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.112464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.112733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.112891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.113008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.113246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.113554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.113830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.113980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.114077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.114228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.114255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.114377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.114498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.114526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.727 qpair failed and we were unable to recover it. 00:27:59.727 [2024-11-19 15:28:58.114623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.727 [2024-11-19 15:28:58.114774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.114802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.114924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.115210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.115511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.115798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.115917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.116043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.116280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.116482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.116855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.116973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.117065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.117389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.117699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.117843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.117993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.118234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.118517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.118780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.118896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.119019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.119292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.119523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.119834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.119955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.120073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.120316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.120556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.120809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.120929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.121077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.121280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.121566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.121874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.121996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.728 [2024-11-19 15:28:58.122092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.122217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.728 [2024-11-19 15:28:58.122244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.728 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.122365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.122516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.122543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.122697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.122846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.122873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.122961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.123206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.123496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.123735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.123855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.123953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.124188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.124511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.124729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.124838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.124933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.125214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.125496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.125708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.125857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.125984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.126236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.126538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.126842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.126998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.127164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.127430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.127732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.127905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.128293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.128587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.128761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.128908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.129194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.129511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.729 qpair failed and we were unable to recover it. 00:27:59.729 [2024-11-19 15:28:58.129823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.729 [2024-11-19 15:28:58.129967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.130096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.130341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.130600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.130846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.130999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.131098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.131331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.131589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.131721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.131880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.132177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.132424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.132749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.132893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.132982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.133283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.133588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.133847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.133975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.134078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.134295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.134587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.134881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.134974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.135151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.135378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.135699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.135840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.135972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.136243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.136525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.730 qpair failed and we were unable to recover it. 00:27:59.730 [2024-11-19 15:28:58.136815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.730 [2024-11-19 15:28:58.136935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.136962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.137091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.137357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.137580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.137855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.137977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.138160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.138414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.138707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.138883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.139031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.139307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.139611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.139890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.139985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.140104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.140326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.140647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.140836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.140956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.141239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.141492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.141835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.141984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.142125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.142427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.142663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.142815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.142933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.143157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.143486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.143845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.143967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.144081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.144354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.731 [2024-11-19 15:28:58.144622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.731 [2024-11-19 15:28:58.144769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.731 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.144890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.144975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.145127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.145382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.145608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.145857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.145981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.146129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.146381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.146663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.146841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.146937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.147195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.147444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.147686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.147846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.147972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.148264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.148499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.148765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.148943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.149072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.149370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.149651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.149788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.149907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.150176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.150453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.150697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.150876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.151013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.151249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.151494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.151706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.151860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.151976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.152068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.152094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.732 qpair failed and we were unable to recover it. 00:27:59.732 [2024-11-19 15:28:58.152221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.732 [2024-11-19 15:28:58.152312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.152339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.152432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.152555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.152582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.152672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.152802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.152830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.152974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.153264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.153473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.153838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.153981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.154166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.154444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.154716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.154856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.155012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.155259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.155532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.155818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.155936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.156031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.156324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.156576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.156741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.156893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.157200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.157441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.157712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.157854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.157948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.158257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.158510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.158813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.158987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.159105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.159381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.159632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.159803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.733 [2024-11-19 15:28:58.159951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.160045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.733 [2024-11-19 15:28:58.160072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.733 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.160194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.160472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.160733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.160880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.161003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.161231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.161467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.161722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.161833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.161981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.162220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.162490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.162764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.162939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.163093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.163335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.163587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.163811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.163936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.164023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.164259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.164505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.164762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.164915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.165038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.165328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.165523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.165827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.165953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.166057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.166179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.166207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.166329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.166416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.166443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.734 qpair failed and we were unable to recover it. 00:27:59.734 [2024-11-19 15:28:58.166562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.734 [2024-11-19 15:28:58.166645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.166673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.166813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.166934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.166962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.167083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.167331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.167629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.167816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.167929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.168214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.168516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.168800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.168980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.169074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.169343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.169588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.169822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.169965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.170050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.170296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.170579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.170823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.170963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.171085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.171393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.171701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.171852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.171978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.172209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.172508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.172826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.172975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.173122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.173398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.173659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.173825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.173943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.174093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.174120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.735 [2024-11-19 15:28:58.174237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.174366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.735 [2024-11-19 15:28:58.174393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.735 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.174527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.174617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.174645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.174812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.174966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.174993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.175119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.175337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.175607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.175778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.175929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.176239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.176509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.176725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.176882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.177038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.177290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.177567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.177781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.177958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.178051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.178278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.178512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.178851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.178976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.179102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.179342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.179607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.179728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.179856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.180144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.180340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.180629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.180778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.180901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.181148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.181412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.181683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.181853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.736 qpair failed and we were unable to recover it. 00:27:59.736 [2024-11-19 15:28:58.181970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.736 [2024-11-19 15:28:58.182087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.182237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.182504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.182743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.182875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.182979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.183276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.183550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.183862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.183994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.184140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.184389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.184633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.184766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.184920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.185162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.185458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.185729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.185850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.185998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.186295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.186600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.186778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.186913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.187156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.187442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.187757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.187893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.188011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.188290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.188567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.188821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.188937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.189061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.189301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.737 [2024-11-19 15:28:58.189556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.737 [2024-11-19 15:28:58.189712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.737 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.189809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.189933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.189959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.190087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.190356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.190635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.190859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.190982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.191131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.191352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.191622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.191769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.191893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.192199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.192397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.192662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.192860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.192977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.193214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.193482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.193706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.193846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.193945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.194182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.194424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.194669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.194802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.194904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.195148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.195417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.195678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.195799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.195924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.196185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.196414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.196666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.738 qpair failed and we were unable to recover it. 00:27:59.738 [2024-11-19 15:28:58.196908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.738 [2024-11-19 15:28:58.196997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.197121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.197328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.197594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.197864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.197993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.198117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.198347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.198616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.198874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.198994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.199081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.199321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.199569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.199835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.199957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.200054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.200290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.200546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.200778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.200917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.201007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.201286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.201533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.201796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.201918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.202045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.202256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.202488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.202746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.202862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.739 qpair failed and we were unable to recover it. 00:27:59.739 [2024-11-19 15:28:58.202953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.739 [2024-11-19 15:28:58.203073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.203187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.203396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.203627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.203867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.203982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.204157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.204409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.204762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.204883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.204973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.205215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.205457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.205733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.205859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.205955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.206218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.206495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.206769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.206891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.206989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.207270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.207556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.207776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.207896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.208027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.208300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.208546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.208810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.208922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.209053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.209341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.209635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.209863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.209984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.740 qpair failed and we were unable to recover it. 00:27:59.740 [2024-11-19 15:28:58.210077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.210159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.740 [2024-11-19 15:28:58.210184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.210331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.210483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.210507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.210643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.210816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.210860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.210988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.211334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.211594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.211748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.211859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.212193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.212498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.212734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.212877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.212979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.213272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.213556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.213789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.213924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.214064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.214276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.214541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.214769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.214892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.214989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.215291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.215562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.215797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.215912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.216001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.216243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.216496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.216752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.216870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.216976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.217212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.217408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.741 [2024-11-19 15:28:58.217564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.741 qpair failed and we were unable to recover it. 00:27:59.741 [2024-11-19 15:28:58.217662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.217813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.217839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.217927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.218156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.218417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.218686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.218819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.218912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.219244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.219465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.219734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.219848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.219953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.220238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.220505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.220717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.220844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.220936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.221205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.221437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.221653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.221901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.221997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.222148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.222450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.222703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.222843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.222958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.223177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.223479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.223703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.223836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.223924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.224192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.224432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.742 qpair failed and we were unable to recover it. 00:27:59.742 [2024-11-19 15:28:58.224701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.742 [2024-11-19 15:28:58.224830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.224928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.225163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.225446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.225680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.225835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.225927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.226127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.226439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.226806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.226928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.227069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.227327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.227621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.227774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.227882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.228191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.228471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.228719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.228867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.228960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.229219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.229557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.229818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.229952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.230077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.230341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.230671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.230810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.230929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.231182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.231541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.743 [2024-11-19 15:28:58.231669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.743 qpair failed and we were unable to recover it. 00:27:59.743 [2024-11-19 15:28:58.231831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.231927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.231951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.232086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.232404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.232696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.232896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.232979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.233160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.233481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.233777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.233928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.234065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.234303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.234582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.234825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.234933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.235054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.235412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.235710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.235896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.236099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.236396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.236685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.236845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.237012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.237277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.237589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.237807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.237913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.238143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.238434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.238663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.238810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.238952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.239077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.239102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:27:59.744 qpair failed and we were unable to recover it. 00:27:59.744 [2024-11-19 15:28:58.239305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:59.744 [2024-11-19 15:28:58.239480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.239510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.239724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.239847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.239872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.239963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.240274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.240556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.240771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.240893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.241167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.241423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.241701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.241813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.241933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.242250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.242551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.242853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.242984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.243115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.243480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.243733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.243848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.244049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.244366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.244666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.244916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.245061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.245202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.245242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.245466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.245624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.245652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.245710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf93600 (9): Bad file descriptor 00:28:00.027 [2024-11-19 15:28:58.245865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.246127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.246379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.246647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.246810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.246903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.247006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.247031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.247171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.247301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.027 [2024-11-19 15:28:58.247330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.027 qpair failed and we were unable to recover it. 00:28:00.027 [2024-11-19 15:28:58.247446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.247564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.247592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.247704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.247845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.247870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.247974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.248211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.248488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.248740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.248888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.248983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.249191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.249478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.249742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.249880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.249971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.250231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.250466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.250700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.250828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.250927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.251231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.251488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.251757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.251883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.251967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.252267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.252506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.252825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.252944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.253034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.253262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.253574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.253802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.253919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.254021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.254159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.254186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.254309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.254421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.254449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.028 qpair failed and we were unable to recover it. 00:28:00.028 [2024-11-19 15:28:58.254543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.028 [2024-11-19 15:28:58.254652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.254678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.254802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.254885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.254926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.255030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.255267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.255573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.255825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.255946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.256088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.256320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.256567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.256791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.256902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.257006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.257280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.257553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.257803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.257953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.258088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.258349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.258607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.258844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.258959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.259046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.259439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.259647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.259792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.260641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.260801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.260829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.260976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.261222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.261484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.261763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.261907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.262044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.262419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.029 [2024-11-19 15:28:58.262740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.029 [2024-11-19 15:28:58.262861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.029 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.262983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.263226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.263484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.263751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.263893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.264009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.264292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.264589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.264846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.264973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.265100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.265353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.265658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.265805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.265977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.266239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.266630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.266768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.266893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.267169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.267453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.267723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.267861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.267952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.268222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.268504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.268807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.268957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.269091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.269323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.269527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.269831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.269951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.270080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.270204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.270228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.270320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.270434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.270461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.030 qpair failed and we were unable to recover it. 00:28:00.030 [2024-11-19 15:28:58.270580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.030 [2024-11-19 15:28:58.270732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.270762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.270884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.271219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.271483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.271772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.271911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.272053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.272276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.272608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.272748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.272854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.273131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.273370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.273665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.273818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.273938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.274252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.274526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.274818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.274944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.275078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.275333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.275593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.275816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.275934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.276018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.276217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.276242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.031 qpair failed and we were unable to recover it. 00:28:00.031 [2024-11-19 15:28:58.276340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.276544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.031 [2024-11-19 15:28:58.276569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.276654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.276748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.276773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.276869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.276985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.277108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.277339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.277631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.277840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.277929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.278221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.278489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.278773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.278898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.279029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.279268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.279506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.279643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.279782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.280401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.280434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.280614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.280773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.280799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.280913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.281326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.281670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.281857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.281948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.282179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.282425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.282676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.282812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.282910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.283192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.283437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.283768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.283870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.283982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.284244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.284559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.284778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.032 qpair failed and we were unable to recover it. 00:28:00.032 [2024-11-19 15:28:58.284877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.032 [2024-11-19 15:28:58.285014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.285161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.285464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.285664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.285801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.285891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.286153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.286400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.286693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.286823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.286910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.287127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.287441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.287780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.287889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.288087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.288310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.288595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.288836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.288943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.289029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.289260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.289496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.289713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.289827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.289913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.290133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.290415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.290734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.290844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.290948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.291183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.291429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.291658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.291870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.033 [2024-11-19 15:28:58.291988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.033 qpair failed and we were unable to recover it. 00:28:00.033 [2024-11-19 15:28:58.292081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.292354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.292557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.292778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.292892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.292978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.293228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.293571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.293817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.293924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.294013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.294343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.294590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.294860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.294997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.295147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.295379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.295663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.295903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.295994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.296111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.296350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.296735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.296860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.296950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.297182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.297436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.297759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.297878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.297974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.298270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.298506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.298801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.298918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.299043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.299161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.299185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.034 [2024-11-19 15:28:58.299268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.299402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.034 [2024-11-19 15:28:58.299429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.034 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.299569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.299686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.299717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.299814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.299911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.299936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.300037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.300269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.300534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.300802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.300928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.301021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.301248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.301472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.301794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.301909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.302034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.302259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.302499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.302752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.302902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.303003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.303280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.303516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.303870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.303988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.304087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.304323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.304549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.304877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.304977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.305094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.305364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.305645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.305883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.305998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.306168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.306434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.035 qpair failed and we were unable to recover it. 00:28:00.035 [2024-11-19 15:28:58.306669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.035 [2024-11-19 15:28:58.306775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.306800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.306896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.306983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.307158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.307490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.307868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.307994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.308138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.308406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.308694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.308836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.308954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.309163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.309393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.309634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.309870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.309984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.310080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.310317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.310560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.310813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.310934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.311084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.311342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.311540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.311750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.311875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.312020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.312280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.312476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.312713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.312825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.313027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.313120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.036 [2024-11-19 15:28:58.313145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.036 qpair failed and we were unable to recover it. 00:28:00.036 [2024-11-19 15:28:58.313259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.313545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.313767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.313986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.314074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.314304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.314575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.314810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.314924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.315009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.315246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.315444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.315736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.315854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.315951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.316213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.316501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.316739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.316851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.316968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.317214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.317508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.317708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.317851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.317938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.318203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.318426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.318662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.318784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.318900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.319139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.319415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.319642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.319816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.319943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.320081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.320109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.320233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.320361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.037 [2024-11-19 15:28:58.320389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.037 qpair failed and we were unable to recover it. 00:28:00.037 [2024-11-19 15:28:58.320592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.320711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.320737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.320932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.321247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.321568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.321847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.321975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.322123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.322285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.322331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.322475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.322676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.322739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.322935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.323218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.323557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.323809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.323934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.324089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.324465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.324814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.324934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.325074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.325412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.325740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.325889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.326010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.326339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.326627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.326815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.326976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.327280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.327551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.327711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.327849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.328145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.328450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.328737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.328908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.329009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.329103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.329143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.038 [2024-11-19 15:28:58.329246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.329351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.038 [2024-11-19 15:28:58.329378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.038 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.329536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.329697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.329741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.329889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.330181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.330470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.330744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.330908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.331008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.331358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.331675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.331801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.331944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.332251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.332671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.332802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.332902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.333206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.333575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.333891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.333981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.334148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.334406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.334706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.334820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.334935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.335191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.335419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.335649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.335822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.335946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.336193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.336474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.336769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.336896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.337006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.337138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.337166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.337262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.337384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.337412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.039 qpair failed and we were unable to recover it. 00:28:00.039 [2024-11-19 15:28:58.337518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.039 [2024-11-19 15:28:58.337609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.337635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.337763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.337870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.337898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.338007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.338330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.338669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.338867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.338970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.339228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.339596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.339814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.339973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.340260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.340509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.340764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.340984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.341136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.341387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.341669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.341855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.341980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.342325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.342654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.342812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.342904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.343213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.343473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.343739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.343882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.344001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.344292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.344560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.040 qpair failed and we were unable to recover it. 00:28:00.040 [2024-11-19 15:28:58.344819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.040 [2024-11-19 15:28:58.344941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.344968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.345102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.345394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.345732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.345846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.345937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.346201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.346488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.346738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.346896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.347173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.347413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.347697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.347934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.348090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.348375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.348636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.348859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.348975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.349073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.349380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.349637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.349878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.349997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.350100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.350330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.350603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.350795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.350895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.351255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.351578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.351780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.351895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.352163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.352430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.352678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.041 [2024-11-19 15:28:58.352802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.041 qpair failed and we were unable to recover it. 00:28:00.041 [2024-11-19 15:28:58.352916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.353180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.353449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.353724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.353867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.354009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.354291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.354564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.354811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.354952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.355081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.355361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.355585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.355851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.355982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.356126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.356413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.356685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.356822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.356943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.357256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.357546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.357853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.357994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.358181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.358444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.358768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.358918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.359017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.359302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.359582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.359858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.359999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.360145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.360381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.042 [2024-11-19 15:28:58.360582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.042 [2024-11-19 15:28:58.360722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.042 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.360805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.360942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.360969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.361078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.361420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.361677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.361842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.361961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.362207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.362542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.362846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.362986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.363173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.363462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.363757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.363882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.363986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.364239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.364521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.364757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.364871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.365031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.365324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.365527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.365829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.365952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.366065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.366373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.366724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.366867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.366966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.367219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.367474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.367774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.367892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.368027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.368295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.043 qpair failed and we were unable to recover it. 00:28:00.043 [2024-11-19 15:28:58.368555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.043 [2024-11-19 15:28:58.368707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.368878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.369131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.369425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.369684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.369848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.369954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.370290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.370560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.370783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.370881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.371184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.371503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.371806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.371948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.372143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.372428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.372722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.372860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.372964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.373214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.373540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.373714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.373926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.374263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.374551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.374788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.374931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.375013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.375271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.375653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.375811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.375915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.376186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.376427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.376662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.376818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.044 qpair failed and we were unable to recover it. 00:28:00.044 [2024-11-19 15:28:58.376916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.044 [2024-11-19 15:28:58.377050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.377219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.377475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.377793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.377939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.378081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.378277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.378536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.378708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.378847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.379153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.379470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.379755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.379891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.380033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.380288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.380575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.380755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.380860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.381207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.381570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.381833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.381953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.382050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.382332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.382626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.382777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.382909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.383136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.383384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.383683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.383808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.045 qpair failed and we were unable to recover it. 00:28:00.045 [2024-11-19 15:28:58.383953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.384038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.045 [2024-11-19 15:28:58.384063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.384177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.384465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.384734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.384874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.384995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.385298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.385541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.385795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.385922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.386014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.386325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.386582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.386845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.386955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.387039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.387243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.387548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.387765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.387913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.388079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.388333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.388611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.388817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.388963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.389050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.389363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.389666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.389835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.389993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.390282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.390544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.390784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.390886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.391228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.391593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.391775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.046 qpair failed and we were unable to recover it. 00:28:00.046 [2024-11-19 15:28:58.391909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.046 [2024-11-19 15:28:58.392046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.392193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.392481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.392779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.392925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.393037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.393274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.393506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.393769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.393896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.394029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.394365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.394632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.394820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.394963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.395234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.395499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.395785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.395929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.396083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.396327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.396568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.396818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.396992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.397079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.397346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.397575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.397730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.397863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.398183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.398472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.398738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.398855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.398937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.399235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.047 [2024-11-19 15:28:58.399507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.047 [2024-11-19 15:28:58.399653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.047 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.399754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.399850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.399876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.400001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.400299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.400543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.400776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.400888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.401007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.401241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.401512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.401835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.401982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.402129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.402409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.402671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.402854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.402967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.403269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.403479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.403775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.403893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.404039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.404300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.404530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.404833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.404978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.405098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.405393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.405701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.405852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.405945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.406209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.406470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.406730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.406837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.406956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.407074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.407098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.048 qpair failed and we were unable to recover it. 00:28:00.048 [2024-11-19 15:28:58.407195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.048 [2024-11-19 15:28:58.407288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.407314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.407439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.407526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.407552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.407649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.407797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.407840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.407966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.408234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.408484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.408752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.408866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.408959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.409235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.409548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.409795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.409915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.410037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.410305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.410520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.410797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.410917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.411036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.411268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.411539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.411783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.411934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.412084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.412339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.412550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.412821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.412934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.413026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.413269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.413512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.413770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.413941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.414060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.414154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.414179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.049 qpair failed and we were unable to recover it. 00:28:00.049 [2024-11-19 15:28:58.414324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.049 [2024-11-19 15:28:58.414446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.414471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.414588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.414681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.414726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.414825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.414912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.414942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.415352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.415587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.415829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.415978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.416065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.416276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.416513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.416750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.416870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.416965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.417251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.417472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.417720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.417841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.417940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.418166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.418418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.418654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.418872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.418993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.419104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.419343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.419609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.419864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.419981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.420006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.420125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.420241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.420266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.050 qpair failed and we were unable to recover it. 00:28:00.050 [2024-11-19 15:28:58.420387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.050 [2024-11-19 15:28:58.420533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.420558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.420678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.420781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.420806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.420900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.421200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.421411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.421672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.421806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.421893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.422184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.422451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.422819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.422911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.423148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.423453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.423668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.423795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.423882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.424130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.424393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.424696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.424831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.424955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.425217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.425477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.425732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.425855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.425957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.426242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.426498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.426738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.426853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.426959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.427205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.051 [2024-11-19 15:28:58.427448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.051 [2024-11-19 15:28:58.427589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.051 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.427695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.427820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.427845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.427938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.428169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.428415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.428710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.428866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.428977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.429262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.429496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.429740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.429863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.430013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.430284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.430520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.430725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.430849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.430940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.431191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.431448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.431658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.431870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.431992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.432104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.432368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.432626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.432846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.432974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.433064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.433354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.433588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.433847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.433954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.434041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.434126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.434150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.434241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.434323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.434348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.052 qpair failed and we were unable to recover it. 00:28:00.052 [2024-11-19 15:28:58.434451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.052 [2024-11-19 15:28:58.434545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.434570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.434700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.434794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.434819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.434938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.435155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.435433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.435722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.435845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.435942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.436207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.436470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.436737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.436859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.436954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.437198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.437497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.437709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.437830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.437977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.438205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.438522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.438791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.438937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.439037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.439298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.439537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.439784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.439905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.439985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.440243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.440507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.440766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.440908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.441024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.441273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.441537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.053 [2024-11-19 15:28:58.441675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.053 qpair failed and we were unable to recover it. 00:28:00.053 [2024-11-19 15:28:58.441786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.441883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.441908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.442001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.442273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.442506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.442741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.442883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.442981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.443248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.443482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.443754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.443873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.443972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.444211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.444469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.444703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.444879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.444975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.445194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.445458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.445675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.445911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.445998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.446118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.446330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.446568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.446812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.446933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.447022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.447342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.447604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.054 qpair failed and we were unable to recover it. 00:28:00.054 [2024-11-19 15:28:58.447830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.054 [2024-11-19 15:28:58.447977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.448116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.448430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.448699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.448821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.448920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.449133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.449400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.449696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.449813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.449909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.450210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.450420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.450719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.450833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.450946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.451203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.451497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.451759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.451923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.452034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.452278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.452515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.452790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.452938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.453019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.453249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.453515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.453738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.453914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.454010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.454312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.454600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.454724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.454859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.455015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.455063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.055 [2024-11-19 15:28:58.455195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.455305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.055 [2024-11-19 15:28:58.455331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.055 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.455425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.455547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.455572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.455672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.455790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.455832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.455949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.456252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.456513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.456751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.456905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.457046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.457313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.457566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.457822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.457940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.458031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.458258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.458517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.458834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.458978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.459163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.459450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.459708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.459862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.459983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.460259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.460560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.460710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.460882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.461206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.461417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.461702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.461884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.461985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.462273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.462517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.462809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.462930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.056 qpair failed and we were unable to recover it. 00:28:00.056 [2024-11-19 15:28:58.463052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.056 [2024-11-19 15:28:58.463195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.463320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.463591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.463805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.463948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.464070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.464362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.464598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.464855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.464986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.465157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.465423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.465652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.465832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.465981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.466268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.466510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.466798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.466987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.467135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.467395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.467628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.467808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.467939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.468256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.468519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.468822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.468963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.469103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.469340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.469557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.469746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.469866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.470165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.470464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.057 [2024-11-19 15:28:58.470723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.057 [2024-11-19 15:28:58.470907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.057 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.471023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.471266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.471527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.471799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.471971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.472063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.472286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.472581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.472838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.472983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.473129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.473367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.473652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.473779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.473888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.474153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.474395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.474661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.474817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.474961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.475197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.475466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.475745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.475888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.475975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.476216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.476446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.476697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.476841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.476939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.477228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.477512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.477797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.477968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.478082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.478192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.058 [2024-11-19 15:28:58.478218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.058 qpair failed and we were unable to recover it. 00:28:00.058 [2024-11-19 15:28:58.478312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.478566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.478843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.478985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.479097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.479392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.479669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.479791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.479929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.480156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.480447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.480709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.480853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.480944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.481182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.481447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.481649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.481829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.481943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.482213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.482474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.482675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.482823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.482939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.483207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.483497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.483737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.483857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.483949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.484240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.484453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.059 [2024-11-19 15:28:58.484602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.059 qpair failed and we were unable to recover it. 00:28:00.059 [2024-11-19 15:28:58.484735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.484856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.484880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.484973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.485201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.485423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.485662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.485849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.485974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.486248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.486494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.486772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.486934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.487085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.487371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.487636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.487835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.487929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.488149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.488446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.488684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.488838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.488964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.489193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.489417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.489671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.489811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.489892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.490131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.490388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.490685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.490837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.490930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.491170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.491434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.491705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.491858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.060 qpair failed and we were unable to recover it. 00:28:00.060 [2024-11-19 15:28:58.491987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.492119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.060 [2024-11-19 15:28:58.492143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.492242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.492490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.492794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.492953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.493136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.493416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.493651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.493786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.493899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.494162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.494389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.494682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.494799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.494918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.495215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.495487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.495719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.495830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.495948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.496153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.496448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.496681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.496899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.496991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.497138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.497397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.497670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.497858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.497991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.498227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.498513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.498762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.498930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.499050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.499142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.499167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.499289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.499370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.499395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.061 qpair failed and we were unable to recover it. 00:28:00.061 [2024-11-19 15:28:58.499511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.061 [2024-11-19 15:28:58.499640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.499664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.499795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.499919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.499945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.500068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.500338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.500572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.500797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.500939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.501056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.501322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.501549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.501853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.501997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.502092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.502356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.502644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.502822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.502938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.503231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.503502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.503767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.503877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.504019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.504263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.504532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.504799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.504928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.505065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.505375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.505624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.505845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.505995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.506119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.506328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.506619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.062 [2024-11-19 15:28:58.506834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.062 [2024-11-19 15:28:58.506972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.062 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.507067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.507304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.507561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.507811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.507949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.508077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.508313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.508587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.508776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.508932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.509236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.509556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.509836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.509988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.510140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.510422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.510638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.510783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.510945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.511169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.511460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.511702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.511846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.511949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.512163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.512412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.512680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.512798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.512916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.513177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.063 [2024-11-19 15:28:58.513389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.063 [2024-11-19 15:28:58.513530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.063 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.513617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.513737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.513762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.513884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.514178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.514425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.514649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.514828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.514948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.515172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.515410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.515666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.515792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.515898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.516135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.516418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.516648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.516797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.516900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.517160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.517400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.517661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.517796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.517916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.518162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.518394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.518667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.518803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.518923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.519126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.519356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.519626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.519797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.519946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.520206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.520496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.064 qpair failed and we were unable to recover it. 00:28:00.064 [2024-11-19 15:28:58.520733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.064 [2024-11-19 15:28:58.520853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.520877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.520998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.521269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.521524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.521826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.521971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.522096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.522328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.522600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.522771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.522904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.523195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.523423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.523737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.523898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.524063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.524322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.524564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.524835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.524980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.525075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.525315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.525547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.525774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.525908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.526040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.526334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.526606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.526870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.526983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.527104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.527302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.527586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.527733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.527879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.528011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.528040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.065 [2024-11-19 15:28:58.528176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.528270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.065 [2024-11-19 15:28:58.528294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.065 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.528383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.528551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.528576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.528816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.528841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.528955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.529203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.529438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.529708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.529820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.529913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.530176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.530441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.530718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.530895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.530985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.531245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.531523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.531790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.531999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.532082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.532286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.532553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.532844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.532982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.533145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.533381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.533619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.533892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.533985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.534104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.534337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.534612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.534863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.534976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.535121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.535389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.066 qpair failed and we were unable to recover it. 00:28:00.066 [2024-11-19 15:28:58.535652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.066 [2024-11-19 15:28:58.535783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.535808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.535927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.536240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.536533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.536836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.536978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.537140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.537353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.537616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.537859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.537998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.538110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.538345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.538581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.538864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.538971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.539087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.539322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.539560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.539820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.539938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.540086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.540352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.540617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.540781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.540944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.541262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.541552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.541820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.541988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.542120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.542451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.542750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.542924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.543040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.543149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.543173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.067 [2024-11-19 15:28:58.543263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.543409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.067 [2024-11-19 15:28:58.543433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.067 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.543586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.543685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.543718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.543868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.544167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.544409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.544670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.544787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.544912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.545203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.545415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.545733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.545905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.546028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.546252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.546567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.546861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.546978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.547145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.547404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.547637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.547781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.547876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.548192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.548466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.548693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.548835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.548950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.549241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.549475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.549708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.549848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.068 [2024-11-19 15:28:58.549939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.550053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.068 [2024-11-19 15:28:58.550079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.068 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.550198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.550494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.550778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.550924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.551070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.551334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.551528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.551799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.551950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.552065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.552332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.552641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.552824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.552971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.553228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.553436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.553702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.553842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.553930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.554242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.554543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.554737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.554908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.555235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.555501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.555752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.555900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.555995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.556240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.556504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.556774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.556943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.557081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.557365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.557602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.557775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.069 qpair failed and we were unable to recover it. 00:28:00.069 [2024-11-19 15:28:58.557923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.069 [2024-11-19 15:28:58.558034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.558182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.558391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.558683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.558824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.558915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.559148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.559379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.559611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.559767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.559933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.560241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.560535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.560711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.560890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.561145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.561421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.561697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.561807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.561925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.562215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.562425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.562663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.562812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.562938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.563147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.563372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.563590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.563862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.563973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.564064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.564331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.564580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.564857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.564979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.070 qpair failed and we were unable to recover it. 00:28:00.070 [2024-11-19 15:28:58.565100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.565216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.070 [2024-11-19 15:28:58.565241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.071 qpair failed and we were unable to recover it. 00:28:00.071 [2024-11-19 15:28:58.565364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.071 qpair failed and we were unable to recover it. 00:28:00.071 [2024-11-19 15:28:58.565634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.071 qpair failed and we were unable to recover it. 00:28:00.071 [2024-11-19 15:28:58.565859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.071 [2024-11-19 15:28:58.565999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.071 qpair failed and we were unable to recover it. 00:28:00.071 [2024-11-19 15:28:58.566122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-19 15:28:58.566334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-19 15:28:58.566547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-19 15:28:58.566762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.566875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-19 15:28:58.566962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.567052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.353 [2024-11-19 15:28:58.567077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.567170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.567438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.567672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.567796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.567921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.568189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.568425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.568720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.568848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.568939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.569165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.569357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.569617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.569851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.569968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.570085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.570349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.570607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.570812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.570964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.571076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.571288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.571551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.571759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.571878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.571975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.572183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.572475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.572781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.572941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.573036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.573135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.573160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-19 15:28:58.573306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.573391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.354 [2024-11-19 15:28:58.573416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.573509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.573595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.573624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.573754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.573855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.573880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.573981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.574240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.574499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.574765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.574912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.575010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.575240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.575445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.575677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.575853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.576004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.576248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.576484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.576749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.576897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.577016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.577287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.577532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.577819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.577991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.578159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.578448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.578683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.578806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.578936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.579201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.579465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.579683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.355 [2024-11-19 15:28:58.579839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-19 15:28:58.579924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.580171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.580410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.580670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.580795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.580890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.581172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.581463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.581746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.581959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.582078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.582315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.582579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.582842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.582984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.583099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.583361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.583626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.583799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.583951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.584147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.584414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.584666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.584810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.584905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.585145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.585407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.585661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.585826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.585925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.586223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.586453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.586752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.586924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.356 qpair failed and we were unable to recover it. 00:28:00.356 [2024-11-19 15:28:58.587072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.587213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.356 [2024-11-19 15:28:58.587238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.587386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.587475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.587501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.587620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.587715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.587742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.587849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.588134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.588390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.588678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.588831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.588950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.589202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.589476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.589761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.589879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.590002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.590276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.590508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.590798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.590985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.591141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.591384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.591621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.591854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.591964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.592118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.592370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.592681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.592825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.592980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.593373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.593703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.593911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.594001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.594139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.357 [2024-11-19 15:28:58.594180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.357 qpair failed and we were unable to recover it. 00:28:00.357 [2024-11-19 15:28:58.594309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.594456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.594481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.594604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.594737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.594764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.594936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.595249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.595528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.595846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.595975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.596138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.596348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.596609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.596846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.596991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.597108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.597367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.597606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.597837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.597975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.598374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.598616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.598854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.598995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.599155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.599415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.599645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.599831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.599924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.600187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.358 qpair failed and we were unable to recover it. 00:28:00.358 [2024-11-19 15:28:58.600431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.358 [2024-11-19 15:28:58.600539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.600655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.600744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.600768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.600891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.601181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.601423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.601686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.601873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.602038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.602322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.602568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.602719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.602861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.603198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.603444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.603733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.603882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.604002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.604237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.604507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.604797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.604983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.605158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.605492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.605746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.605966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.606101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.606385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.606627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.606820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.606973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.607230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.607538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.607679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.607942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.608125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.608191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.359 qpair failed and we were unable to recover it. 00:28:00.359 [2024-11-19 15:28:58.608308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.359 [2024-11-19 15:28:58.608392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.608417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.608537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.608655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.608680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.608835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.608955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.608979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.609098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.609348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.609585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.609839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.609962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.610047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.610278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.610572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.610864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.610995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.611157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.611363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.611651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.611775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.611893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.612124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.612410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.612672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.612851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.612947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.613264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.613535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.613845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.613986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.614117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.614341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.614599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.614811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.614914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.615063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.615338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.360 qpair failed and we were unable to recover it. 00:28:00.360 [2024-11-19 15:28:58.615597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.360 [2024-11-19 15:28:58.615710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.615832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.615946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.615971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.616088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.616305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.616597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.616970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.617125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.617453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.617726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.617844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.617942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.618198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.618459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.618721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.618902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.619029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.619297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.619525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.619834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.619998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.620147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.620640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.620820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.620967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.621284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.621550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.621852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.621965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.622134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.622416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.622656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.622898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.622992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.623017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.623140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.623227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.361 [2024-11-19 15:28:58.623252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.361 qpair failed and we were unable to recover it. 00:28:00.361 [2024-11-19 15:28:58.623351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.623478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.623502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.623654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.623801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.623844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.623950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.624280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.624520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.624782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.624910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.625066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.625323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.625535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.625836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.625981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.626113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.626335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.626568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.626870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.627142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.627433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.627670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.627807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.627921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.628165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.628459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.628706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.628825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.628954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.629166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.629391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.629648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.629877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.629976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.630122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.630394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.362 qpair failed and we were unable to recover it. 00:28:00.362 [2024-11-19 15:28:58.630630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.362 [2024-11-19 15:28:58.630776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.630801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.630917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.631198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.631440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.631700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.631812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.631901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.632132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.632338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.632630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.632879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.632998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.633149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.633381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.633638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.633825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.633932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.634250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.634489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.634724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.634844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.634936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.635202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.635418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.635670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.635825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.635950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.636177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.636416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.363 qpair failed and we were unable to recover it. 00:28:00.363 [2024-11-19 15:28:58.636650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.363 [2024-11-19 15:28:58.636803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.636922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.637150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.637390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.637678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.637847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.637974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.638211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.638502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.638740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.638862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.638976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.639238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.639527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.639834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.639996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.640180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.640463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.640764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.640974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.641105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.641414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.641707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.641897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.642020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.642409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.642650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.642844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.642954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.643265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.643537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.643834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.643992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.644205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.644523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.644816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.644975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.364 [2024-11-19 15:28:58.645016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.364 qpair failed and we were unable to recover it. 00:28:00.364 [2024-11-19 15:28:58.645140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.645229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.645254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2888066 Killed "${NVMF_APP[@]}" "$@" 00:28:00.365 [2024-11-19 15:28:58.645413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.645531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.645555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 15:28:58 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:28:00.365 [2024-11-19 15:28:58.645649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.645818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:00.365 [2024-11-19 15:28:58.645863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.645952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:00.365 [2024-11-19 15:28:58.646080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:00.365 [2024-11-19 15:28:58.646105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 15:28:58 -- common/autotest_common.sh@10 -- # set +x 00:28:00.365 [2024-11-19 15:28:58.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.646504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.646797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.646993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.647174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.647415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.647725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.647896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.648015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.648281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.648548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.648781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.648923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.649014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.649231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- nvmf/common.sh@469 -- # nvmfpid=2888767 00:28:00.365 [2024-11-19 15:28:58.649355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 15:28:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 15:28:58 -- nvmf/common.sh@470 -- # waitforlisten 2888767 00:28:00.365 [2024-11-19 15:28:58.649505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b9 15:28:58 -- common/autotest_common.sh@829 -- # '[' -z 2888767 ']' 00:28:00.365 0 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.649729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:00.365 [2024-11-19 15:28:58.649817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.649842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 15:28:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:00.365 [2024-11-19 15:28:58.649965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:00.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:00.365 [2024-11-19 15:28:58.650083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 15:28:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:00.365 [2024-11-19 15:28:58.650108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 15:28:58 -- common/autotest_common.sh@10 -- # set +x 00:28:00.365 [2024-11-19 15:28:58.650232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.650487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.650699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.650813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.650912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.651148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.651498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.365 [2024-11-19 15:28:58.651673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.365 qpair failed and we were unable to recover it. 00:28:00.365 [2024-11-19 15:28:58.651810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.651913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.651939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.652036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.652322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.652595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.652756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.652878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.653139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.653415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.653679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.653832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.654010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.654277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.654638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.654869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.654995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.655137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.655433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.655756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.655904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.656013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.656327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.656698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.656839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.656973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.657280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.657547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.657835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.657959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.658097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.658427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.658743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.658868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.659000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.659298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.659588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.366 qpair failed and we were unable to recover it. 00:28:00.366 [2024-11-19 15:28:58.659874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.366 [2024-11-19 15:28:58.659976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.660143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.660454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.660722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.660864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.661011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.661303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.661585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.661878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.661999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.662145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.662427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.662729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.662878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.662985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.663267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.663560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.663868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.663964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.664135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.664415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.664685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.664861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.664973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.665261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.665508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.665779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.665895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.665984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.666320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.666597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.666760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.666889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.667191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.667422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.367 qpair failed and we were unable to recover it. 00:28:00.367 [2024-11-19 15:28:58.667763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.367 [2024-11-19 15:28:58.667854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.667880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.667981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.668248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.668529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.668756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.668880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.669009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.669265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.669552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.669845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.669975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.670160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.670428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.670715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.670862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.671008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.671254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.671486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.671686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.671818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.671947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.672218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.672467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.672740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.672856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.672947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.673215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.673462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.673712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.673870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.673996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.674095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.674120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.368 qpair failed and we were unable to recover it. 00:28:00.368 [2024-11-19 15:28:58.674236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.674333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.368 [2024-11-19 15:28:58.674359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.674457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.674581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.674607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.674733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.674832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.674859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.674980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.675215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.675495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.675795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.675928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.676049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.676330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.676626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.676864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.676987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.677139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.677379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.677614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.677862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.677990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.678170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.678447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.678720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.678884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.679018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.679225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.679472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.679756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.679893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.680039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.680313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.680550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.680781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.680890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.680981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.681221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.369 [2024-11-19 15:28:58.681468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.369 [2024-11-19 15:28:58.681588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.369 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.681711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.681829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.681855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.681970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.682217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.682454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.682722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.682871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.683023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.683279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.683551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.683797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.683936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.684096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.684346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.684567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.684833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.684989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.685088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.685306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.685596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.685812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.685969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.686101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.686385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.686634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.686854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.686976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.687093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.687329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.687573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.687825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.687968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.688074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.688350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.688609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.688787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.370 qpair failed and we were unable to recover it. 00:28:00.370 [2024-11-19 15:28:58.688898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.370 [2024-11-19 15:28:58.689020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.689178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.689468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.689669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.689835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.689923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.690230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.690462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.690772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.690919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.691017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.691238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:00.371 [2024-11-19 15:28:58.691334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691340] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:00.371 [2024-11-19 15:28:58.691359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.691508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.691718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.691832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.691922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.692168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.692443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.692700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.692860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.693012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.693268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.693563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.693841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.693962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.694084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.694312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.694610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.694861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.694987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.695131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.695420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.695676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.695830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.695951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.696033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.696059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.371 qpair failed and we were unable to recover it. 00:28:00.371 [2024-11-19 15:28:58.696191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.371 [2024-11-19 15:28:58.696283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.696309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.696405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.696526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.696552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.696646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.696736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.696762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.696924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.697190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.697395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.697632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.697870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.697981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.698070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.698301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.698545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.698769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.698916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.699012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.699251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.699525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.699798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.699947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.700098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.700384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.700608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.700782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.700881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.701134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.701432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.701651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.701907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.701993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.702018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.702113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.702237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.702263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.372 qpair failed and we were unable to recover it. 00:28:00.372 [2024-11-19 15:28:58.702385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.702478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.372 [2024-11-19 15:28:58.702503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.702590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.702685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.702721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.702811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.702909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.702933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.703018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.703247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.703523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.703749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.703894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.703993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.704221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.704495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.704769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.704894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.704995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.705237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.705473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.705719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.705840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.705985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.706194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.706404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.706665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.706834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.706938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.707174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.707427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.707639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.707879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.707997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.708095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.708312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.708524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.708796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.708904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.709025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.709121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.709145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.373 qpair failed and we were unable to recover it. 00:28:00.373 [2024-11-19 15:28:58.709264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.373 [2024-11-19 15:28:58.709387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.709411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.709502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.709596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.709620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.709746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.709872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.709898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.710031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.710276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.710512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.710752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.710906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.711028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.711264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.711499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.711711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.711854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.711976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.712212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.712500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.712804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.712975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.713086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.713322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.713533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.713783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.713950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.714100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.714372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.714567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.714891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.714988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.715137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.715403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.715603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.715838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.715948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.716041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.716159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.716184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.716305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.716388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.716413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.374 qpair failed and we were unable to recover it. 00:28:00.374 [2024-11-19 15:28:58.716535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.374 [2024-11-19 15:28:58.716650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.716674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.716799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.716912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.716941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.717064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.717264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.717495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.717791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.717901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.717991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.718245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.718459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.718740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.718849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.718942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.719210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.719460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.719725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.719869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.719983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.720208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.720495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.720775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.720886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.720970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.721212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.721428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.721630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.721873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.721986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.722134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.722390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.722598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.722861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.722976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.723001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.723093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.723180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.723205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.723326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.723448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.375 [2024-11-19 15:28:58.723473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.375 qpair failed and we were unable to recover it. 00:28:00.375 [2024-11-19 15:28:58.723566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.723667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.723698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.723823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.723923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.723948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.724071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.724300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.724572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.724778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.724895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.725016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.725226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.725492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.725710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.725830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.725924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.726137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.726358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.726646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.726892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.726989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.727109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.727349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.727580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.727841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.376 [2024-11-19 15:28:58.727951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.727975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.728072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.728342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.728572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.728819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.728936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.729062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.729277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.729512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.729720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.729861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.729991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.730088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.730113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.376 qpair failed and we were unable to recover it. 00:28:00.376 [2024-11-19 15:28:58.730230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.730316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.376 [2024-11-19 15:28:58.730341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.730426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.730550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.730575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.730667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.730771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.730797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.730917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.731141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.731390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.731609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.731842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.731955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.732084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.732290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.732562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.732839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.732952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.733046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.733278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.733508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.733715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.733859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.733989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.734205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.734441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.734644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.734784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.734886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.735136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.735375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.735617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.735767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.735872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.736017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.736042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.736162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.736285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.736310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.377 qpair failed and we were unable to recover it. 00:28:00.377 [2024-11-19 15:28:58.736412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.377 [2024-11-19 15:28:58.736498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.736522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.736668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.736811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.736837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.736982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.737252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.737488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.737775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.737895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.737993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.738262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.738470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.738727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.738846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.738961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.739204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.739411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.739618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.739842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.739993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.740081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.740320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.740514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.740755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.740895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.740989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.741207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.741511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.741770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.741884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.742003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.742278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.742510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.742778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.742920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.743012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.743132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.743158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.378 [2024-11-19 15:28:58.743261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.743353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.378 [2024-11-19 15:28:58.743377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.378 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.743522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.743625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.743649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.743778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.743892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.743916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.744021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.744260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.744519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.744757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.744867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.744956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.745207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.745443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.745668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.745907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.745999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.746149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.746392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.746640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.746787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.746911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.747155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.747376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.747613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.747816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.747918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.748047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.748313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.748600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.748835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.748949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.749069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.749307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.749541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.749756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.749868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.749989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.750078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.750103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.379 qpair failed and we were unable to recover it. 00:28:00.379 [2024-11-19 15:28:58.750196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.750315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.379 [2024-11-19 15:28:58.750341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.750459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.750552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.750577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.750704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.750825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.750849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.750949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.751203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.751405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.751640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.751792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.751887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.752145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.752347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.752587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.752805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.752950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.753031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.753258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.753522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.753737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.753877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.754021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.754259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.754468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.754729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.754843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.754968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.755228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.755453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.755752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.755867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.756009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.756202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.756502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.756781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.756924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.757033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.757123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.757148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.380 qpair failed and we were unable to recover it. 00:28:00.380 [2024-11-19 15:28:58.757270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.380 [2024-11-19 15:28:58.757413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.757438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.757558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.757641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.757666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.757762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.757884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.757909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.758001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.758240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.758455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.758652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.758981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.759132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.759340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.759547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.759862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.759973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.760070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.760311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.760524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.760791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.760911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.761001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.761234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.761467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.761704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.761852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.761946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.762164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.762403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.762596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.762952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.381 [2024-11-19 15:28:58.763066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.763148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.381 [2024-11-19 15:28:58.763161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:00.381 [2024-11-19 15:28:58.763172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.381 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.763261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.763534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.763756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.763875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.763997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.764226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.764482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.764721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.764834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.764935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.765154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.765365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.765619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.765836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.765946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.766037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.766246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.766465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.766672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.766804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.766925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.767145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.767353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.767573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.767840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.767993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.768094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.768331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.768572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.768822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.768945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.769036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.769287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.769496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.382 [2024-11-19 15:28:58.769607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.382 qpair failed and we were unable to recover it. 00:28:00.382 [2024-11-19 15:28:58.769711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.769818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.769843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.769941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.770224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.770455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.770736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.770854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.770972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.771257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.771464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.771765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.771904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.772026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.772283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.772550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.772804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.772924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.773053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.773360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.773572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.773818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.773943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.774064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.774322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.774583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.774823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.774974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.775068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.775326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.775533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.775751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.775865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.775996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.776236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.776499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.383 qpair failed and we were unable to recover it. 00:28:00.383 [2024-11-19 15:28:58.776738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.383 [2024-11-19 15:28:58.776863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.776987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.777218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.777434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.777715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.777831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.777934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.778290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.778551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.778849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.778980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.779070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.779318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.779608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.779825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.779943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.780030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.780252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.780474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.780680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.780803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.780928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.781161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.781367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.781608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.781828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.781931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.782020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.782220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.782456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.782679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.782906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.782997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.783224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.783449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.384 qpair failed and we were unable to recover it. 00:28:00.384 [2024-11-19 15:28:58.783683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.384 [2024-11-19 15:28:58.783817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.783842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.783938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.784185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.784429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.784666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.784792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.784920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.785120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.785338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.785578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.785790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.785929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.786026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.786268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.786503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.786727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.786900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.786998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.787219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.787460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.787700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.787841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.787931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.788219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.788423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.788651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.788869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.788995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.789113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.789347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.789590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.789821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.789946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.790098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.790236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.790264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.385 [2024-11-19 15:28:58.790371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.790491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.385 [2024-11-19 15:28:58.790515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.385 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.790606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.790701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.790727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.790843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.790962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.790986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.791107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.791326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.791560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.791839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.791964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.792055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.792288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.792561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.792796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.792917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.793026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.793240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.793513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.793755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.793876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.793983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.794251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.794492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.794754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.794877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.794967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.795214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.795479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.795698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.795842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.795992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.796236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.796475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.386 qpair failed and we were unable to recover it. 00:28:00.386 [2024-11-19 15:28:58.796720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.386 [2024-11-19 15:28:58.796816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.796840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.796938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.797202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.797462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.797716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.797827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.797920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.798178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.798403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.798641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.798864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.798976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.799074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.799301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.799543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.799814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.799928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.800015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.800247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.800507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.800754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.800866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.801010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.801239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.801506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.801742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.801886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.801981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.802218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.802521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.802743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.802909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.803004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.803122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.803147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.387 qpair failed and we were unable to recover it. 00:28:00.387 [2024-11-19 15:28:58.803235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.387 [2024-11-19 15:28:58.803322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.803347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.803472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.803587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.803613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.803706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.803823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.803848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.803943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.804187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.804434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.804701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.804848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.804943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.805183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.805396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.805642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.805792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.805892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.806179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.806420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.806661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.806879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.806997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.807112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.807330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.807620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.807869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.807993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.808142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.808428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.808699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.808842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.808944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.809215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.809455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.809700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.809840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.809941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.810039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.810064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.388 [2024-11-19 15:28:58.810215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.810315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.388 [2024-11-19 15:28:58.810341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.388 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.810431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.810544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.810569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.810686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.810790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.810814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.810905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.811137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.811404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.811620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.811870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.811989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.812390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.812603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.812843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.812985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.813102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.813355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.813622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.813762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.813861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.814156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.814368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.814645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.814857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.814979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.815103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.815309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.815579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.815797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.815914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.816016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.816283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.816558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.816787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.816936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.817081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.817165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.817189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.389 qpair failed and we were unable to recover it. 00:28:00.389 [2024-11-19 15:28:58.817294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.389 [2024-11-19 15:28:58.817384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.817410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.817557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.817648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.817674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.817781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.817871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.817897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.817987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.818253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.818488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.818726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.818873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.818969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.819204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.819467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.819701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.819821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.819919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.820194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.820439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.820698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.820811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.820934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.821207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.821442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.821684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.821894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.821979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.822095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.822354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.822591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.822827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.822971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.823060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.823294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.823525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.823807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.823948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.390 qpair failed and we were unable to recover it. 00:28:00.390 [2024-11-19 15:28:58.824063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.824180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.390 [2024-11-19 15:28:58.824205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.824311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.824559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.824827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.824937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.825031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.825272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.825581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.825821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.825968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.826085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.826351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.826592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.826827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.826969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.827119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.827375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.827641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.827819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.827910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.828167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.828431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.828717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.828836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.828956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.829188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.829436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.829655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.829822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.829923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.830168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.391 [2024-11-19 15:28:58.830377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.391 [2024-11-19 15:28:58.830535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.391 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.830621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.830721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.830746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.830894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.830984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.831137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.831352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.831594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.831815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.831943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.832092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.832358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.832636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.832849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.832962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.833083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.833351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.833581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.833825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.833933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.834048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.834311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.834571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.834846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.834977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.835130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.835397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.835630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.835772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.835895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.836169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.836367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.836590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.836834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.836940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.837086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.837221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.837247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.837367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.837454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.837480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.392 qpair failed and we were unable to recover it. 00:28:00.392 [2024-11-19 15:28:58.837599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.392 [2024-11-19 15:28:58.837687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.837718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.837827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.837933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.837958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.838080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.838307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.838632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.838852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.838962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.839060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.839316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.839556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.839848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.839994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.840085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.840299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.840526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.840776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.840881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.840975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.841217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.841477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.841701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.841819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.841949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.842250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.842453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.842697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.842815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.842932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.843131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.843376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.843614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.843840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.843954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.844120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.844265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.844290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.393 [2024-11-19 15:28:58.844379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.844474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.393 [2024-11-19 15:28:58.844505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.393 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.844602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.844789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.844815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.844939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.845208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.845468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.845741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.845867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.845953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.846163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.846420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.846629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.846892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.846996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.847159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.847369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.847635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.847838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.847979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.848071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.848352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.848594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.848804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.848955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.849089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.849335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.849580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.849822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.849934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.850021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.850239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.850512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.850785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.850909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.850999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.851144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.851169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.851296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.851418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.851443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.394 qpair failed and we were unable to recover it. 00:28:00.394 [2024-11-19 15:28:58.851576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.394 [2024-11-19 15:28:58.851708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.851734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.851832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.851924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.851949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.852073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.852301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.852510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.852792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.852930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.853053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.853309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.853508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.853717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.853842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.853943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.854142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.854414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.854737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.854854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.854943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.855182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.855412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.855673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.855808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.855903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.856172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.856405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.856613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.856877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.856998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.857111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.857342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.395 [2024-11-19 15:28:58.857599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.395 [2024-11-19 15:28:58.857745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.395 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.857865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.858195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.858418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.858700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.858868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.858973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.859224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.859449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.859702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.859845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.859964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.860206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.860432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.860672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.860829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.860917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.861203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.861437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.861673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.861822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.861919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.862156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.862395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.862601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.862823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.862933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.863028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.863282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.863499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.863722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.863896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.863997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.864219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.864476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.396 qpair failed and we were unable to recover it. 00:28:00.396 [2024-11-19 15:28:58.864719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.396 [2024-11-19 15:28:58.864819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.864846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.864965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.865237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.865475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.865673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.865885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.865993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.866080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.866346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.866560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.866765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.866882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.866977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.867215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.867462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.867685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.867812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.867934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.868166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.868368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.868598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.868812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.868931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.869026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.869250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.869536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.869747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.869861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.869945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.870202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.870434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.870638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.870786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.870887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.871003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.871028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.397 [2024-11-19 15:28:58.871148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.871240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.397 [2024-11-19 15:28:58.871265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.397 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.871388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.871624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.871871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.871980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.872071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.872334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.872576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.872838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.872965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.873098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.873301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.873528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.873751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.873882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.873976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.874209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.874470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.874735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.874863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.874947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.875187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.875418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.875625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.875762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.875906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.876126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.876388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.876625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.876865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.876981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.877068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.877259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877347] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:00.398 [2024-11-19 15:28:58.877366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.877457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:00.398 [2024-11-19 15:28:58.877506] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:00.398 [2024-11-19 15:28:58.877521] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:00.398 [2024-11-19 15:28:58.877544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.877655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.398 [2024-11-19 15:28:58.877704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:00.398 [2024-11-19 15:28:58.877776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.398 qpair failed and we were unable to recover it. 00:28:00.398 [2024-11-19 15:28:58.877748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:00.398 [2024-11-19 15:28:58.877771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:00.398 [2024-11-19 15:28:58.877775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:00.398 [2024-11-19 15:28:58.877903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.877997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.878026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.878123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.878212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.878238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.878353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.881704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.881741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.881890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.882200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.882460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.882731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.882864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.882970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.883237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.883495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.883773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.883935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.884039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.884297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.884539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.884767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.884937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.885038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.885362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.885609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.885897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.885996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.886148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.886373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.886669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.886839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.886962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.887252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.887552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.887849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.887995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.888117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.888384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.888659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.888840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.888968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.889095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.889132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.889254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.889398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.399 [2024-11-19 15:28:58.889435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.399 qpair failed and we were unable to recover it. 00:28:00.399 [2024-11-19 15:28:58.889564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.889703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.889741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.889867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.889972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.890132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.890402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.890717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.890853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.890953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.891192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.891464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.400 [2024-11-19 15:28:58.891583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.400 qpair failed and we were unable to recover it. 00:28:00.400 [2024-11-19 15:28:58.891674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.891790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.891815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.685 qpair failed and we were unable to recover it. 00:28:00.685 [2024-11-19 15:28:58.891902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.685 qpair failed and we were unable to recover it. 00:28:00.685 [2024-11-19 15:28:58.892148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.685 qpair failed and we were unable to recover it. 00:28:00.685 [2024-11-19 15:28:58.892410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.685 [2024-11-19 15:28:58.892530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.892628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.892751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.892777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.892877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.892995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.893145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.893397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.893613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.893828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.893956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.894093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.894321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.894533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.894764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.894914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.895006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.895211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.895434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.895684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.895809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.895929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.896158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.896461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.896703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.896827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.896922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.897140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.897424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.897637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.897745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.897868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.898113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.898363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.686 qpair failed and we were unable to recover it. 00:28:00.686 [2024-11-19 15:28:58.898565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.686 [2024-11-19 15:28:58.898649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.898674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.898768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.898880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.898905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.899025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.899228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.899430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.899700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.899823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.899915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.900118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.900315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.900524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.900792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.900915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.900997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.901207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.901459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.901716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.901840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.901962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.902182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.902425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.902656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.902868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.902971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.903087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.903351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.903546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.903818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.903977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.904073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.904292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.904536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.904741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.904848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.687 qpair failed and we were unable to recover it. 00:28:00.687 [2024-11-19 15:28:58.904972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.905094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.687 [2024-11-19 15:28:58.905120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.905225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.905458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.905703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.905828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.905929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.906191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.906454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.906721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.906828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.906925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.907165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.907388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.907598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.907818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.907954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.908054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.908260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.908477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.908735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.908877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.908976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.909219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.909509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.909739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.909854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.909945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.910153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.910419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.910652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.688 [2024-11-19 15:28:58.910866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.688 [2024-11-19 15:28:58.910983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.688 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.911087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.911348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.911570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.911835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.911962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.912056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.912306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.912574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.912857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.912971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.913065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.913364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.913612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.913844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.913960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.914049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.914379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.914629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.914776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.914906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.915169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.915411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.915682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.915806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.915923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.916179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.916384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.916621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.916828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.916948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.917076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.917310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.917552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.917773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.689 [2024-11-19 15:28:58.917895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.689 qpair failed and we were unable to recover it. 00:28:00.689 [2024-11-19 15:28:58.918007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.918247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.918494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.918755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.918876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.918972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.919172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.919385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.919636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.919853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.919985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.920113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.920322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.920536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.920833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.920943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.921037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.921273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.921494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.921720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.921835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.921936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.922146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.690 [2024-11-19 15:28:58.922420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.690 [2024-11-19 15:28:58.922537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.690 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.922660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.922756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.922782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.922902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.923196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.923411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.923632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.923864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.923971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.924099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.924341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.924558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.924864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.924989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.925082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.925285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.925555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.925820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.925931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.926034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.926246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.926463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.926668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.926796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.926919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.927159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.927368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.927575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.927830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.927967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.928059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.928255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.928492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.928770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.928882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.928975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.929093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.929119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.691 qpair failed and we were unable to recover it. 00:28:00.691 [2024-11-19 15:28:58.929251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.691 [2024-11-19 15:28:58.929346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.929371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.929469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.929587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.929613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.929703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.929827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.929852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.929976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.930197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.930471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.930686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.930899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.930993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.931019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.931139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.933704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.933736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.933874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.934139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.934401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.934654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.934898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.934994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.935149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.935385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.935668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.935900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.935988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.936146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.936421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.936632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.936874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.936975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.937089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.937362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.937610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.937857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.937983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.939702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.939816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.939856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.939970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.940088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.940125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.940268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.940376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.692 [2024-11-19 15:28:58.940413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.692 qpair failed and we were unable to recover it. 00:28:00.692 [2024-11-19 15:28:58.940565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.940736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.940773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.940892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.941218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.941512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.941815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.941951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.942088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.942355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.942672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.942829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.942941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.943177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.943409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.943708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.943864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.943969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.944218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.944468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.944729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.944866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.944983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.945256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.945487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.945750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.945906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.946016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.946263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.946484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.946676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.946803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.946892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.947114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.947343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.947613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.947813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.693 [2024-11-19 15:28:58.947934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.693 qpair failed and we were unable to recover it. 00:28:00.693 [2024-11-19 15:28:58.948023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.948292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.948499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.948765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.948882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.948978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.949186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.949395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.949633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.949860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.949979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.950120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.950352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.950553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.950807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.950936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.951029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.951300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.951505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.951724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.951841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.951990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.952206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.952414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.952644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.952895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.952978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.953130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.953372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.953570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.953868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.953983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.954336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.694 [2024-11-19 15:28:58.954580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.694 [2024-11-19 15:28:58.954713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.694 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.954797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.954914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.954940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.955032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.955259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.955453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.955642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.955857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.955967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.956055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.956289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.956495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.956729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.956847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.956929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.957147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.957342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.957591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.957833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.957946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.958038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.958128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.958153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.695 qpair failed and we were unable to recover it. 00:28:00.695 [2024-11-19 15:28:58.958245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.695 [2024-11-19 15:28:58.958364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.958389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.958542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.958622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.958647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.958768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.958863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.958887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.958969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.959208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.959460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.959657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.959785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.959875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.960121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.960348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.960546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.960794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.960910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.961012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.961206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.961415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.961667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.961867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.961982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.962096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.962351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.962583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.962789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.962927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.963045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.963257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.963476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.963683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.963907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.963995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.964136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.964334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.696 qpair failed and we were unable to recover it. 00:28:00.696 [2024-11-19 15:28:58.964538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.696 [2024-11-19 15:28:58.964657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.964682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.964797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.964887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.964913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.965014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.965228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.965427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.965629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.965871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.965992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.966110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.966345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.966587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.966801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.966914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.967001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.967210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.967416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.967672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.967876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.967969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.968101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.968342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.968569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.968838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.968993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.969142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.969331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.969544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.969763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.969881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.969980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.970098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.970123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.970239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.970359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.697 [2024-11-19 15:28:58.970383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.697 qpair failed and we were unable to recover it. 00:28:00.697 [2024-11-19 15:28:58.970505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.970597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.970621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.970717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.970802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.970827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.970925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.971198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.971431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.971635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.971873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.971991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.972085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.972297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.972576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.972811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.972922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.973024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.973239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.973430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.973653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.973874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.973996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.974147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.974374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.974601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.974879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.974991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.975110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.975388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.975591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.975881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.975992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.976085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.976298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.976598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.976832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.976946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.698 qpair failed and we were unable to recover it. 00:28:00.698 [2024-11-19 15:28:58.977047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.698 [2024-11-19 15:28:58.977169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.977308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.977539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.977813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.977938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.978032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.978244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.978503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.978743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.978856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.978948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.979177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.979439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.979657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.979884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.979999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.980121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.980363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.980604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.980816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.980931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.981025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.981285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.981509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.981742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.981867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.981965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.982176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.982432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.982659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.982845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.699 [2024-11-19 15:28:58.982937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.983033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.699 [2024-11-19 15:28:58.983058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.699 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.983188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.983391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.983676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.983907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.983994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.984115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.984381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.984611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.984830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.984948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.985085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.985330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.985561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.985782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.985902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.985996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.986268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.986473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.986705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.986823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.986921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.987214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.987452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.987711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.987830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.987913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.988026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.988051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.700 [2024-11-19 15:28:58.988132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.988243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.700 [2024-11-19 15:28:58.988268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.700 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.988393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.988626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.988834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.988977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.989099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.989324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.989523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.989743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.989938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.990030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.990272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.990535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.990803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.990926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.991015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.991261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.991492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.991698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.991903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.991991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.992110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.992399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.992637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.992863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.992978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.993098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.993302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.993593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.993857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.993971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.994091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.994301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.994542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.701 [2024-11-19 15:28:58.994789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.994987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.701 [2024-11-19 15:28:58.995012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.701 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.995102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.995299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.995572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.995786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.995892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.996011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.996217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.996441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.996670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.996798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.997142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.997456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.997723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.997836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.997933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.998250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.998499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.998703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.998847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.998965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.999200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.999407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.999673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:58.999898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:58.999983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:59.000104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:59.000329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:59.000568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:59.000825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.000942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.702 qpair failed and we were unable to recover it. 00:28:00.702 [2024-11-19 15:28:59.001067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.702 [2024-11-19 15:28:59.001153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.001271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.001559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.001790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.001910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.002033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.002240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.002462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.002701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.002908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.002989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.003134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.003341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.003560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.003784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.003923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.004025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.004242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.004500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.004743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.004858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.004941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.005177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.005426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.005696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.005817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.005932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.006198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.006424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.006635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.006877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.006994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.007088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.007314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.007575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.703 [2024-11-19 15:28:59.007727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.703 qpair failed and we were unable to recover it. 00:28:00.703 [2024-11-19 15:28:59.007815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.007906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.007931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.008019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.008286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.008493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.008767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.008898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.008982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.009242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.009497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.009769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.009876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.009966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.010242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.010475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.010733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.010866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.010986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.011199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.011540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.011778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.011889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.012006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.012275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.012474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.012677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.012826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.012920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.013124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.013329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.013566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.013838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.013984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.014104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.014344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.704 qpair failed and we were unable to recover it. 00:28:00.704 [2024-11-19 15:28:59.014550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.704 [2024-11-19 15:28:59.014638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.014665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.014787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.014877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.014903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.014987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.015256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.015503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.015733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.015848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.015959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.016171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.016382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.016624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.016862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.016973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.017109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.017351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.017581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.017816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.017956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.018049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.018300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.018581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.018794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.018915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.019009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.019247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.019452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.019697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.019867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.019960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.020053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.020079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.705 qpair failed and we were unable to recover it. 00:28:00.705 [2024-11-19 15:28:59.020174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.020267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.705 [2024-11-19 15:28:59.020294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.020387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.020585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.020846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.020993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.021126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.021387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.021594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.021842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.021973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.022089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.022361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.022621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.022829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.022952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.023038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.023250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.023477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.023709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.023833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.023940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.024170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.024402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.024604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.024808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.024928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.025017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.025255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.025528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.025742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.025860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.025958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.026193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.026429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.026633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.706 [2024-11-19 15:28:59.026772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.706 qpair failed and we were unable to recover it. 00:28:00.706 [2024-11-19 15:28:59.026860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.026970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.026995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.027077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.027277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.027509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.027748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.027859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.027978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.028268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.028513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.028780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.028897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.029025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.029266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.029470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.029699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.029814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.029911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.030180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.030469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.030716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.030839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.030955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.031191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.031401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.031668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.031890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.031982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.032098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.032349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.032560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.032815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.032956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.033042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.033186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.033211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.033353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.033474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.033501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.707 qpair failed and we were unable to recover it. 00:28:00.707 [2024-11-19 15:28:59.033636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.707 [2024-11-19 15:28:59.033778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.033803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.033895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.034163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.034370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.034605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.034860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.034974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.035098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.035313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.035553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.035789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.035902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.035997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.036227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.036499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.036729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.036843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.036941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.037173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.037446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.037648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.037887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.037976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.038099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.038339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.038578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.038796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.038940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.039031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.039290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.039557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.039812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.039954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.040074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.040161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.040187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.040277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.040397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.708 [2024-11-19 15:28:59.040422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.708 qpair failed and we were unable to recover it. 00:28:00.708 [2024-11-19 15:28:59.040509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.040626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.040652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.040794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.040882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.040907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.041028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.041253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.041537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.041745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.041860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.041947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.042185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.042383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.042648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.042796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.042943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.043172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.043407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.043598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.043819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.043965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.044049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.044283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.044496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.044725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.044843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.044934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.045144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.045402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.045635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.045835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.045955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.046068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.046306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.709 qpair failed and we were unable to recover it. 00:28:00.709 [2024-11-19 15:28:59.046537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.709 [2024-11-19 15:28:59.046653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.046767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.046887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.046912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.046999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.047232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.047458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.047654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.047870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.047992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.048102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.048333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.048569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.048815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.048958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.049066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.049264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.049523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.049723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.049868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.049994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.050202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.050417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.050662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.050911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.050998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.051119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.051351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.051592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.051807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.051926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.052016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.052282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.052544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.710 [2024-11-19 15:28:59.052657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.710 qpair failed and we were unable to recover it. 00:28:00.710 [2024-11-19 15:28:59.052810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.052903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.052929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.053022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.053216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.053442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.053637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.053874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.053975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.054158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.054387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.054613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.054873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.054985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.055147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.055354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.055599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.055823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.055959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.056044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.056278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.056511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.056720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.056865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.056979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.057244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.057488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.057699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.057846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.057942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.058150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.058356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.058587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.058780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.058871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.059129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.711 qpair failed and we were unable to recover it. 00:28:00.711 [2024-11-19 15:28:59.059364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.711 [2024-11-19 15:28:59.059481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.059567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.059662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.059693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.059809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.059923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.059949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.060039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.060258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.060465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.060752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.060881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.060978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.061220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.061455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.061700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.061846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.061941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.062181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.062419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.062657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.062863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.062979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.063107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.063322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.063524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.063766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.063874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.064009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.064245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.064445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.064666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.064788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.064937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.065143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.065358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.065595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.065818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.712 [2024-11-19 15:28:59.065932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.712 qpair failed and we were unable to recover it. 00:28:00.712 [2024-11-19 15:28:59.066033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.066265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.066465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.066751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.066870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.066951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.067186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.067406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.067640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.067858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.067981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.068105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.068347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.068586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.068799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.068913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.069017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.069276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.069504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.069718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.069830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.069919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.070138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.070351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.070556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.070818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.070963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.071069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.071303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.071545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.071769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.071885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.071978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.072244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.713 qpair failed and we were unable to recover it. 00:28:00.713 [2024-11-19 15:28:59.072460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.713 [2024-11-19 15:28:59.072634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.072774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.072861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.072886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.073016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.073246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.073441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.073656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.073873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.073987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.074079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.074290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.074556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.074865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.074983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.075108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.075346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.075584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.075835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.075978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.076095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.076294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.076515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.076732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.076842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.076961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.077190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.077421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.077695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.077822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.077919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.078167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.078368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.714 [2024-11-19 15:28:59.078476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.714 qpair failed and we were unable to recover it. 00:28:00.714 [2024-11-19 15:28:59.078561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.078654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.078680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.078803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.078897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.078924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.079027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.079270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.079513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.079726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.079848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.079971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.080203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.080454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.080657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.080776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.080863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.081131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.081361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.081590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.081808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.081950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.082077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.082303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.082543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.082752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.082858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.082972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.083166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.083437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.083667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.083833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.083956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.084227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.084508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.084756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.084872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.084967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.085086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.085112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.715 qpair failed and we were unable to recover it. 00:28:00.715 [2024-11-19 15:28:59.085204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.715 [2024-11-19 15:28:59.085319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.085437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.085668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.085887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.085999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.086089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.086295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.086521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.086760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.086876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.086974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.087182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.087373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.087674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.087893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.087985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.088106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.088363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.088614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.088761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.088854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.089125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.089389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.089587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.089818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.089934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.090054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.090312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.090540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.090740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.090864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.090954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.091197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.091393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.716 [2024-11-19 15:28:59.091597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.716 [2024-11-19 15:28:59.091707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.716 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.091795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.091875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.091900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.091981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.092215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.092442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.092643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.092782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.092896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.093129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.093333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.093628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.093840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.093985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.094069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.094302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.094519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.094759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.094870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.094962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.095225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.095432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.095638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.095887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.095979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.096093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.096334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.096557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.096808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.096957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.097073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.097262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.097484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.097737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.097846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.097962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.098076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.098108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.717 qpair failed and we were unable to recover it. 00:28:00.717 [2024-11-19 15:28:59.098232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.717 [2024-11-19 15:28:59.098317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.098342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.098460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.098552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.098578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.098676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.098774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.098800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.098924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.099140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.099360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.099568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.099811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.099953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.100040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.100284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.100509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.100718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.100833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.100925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.101134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.101367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.101588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.101808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.101948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.102036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.102241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.102503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.102721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.102864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.102948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.103158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.103382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.103588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.103812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.103959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.104046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.104249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.718 [2024-11-19 15:28:59.104512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.718 [2024-11-19 15:28:59.104665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.718 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.104813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.104896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.104922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.105033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.105263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.105487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.105726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.105845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.105949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.106205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.106425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.106650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.106858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.106977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.107095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.107359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.107578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.107839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.107959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.108110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.108312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.108571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.108817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.108941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.109028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.109255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.109457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.109715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.109837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.109958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.110167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.719 [2024-11-19 15:28:59.110369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.719 [2024-11-19 15:28:59.110477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.719 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.110599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.110691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.110717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.110810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.110899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.110924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.111023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.111278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.111479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.111682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.111805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.111900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.112137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.112363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.112592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.112866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.112985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.113073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.113299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.113531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.113770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.113880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.113965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.114169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.114403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.114613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.114824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.114967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.115060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.115254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.115487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.115712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.115824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.115920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.116178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.116429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.116685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.116827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.720 qpair failed and we were unable to recover it. 00:28:00.720 [2024-11-19 15:28:59.116947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.720 [2024-11-19 15:28:59.117037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.117151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.117380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.117611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.117815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.117968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.118085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.118284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.118497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.118800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.118919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.119033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.119251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.119448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.119661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.119791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.119910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.120147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.120349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.120577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.120829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.120970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.121098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.121310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.121581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.121801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.121944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.122047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.122277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.122534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.122759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.122873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.122962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.123232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.721 [2024-11-19 15:28:59.123424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.721 [2024-11-19 15:28:59.123570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.721 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.123656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.123759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.123784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.123874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.123995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.124115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.124346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.124541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.124763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.124869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.124992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.125187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.125439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.125640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.125778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.125928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.126169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.126406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.126646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.126862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.126980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.127071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.127271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.127507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.127704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.127904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.127992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.128139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.128375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.128569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.128828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.128939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.129035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.129273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.129500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.129729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.129849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.722 qpair failed and we were unable to recover it. 00:28:00.722 [2024-11-19 15:28:59.129937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.722 [2024-11-19 15:28:59.130028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.130172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.130373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.130575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.130798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.130943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.131046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.131262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.131459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.131695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.131811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.131936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.132172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.132396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.132628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.132891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.132976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.133131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.133371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.133632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.133850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.133979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.134105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.134334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.134566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.134803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.134924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.135057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.135288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.135520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.723 qpair failed and we were unable to recover it. 00:28:00.723 [2024-11-19 15:28:59.135758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.723 [2024-11-19 15:28:59.135850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.135875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.135963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.136212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.136521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.136762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.136939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.137047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.137280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.137542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.137751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.137870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.137963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.138196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.138399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.138698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.138809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.138920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.139130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.139362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.139554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.139786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.139908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.140029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.140263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.140463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.140676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.140817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.140916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.141143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.141369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.141597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.141809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.141925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.142024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.142109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.142134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.724 qpair failed and we were unable to recover it. 00:28:00.724 [2024-11-19 15:28:59.142255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.724 [2024-11-19 15:28:59.142378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.142403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.142490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.142604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.142628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.142725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.142816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.142841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.142931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.143144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.143375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.143634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.143849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.143956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.144086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.144292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.144497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.144725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.144868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.144960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.145218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.145425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.145633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.145770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.145919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.146164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.146417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.146696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.146899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.146992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.147134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.147366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.147607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.147852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.147970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.148163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.148363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.148596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.148754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.725 [2024-11-19 15:28:59.148876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.149003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.725 [2024-11-19 15:28:59.149029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.725 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.149129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.149334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.149547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.149750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.149861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.149978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.150206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.150421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.150621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.150807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.150919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.151111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.151343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.151568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.151784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.151897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.151984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.152185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.152393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.152583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.152794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.152908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.153028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.153280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.153479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.153682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.153889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.153977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.154097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.154312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.154496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.154707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.154818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.154934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.155054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.726 [2024-11-19 15:28:59.155079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.726 qpair failed and we were unable to recover it. 00:28:00.726 [2024-11-19 15:28:59.155197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.155433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.155634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.155851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.155964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.156083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.156315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.156521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.156726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.156871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.156984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.157186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.157452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.157708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.157820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.157911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.158187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.158415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.158647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.158881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.158990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.159078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.159301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.159523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.159728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.159856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.159956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.160166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.160362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.160600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.727 [2024-11-19 15:28:59.160853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.727 [2024-11-19 15:28:59.160969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.727 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.161091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.161323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.161552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.161764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.161879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.161963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.162202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.162404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.162622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.162870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.162986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.163091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.163359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.163566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.163838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.163953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.164042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.164308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.164512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.164723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.164873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.164996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.165257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.165469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.165728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.165848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.165943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.166193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.166400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.166598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.166816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.728 [2024-11-19 15:28:59.166933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.728 qpair failed and we were unable to recover it. 00:28:00.728 [2024-11-19 15:28:59.167023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.167247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.167499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.167713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.167855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.167957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.168201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.168445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.168635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.168850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.168971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.169092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.169465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.169709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.169829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.169920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.170194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.170397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.170603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.170846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.170993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.171087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.171298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.171561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.171764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.171878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.171979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.172220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.172431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.172707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.172819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.172918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.173155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.173394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.173648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.173832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.173928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.174026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.174052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.729 [2024-11-19 15:28:59.174171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.174262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.729 [2024-11-19 15:28:59.174289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.729 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.174377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.174642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.174867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.174985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.175078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.175330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.175532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.175773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.175892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.176021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.176257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.176481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.176687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.176826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.176951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.177152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.177361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.177556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.177801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.177926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.178054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.178257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.178485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.178725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.178839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.178935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.179188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.179437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.179668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.179820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.179939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.180031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.180056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.180148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.180230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.730 [2024-11-19 15:28:59.180255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.730 qpair failed and we were unable to recover it. 00:28:00.730 [2024-11-19 15:28:59.180348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.180578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.180827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.180944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.181068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.181269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.181509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.181720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.181860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.181948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.182169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.182368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.182603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.182866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.182978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.183070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.183281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.183515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.183812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.183933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.184070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.184286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.184553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.184798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.184919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.185024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.185303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.185495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.185740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.185864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.186002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.186238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.186491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.186725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.186862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.186973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.187181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.187382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.731 [2024-11-19 15:28:59.187524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.731 qpair failed and we were unable to recover it. 00:28:00.731 [2024-11-19 15:28:59.187614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.187737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.187763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.187851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.187972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.188098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.188362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.188569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.188795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.188910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.189006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.189243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.189465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.189723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.189852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.189969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.190205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.190437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.190634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.190759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.190888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.191138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.191364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.191569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.191836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.191949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.192048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.192271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.192508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.192775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.192890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.192981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.193210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.193414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.193643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.732 [2024-11-19 15:28:59.193762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.732 qpair failed and we were unable to recover it. 00:28:00.732 [2024-11-19 15:28:59.193850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.193969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.193994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.194112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.194380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.194604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.194848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.194968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.195090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.195339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.195544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.195820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.195942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.196077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.196320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.196538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.196787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.196908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.197021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.197291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.197516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.197771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.197910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.197999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.198206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.198471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.733 [2024-11-19 15:28:59.198675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.733 [2024-11-19 15:28:59.198826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.733 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.198922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.199158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.199423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.199663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.199881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.199997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.200149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.200362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.200627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.200873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.200984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.201068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.201329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.201566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.201816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.201934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.202024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.202286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.202490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.202737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.202897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.203021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.203249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.203483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.203685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.203805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.203889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.204130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.204363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.204559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.204791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.204912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.205005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.205097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.205123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.205211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.205329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.205354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.734 qpair failed and we were unable to recover it. 00:28:00.734 [2024-11-19 15:28:59.205439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.734 [2024-11-19 15:28:59.205551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.205575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.205673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.205808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.205834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.205925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.206165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.206378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.206613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.206851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.206961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.207090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.207384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.207621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.207825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.207964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.208056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.208336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.208597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.208860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.208981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.209081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.209330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.209546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.209826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.209977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.210122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.210348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.210851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.210993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.211079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.211283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.211485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.211725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.211864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.211958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.212053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.212078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.735 [2024-11-19 15:28:59.212172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.212302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.735 [2024-11-19 15:28:59.212327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.735 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.212421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.212511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.212536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.212661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.212761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.212787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.212882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.212976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.213090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.213293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.213500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.213747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.213857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.213942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.214165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.214393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.214626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.214837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.214948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.215093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.215327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.215570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.215783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.215921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.216013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.216277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.216481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.216683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.216906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.216993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.217106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.217343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.217559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.217817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.217936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.218054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.218281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.218487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.736 qpair failed and we were unable to recover it. 00:28:00.736 [2024-11-19 15:28:59.218705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.736 [2024-11-19 15:28:59.218801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.218826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.218946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.219156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.219369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.219600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.219809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.219935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.220024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.220259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.220490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.220709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.220818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.220920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.221009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.221035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:00.737 [2024-11-19 15:28:59.221119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.221205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:00.737 [2024-11-19 15:28:59.221235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:00.737 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.221353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.221569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.221774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.221882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.221962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.222166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.222412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.222617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.222867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.222990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.223103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.223317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.223600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.223805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.223955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.224048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.224147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.224172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.224297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.224388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.003 [2024-11-19 15:28:59.224413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.003 qpair failed and we were unable to recover it. 00:28:01.003 [2024-11-19 15:28:59.224554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.224648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.224673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.224770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.224865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.224890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.224985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.225217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.225419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.225626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.225840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.225954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.226041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.226249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.226461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.226698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.226907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.226995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.227108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.227314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.227521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.227791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.227918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.228011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.228236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.228484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.228718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.228857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.228953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.229160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.229423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.229672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.229819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.229939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.230140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.230423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.230712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.230834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.004 qpair failed and we were unable to recover it. 00:28:01.004 [2024-11-19 15:28:59.230929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.004 [2024-11-19 15:28:59.231020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.231172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.231374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.231576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.231823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.231937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.232026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.232228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.232486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.232698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.232820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.232918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.233177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.233377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.233578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.233822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.233972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.234093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.234334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.234570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.234778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.234921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.235016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.235282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.235549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.235792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.235903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.236027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.236246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.236452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.236700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.236819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.236907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.237164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8098000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.005 [2024-11-19 15:28:59.237413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.005 [2024-11-19 15:28:59.237535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.005 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.237626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.237718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.237744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.237858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.237946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.237970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.238058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.238300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.238538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.238814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.238925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.239016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.239209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.239405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.239660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.239829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.239924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.240162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.240375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.240609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.240838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.240947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.241041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.241288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.241491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.241728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.241845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.241966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.242199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.242401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.242636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.242880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.242978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.243099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.243340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.243579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.243846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.243960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.006 qpair failed and we were unable to recover it. 00:28:01.006 [2024-11-19 15:28:59.244055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.006 [2024-11-19 15:28:59.244142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.244285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.244532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.244737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.244860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.244953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.245216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.245446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.245686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.245904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.245993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.246114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.246343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.246575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.246851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.246963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.247051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.247249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.247506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.247789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.247896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.248044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.248301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.248533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.248742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.248861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.248961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.249161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.249380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.249571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.249785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.249919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.250041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.250124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.250148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.250266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.250351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.250376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.007 qpair failed and we were unable to recover it. 00:28:01.007 [2024-11-19 15:28:59.250475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.007 [2024-11-19 15:28:59.250589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.250614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.250730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.250827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.250853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.250937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.251133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.251379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.251609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.251845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.251953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.252066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.252310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.252580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.252787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.252925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.253017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.253280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.253515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.253772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.253892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.253986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.254230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.254455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.254704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.254858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.254950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.255185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.255399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.255658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.255867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.255989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.256085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.256171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.256197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.008 qpair failed and we were unable to recover it. 00:28:01.008 [2024-11-19 15:28:59.256291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.008 [2024-11-19 15:28:59.256379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.256403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.256499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.256584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.256610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.256754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.256850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.256875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.257001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.257192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.257418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.257667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.257792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.257918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.258188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.258459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.258681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.258804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.258892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.259118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.259322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.259549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.259815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.259930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.260050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.260257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.260464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.260704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.260857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.260940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.261137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.261415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.261625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.261854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.261963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.262086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.262318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.262552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.009 [2024-11-19 15:28:59.262839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.009 [2024-11-19 15:28:59.262956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.009 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.263082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.263271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.263480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.263711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.263860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.263944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.264143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.264373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.264582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.264845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.264955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.265100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.265344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.265540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.265755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.265868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.265962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.266195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.266423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.266609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.266845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.266958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.267067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.267295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.267503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.267741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.267916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.268004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.268238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.268502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.268703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.268819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.268911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.269000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.269025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.269146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.269279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.269305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.010 qpair failed and we were unable to recover it. 00:28:01.010 [2024-11-19 15:28:59.269429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.010 [2024-11-19 15:28:59.269515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.269540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.269658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.269784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.269809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.269937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.270227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.270430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.270662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.270790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.270882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.271138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.271343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.271561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.271807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.271924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.272011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.272221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.272420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.272701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.272854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.272949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.273183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.273379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.273610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.273837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.273954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.274041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.274276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.274500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.274724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.274865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.274992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.275205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.275436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.275631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.011 qpair failed and we were unable to recover it. 00:28:01.011 [2024-11-19 15:28:59.275834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.011 [2024-11-19 15:28:59.275979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.276068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.276330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.276531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.276745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.276858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.276952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.277185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.277384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.277618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.277807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.277947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.278067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.278295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.278518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.278819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.278927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.279049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.279284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.279488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.279715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.279831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.279954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.280186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.280384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.280582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.280798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.280944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.281055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.281284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.281521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.012 [2024-11-19 15:28:59.281632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-11-19 15:28:59.281729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.281816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.281840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.281963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.282198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.282432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.282666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.282895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.282998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.283091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.283293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.283555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.283801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.283918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.284012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.284245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.284614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.284835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.284948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.285035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.285267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.285478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.285708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.285845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.285963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.286185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.286381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.286606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.286836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.286954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.287043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.287276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.287481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.287713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.287862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-11-19 15:28:59.287955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.288038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.013 [2024-11-19 15:28:59.288062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.288158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.288423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.288648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.288851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.288966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.289054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.289281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.289501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.289732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.289843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.289959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.290234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.290430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.290666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.290784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.290908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.291140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.291363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.291580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.291846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.291959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.292043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.292267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.292470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.292729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.292852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-11-19 15:28:59.292939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.293025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.014 [2024-11-19 15:28:59.293051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.293142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.293340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.293565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.293822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.293933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.294059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.294263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.294514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.294768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.294910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.295027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.295248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.295483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.295720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.295830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.295919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.296148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.296377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.296624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.296832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.296947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.297044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.297262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.297529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.297739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.297883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.297975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.298174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.298377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.298607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.298812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.298957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.299077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.299170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.299196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.015 [2024-11-19 15:28:59.299316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.015 [2024-11-19 15:28:59.299457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.015 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.299575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.299697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.299722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.299821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.299946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.299971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.300099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.300295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.300499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.300758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.300873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.300962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.301230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.301423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.301684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.301831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.301949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.302162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.302391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.302588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.302877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.302989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.303094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.303297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.303545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.303776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.303916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.304036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.304232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.304460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.304662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.304830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.304917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.305114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.305356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.305577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.305824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.305941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.016 qpair failed and we were unable to recover it. 00:28:01.016 [2024-11-19 15:28:59.306066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.016 [2024-11-19 15:28:59.306156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.306270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.306565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.306781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.306920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.307006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.307253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.307502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.307776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.307879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.307996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.308230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.308474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.308727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.308841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.308960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.309203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.309449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.309648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.309827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.309928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.310156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.310378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.310618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.310874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.310979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.311076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.311307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.311525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.017 qpair failed and we were unable to recover it. 00:28:01.017 [2024-11-19 15:28:59.311793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.017 [2024-11-19 15:28:59.311933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.312052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.312294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.312529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.312735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.312847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.312945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.313176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f80a0000b90 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.313402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.313637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.313838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.313984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.314072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.314278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.314514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.314725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.314875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.314996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.315225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.315431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.315722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.315827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.315918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.316145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.316365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.316578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.316845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.316962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.317055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.317297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.317496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.317749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.317857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.317938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.318032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.318057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 [2024-11-19 15:28:59.318144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.318260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.318284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf85cb0 with addr=10.0.0.2, port=4420 00:28:01.018 qpair failed and we were unable to recover it. 00:28:01.018 A controller has encountered a failure and is being reset. 00:28:01.018 [2024-11-19 15:28:59.318426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.018 [2024-11-19 15:28:59.318529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.318563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.318653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.318751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.318778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.318861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.318959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.318985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.319113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.319315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.319528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.319729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.319845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.319934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.320137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.320374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.320581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.320802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.320914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8094000b90 with addr=10.0.0.2, port=4420 00:28:01.019 qpair failed and we were unable to recover it. 00:28:01.019 [2024-11-19 15:28:59.321063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.321195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:01.019 [2024-11-19 15:28:59.321222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf93600 with addr=10.0.0.2, port=4420 00:28:01.019 [2024-11-19 15:28:59.321239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf93600 is same with the state(5) to be set 00:28:01.019 [2024-11-19 15:28:59.321267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf93600 (9): Bad file descriptor 00:28:01.019 [2024-11-19 15:28:59.321285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:01.019 [2024-11-19 15:28:59.321298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:01.019 [2024-11-19 15:28:59.321314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:01.019 Unable to reset the controller. 00:28:01.277 15:28:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:01.277 15:28:59 -- common/autotest_common.sh@862 -- # return 0 00:28:01.277 15:28:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:01.277 15:28:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:01.277 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.277 15:28:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:01.277 15:28:59 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:01.277 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.277 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.277 Malloc0 00:28:01.277 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.277 15:28:59 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:01.277 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.277 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.277 [2024-11-19 15:28:59.804597] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.277 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.277 15:28:59 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:01.277 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.277 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.277 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.277 15:28:59 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:01.277 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.278 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.278 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.278 15:28:59 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:01.278 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.278 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.278 [2024-11-19 15:28:59.832895] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:01.278 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.278 15:28:59 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:01.278 15:28:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:01.278 15:28:59 -- common/autotest_common.sh@10 -- # set +x 00:28:01.535 15:28:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:01.536 15:28:59 -- host/target_disconnect.sh@58 -- # wait 2888228 00:28:02.101 Controller properly reset. 00:28:07.363 Initializing NVMe Controllers 00:28:07.363 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:07.363 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:07.363 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:07.363 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:07.363 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:07.363 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:07.363 Initialization complete. Launching workers. 00:28:07.363 Starting thread on core 1 00:28:07.363 Starting thread on core 2 00:28:07.363 Starting thread on core 3 00:28:07.363 Starting thread on core 0 00:28:07.363 15:29:04 -- host/target_disconnect.sh@59 -- # sync 00:28:07.363 00:28:07.363 real 0m11.427s 00:28:07.363 user 0m35.393s 00:28:07.363 sys 0m7.466s 00:28:07.363 15:29:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:07.363 15:29:04 -- common/autotest_common.sh@10 -- # set +x 00:28:07.363 ************************************ 00:28:07.363 END TEST nvmf_target_disconnect_tc2 00:28:07.363 ************************************ 00:28:07.363 15:29:04 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:07.363 15:29:04 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:07.363 15:29:04 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:07.363 15:29:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:07.363 15:29:04 -- nvmf/common.sh@116 -- # sync 00:28:07.363 15:29:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:07.363 15:29:04 -- nvmf/common.sh@119 -- # set +e 00:28:07.363 15:29:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:07.363 15:29:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:07.363 rmmod nvme_tcp 00:28:07.363 rmmod nvme_fabrics 00:28:07.363 rmmod nvme_keyring 00:28:07.363 15:29:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:07.363 15:29:04 -- nvmf/common.sh@123 -- # set -e 00:28:07.363 15:29:04 -- nvmf/common.sh@124 -- # return 0 00:28:07.363 15:29:04 -- nvmf/common.sh@477 -- # '[' -n 2888767 ']' 00:28:07.363 15:29:04 -- nvmf/common.sh@478 -- # killprocess 2888767 00:28:07.363 15:29:04 -- common/autotest_common.sh@936 -- # '[' -z 2888767 ']' 00:28:07.363 15:29:04 -- common/autotest_common.sh@940 -- # kill -0 2888767 00:28:07.363 15:29:04 -- common/autotest_common.sh@941 -- # uname 00:28:07.363 15:29:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:07.363 15:29:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2888767 00:28:07.363 15:29:05 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:07.363 15:29:05 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:07.363 15:29:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2888767' 00:28:07.363 killing process with pid 2888767 00:28:07.363 15:29:05 -- common/autotest_common.sh@955 -- # kill 2888767 00:28:07.363 15:29:05 -- common/autotest_common.sh@960 -- # wait 2888767 00:28:07.363 15:29:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:07.363 15:29:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:07.363 15:29:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:07.363 15:29:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:07.363 15:29:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:07.363 15:29:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:07.363 15:29:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:07.363 15:29:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:09.267 15:29:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:09.267 00:28:09.267 real 0m16.337s 00:28:09.267 user 1m0.900s 00:28:09.267 sys 0m9.839s 00:28:09.267 15:29:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:09.267 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.267 ************************************ 00:28:09.267 END TEST nvmf_target_disconnect 00:28:09.267 ************************************ 00:28:09.267 15:29:07 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:09.267 15:29:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:09.267 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.267 15:29:07 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:09.267 00:28:09.267 real 21m30.607s 00:28:09.267 user 62m32.812s 00:28:09.267 sys 5m2.071s 00:28:09.267 15:29:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:09.267 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.267 ************************************ 00:28:09.267 END TEST nvmf_tcp 00:28:09.267 ************************************ 00:28:09.267 15:29:07 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:09.267 15:29:07 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:09.267 15:29:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:09.267 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.267 ************************************ 00:28:09.267 START TEST spdkcli_nvmf_tcp 00:28:09.267 ************************************ 00:28:09.267 15:29:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:09.267 * Looking for test storage... 00:28:09.267 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:09.267 15:29:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:09.267 15:29:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:09.267 15:29:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:09.267 15:29:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:09.267 15:29:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:09.267 15:29:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:09.267 15:29:07 -- scripts/common.sh@335 -- # IFS=.-: 00:28:09.267 15:29:07 -- scripts/common.sh@335 -- # read -ra ver1 00:28:09.267 15:29:07 -- scripts/common.sh@336 -- # IFS=.-: 00:28:09.267 15:29:07 -- scripts/common.sh@336 -- # read -ra ver2 00:28:09.267 15:29:07 -- scripts/common.sh@337 -- # local 'op=<' 00:28:09.267 15:29:07 -- scripts/common.sh@339 -- # ver1_l=2 00:28:09.267 15:29:07 -- scripts/common.sh@340 -- # ver2_l=1 00:28:09.267 15:29:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:09.267 15:29:07 -- scripts/common.sh@343 -- # case "$op" in 00:28:09.267 15:29:07 -- scripts/common.sh@344 -- # : 1 00:28:09.267 15:29:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:09.267 15:29:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:09.267 15:29:07 -- scripts/common.sh@364 -- # decimal 1 00:28:09.267 15:29:07 -- scripts/common.sh@352 -- # local d=1 00:28:09.267 15:29:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:09.267 15:29:07 -- scripts/common.sh@354 -- # echo 1 00:28:09.267 15:29:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:09.267 15:29:07 -- scripts/common.sh@365 -- # decimal 2 00:28:09.267 15:29:07 -- scripts/common.sh@352 -- # local d=2 00:28:09.267 15:29:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:09.267 15:29:07 -- scripts/common.sh@354 -- # echo 2 00:28:09.267 15:29:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:09.267 15:29:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:09.267 15:29:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:09.267 15:29:07 -- scripts/common.sh@367 -- # return 0 00:28:09.267 15:29:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.267 --rc genhtml_branch_coverage=1 00:28:09.267 --rc genhtml_function_coverage=1 00:28:09.267 --rc genhtml_legend=1 00:28:09.267 --rc geninfo_all_blocks=1 00:28:09.267 --rc geninfo_unexecuted_blocks=1 00:28:09.267 00:28:09.267 ' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.267 --rc genhtml_branch_coverage=1 00:28:09.267 --rc genhtml_function_coverage=1 00:28:09.267 --rc genhtml_legend=1 00:28:09.267 --rc geninfo_all_blocks=1 00:28:09.267 --rc geninfo_unexecuted_blocks=1 00:28:09.267 00:28:09.267 ' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.267 --rc genhtml_branch_coverage=1 00:28:09.267 --rc genhtml_function_coverage=1 00:28:09.267 --rc genhtml_legend=1 00:28:09.267 --rc geninfo_all_blocks=1 00:28:09.267 --rc geninfo_unexecuted_blocks=1 00:28:09.267 00:28:09.267 ' 00:28:09.267 15:29:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.267 --rc genhtml_branch_coverage=1 00:28:09.267 --rc genhtml_function_coverage=1 00:28:09.267 --rc genhtml_legend=1 00:28:09.267 --rc geninfo_all_blocks=1 00:28:09.267 --rc geninfo_unexecuted_blocks=1 00:28:09.267 00:28:09.267 ' 00:28:09.267 15:29:07 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:09.267 15:29:07 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:09.267 15:29:07 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:09.267 15:29:07 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:09.267 15:29:07 -- nvmf/common.sh@7 -- # uname -s 00:28:09.267 15:29:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:09.267 15:29:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:09.267 15:29:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:09.267 15:29:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:09.267 15:29:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:09.267 15:29:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:09.267 15:29:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:09.267 15:29:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:09.267 15:29:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:09.267 15:29:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:09.267 15:29:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:09.267 15:29:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:09.267 15:29:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:09.267 15:29:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:09.268 15:29:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:09.268 15:29:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:09.268 15:29:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:09.268 15:29:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:09.268 15:29:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:09.268 15:29:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.268 15:29:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.268 15:29:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.268 15:29:07 -- paths/export.sh@5 -- # export PATH 00:28:09.268 15:29:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.268 15:29:07 -- nvmf/common.sh@46 -- # : 0 00:28:09.268 15:29:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:09.268 15:29:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:09.268 15:29:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:09.268 15:29:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:09.268 15:29:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:09.268 15:29:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:09.268 15:29:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:09.268 15:29:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:09.268 15:29:07 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:09.268 15:29:07 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:09.268 15:29:07 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:09.268 15:29:07 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:09.268 15:29:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:09.268 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.268 15:29:07 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:09.268 15:29:07 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2890006 00:28:09.268 15:29:07 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:09.268 15:29:07 -- spdkcli/common.sh@34 -- # waitforlisten 2890006 00:28:09.268 15:29:07 -- common/autotest_common.sh@829 -- # '[' -z 2890006 ']' 00:28:09.268 15:29:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:09.268 15:29:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:09.268 15:29:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:09.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:09.268 15:29:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:09.268 15:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:09.268 [2024-11-19 15:29:07.628099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:09.268 [2024-11-19 15:29:07.628194] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2890006 ] 00:28:09.268 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.268 [2024-11-19 15:29:07.686505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:09.268 [2024-11-19 15:29:07.799821] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:09.268 [2024-11-19 15:29:07.800001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:09.268 [2024-11-19 15:29:07.800008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:10.203 15:29:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:10.203 15:29:08 -- common/autotest_common.sh@862 -- # return 0 00:28:10.203 15:29:08 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:10.203 15:29:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:10.203 15:29:08 -- common/autotest_common.sh@10 -- # set +x 00:28:10.203 15:29:08 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:10.203 15:29:08 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:10.203 15:29:08 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:10.203 15:29:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:10.203 15:29:08 -- common/autotest_common.sh@10 -- # set +x 00:28:10.203 15:29:08 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:10.203 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:10.203 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:10.203 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:10.203 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:10.203 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:10.203 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:10.203 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:10.203 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:10.203 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:10.203 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:10.203 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:10.203 ' 00:28:10.768 [2024-11-19 15:29:09.081150] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:13.296 [2024-11-19 15:29:11.261029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:14.229 [2024-11-19 15:29:12.501496] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:16.756 [2024-11-19 15:29:14.788768] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:18.672 [2024-11-19 15:29:16.767315] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:20.045 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:20.045 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:20.045 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:20.045 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:20.045 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:20.045 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:20.045 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:20.046 15:29:18 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:20.046 15:29:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:20.046 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:28:20.046 15:29:18 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:20.046 15:29:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:20.046 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:28:20.046 15:29:18 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:20.046 15:29:18 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:20.304 15:29:18 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:20.562 15:29:18 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:20.562 15:29:18 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:20.562 15:29:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:20.562 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:28:20.562 15:29:18 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:20.563 15:29:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:20.563 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:28:20.563 15:29:18 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:20.563 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:20.563 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:20.563 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:20.563 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:20.563 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:20.563 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:20.563 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:20.563 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:20.563 ' 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:25.842 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:25.842 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:25.842 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:25.842 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:25.842 15:29:24 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:25.842 15:29:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.842 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:25.842 15:29:24 -- spdkcli/nvmf.sh@90 -- # killprocess 2890006 00:28:25.842 15:29:24 -- common/autotest_common.sh@936 -- # '[' -z 2890006 ']' 00:28:25.842 15:29:24 -- common/autotest_common.sh@940 -- # kill -0 2890006 00:28:25.842 15:29:24 -- common/autotest_common.sh@941 -- # uname 00:28:25.842 15:29:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:25.842 15:29:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2890006 00:28:25.842 15:29:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:25.842 15:29:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:25.842 15:29:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2890006' 00:28:25.842 killing process with pid 2890006 00:28:25.842 15:29:24 -- common/autotest_common.sh@955 -- # kill 2890006 00:28:25.843 [2024-11-19 15:29:24.300375] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:25.843 15:29:24 -- common/autotest_common.sh@960 -- # wait 2890006 00:28:26.102 15:29:24 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:26.102 15:29:24 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:26.102 15:29:24 -- spdkcli/common.sh@13 -- # '[' -n 2890006 ']' 00:28:26.102 15:29:24 -- spdkcli/common.sh@14 -- # killprocess 2890006 00:28:26.102 15:29:24 -- common/autotest_common.sh@936 -- # '[' -z 2890006 ']' 00:28:26.102 15:29:24 -- common/autotest_common.sh@940 -- # kill -0 2890006 00:28:26.102 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2890006) - No such process 00:28:26.102 15:29:24 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2890006 is not found' 00:28:26.102 Process with pid 2890006 is not found 00:28:26.102 15:29:24 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:26.102 15:29:24 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:26.102 15:29:24 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:26.102 00:28:26.102 real 0m17.170s 00:28:26.102 user 0m36.551s 00:28:26.102 sys 0m0.817s 00:28:26.102 15:29:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:26.102 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:26.102 ************************************ 00:28:26.102 END TEST spdkcli_nvmf_tcp 00:28:26.102 ************************************ 00:28:26.102 15:29:24 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:26.102 15:29:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:26.102 15:29:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:26.102 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:26.102 ************************************ 00:28:26.102 START TEST nvmf_identify_passthru 00:28:26.102 ************************************ 00:28:26.102 15:29:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:26.102 * Looking for test storage... 00:28:26.102 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:26.102 15:29:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:26.102 15:29:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:26.102 15:29:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:26.363 15:29:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:26.363 15:29:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:26.363 15:29:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:26.363 15:29:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:26.363 15:29:24 -- scripts/common.sh@335 -- # IFS=.-: 00:28:26.363 15:29:24 -- scripts/common.sh@335 -- # read -ra ver1 00:28:26.363 15:29:24 -- scripts/common.sh@336 -- # IFS=.-: 00:28:26.363 15:29:24 -- scripts/common.sh@336 -- # read -ra ver2 00:28:26.363 15:29:24 -- scripts/common.sh@337 -- # local 'op=<' 00:28:26.363 15:29:24 -- scripts/common.sh@339 -- # ver1_l=2 00:28:26.363 15:29:24 -- scripts/common.sh@340 -- # ver2_l=1 00:28:26.363 15:29:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:26.363 15:29:24 -- scripts/common.sh@343 -- # case "$op" in 00:28:26.363 15:29:24 -- scripts/common.sh@344 -- # : 1 00:28:26.363 15:29:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:26.363 15:29:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:26.363 15:29:24 -- scripts/common.sh@364 -- # decimal 1 00:28:26.363 15:29:24 -- scripts/common.sh@352 -- # local d=1 00:28:26.363 15:29:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:26.363 15:29:24 -- scripts/common.sh@354 -- # echo 1 00:28:26.363 15:29:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:26.363 15:29:24 -- scripts/common.sh@365 -- # decimal 2 00:28:26.363 15:29:24 -- scripts/common.sh@352 -- # local d=2 00:28:26.363 15:29:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:26.363 15:29:24 -- scripts/common.sh@354 -- # echo 2 00:28:26.363 15:29:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:26.363 15:29:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:26.363 15:29:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:26.363 15:29:24 -- scripts/common.sh@367 -- # return 0 00:28:26.363 15:29:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:26.363 15:29:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:26.363 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:26.363 --rc genhtml_branch_coverage=1 00:28:26.363 --rc genhtml_function_coverage=1 00:28:26.363 --rc genhtml_legend=1 00:28:26.363 --rc geninfo_all_blocks=1 00:28:26.363 --rc geninfo_unexecuted_blocks=1 00:28:26.363 00:28:26.363 ' 00:28:26.363 15:29:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:26.363 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:26.363 --rc genhtml_branch_coverage=1 00:28:26.363 --rc genhtml_function_coverage=1 00:28:26.363 --rc genhtml_legend=1 00:28:26.363 --rc geninfo_all_blocks=1 00:28:26.363 --rc geninfo_unexecuted_blocks=1 00:28:26.363 00:28:26.363 ' 00:28:26.363 15:29:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:26.363 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:26.363 --rc genhtml_branch_coverage=1 00:28:26.363 --rc genhtml_function_coverage=1 00:28:26.363 --rc genhtml_legend=1 00:28:26.363 --rc geninfo_all_blocks=1 00:28:26.363 --rc geninfo_unexecuted_blocks=1 00:28:26.363 00:28:26.363 ' 00:28:26.363 15:29:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:26.363 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:26.363 --rc genhtml_branch_coverage=1 00:28:26.363 --rc genhtml_function_coverage=1 00:28:26.363 --rc genhtml_legend=1 00:28:26.363 --rc geninfo_all_blocks=1 00:28:26.363 --rc geninfo_unexecuted_blocks=1 00:28:26.363 00:28:26.363 ' 00:28:26.363 15:29:24 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:26.363 15:29:24 -- nvmf/common.sh@7 -- # uname -s 00:28:26.363 15:29:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:26.363 15:29:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:26.363 15:29:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:26.363 15:29:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:26.363 15:29:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:26.363 15:29:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:26.363 15:29:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:26.363 15:29:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:26.363 15:29:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:26.363 15:29:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:26.363 15:29:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:26.363 15:29:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:26.363 15:29:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:26.363 15:29:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:26.364 15:29:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:26.364 15:29:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:26.364 15:29:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:26.364 15:29:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:26.364 15:29:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:26.364 15:29:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@5 -- # export PATH 00:28:26.364 15:29:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- nvmf/common.sh@46 -- # : 0 00:28:26.364 15:29:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:26.364 15:29:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:26.364 15:29:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:26.364 15:29:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:26.364 15:29:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:26.364 15:29:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:26.364 15:29:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:26.364 15:29:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:26.364 15:29:24 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:26.364 15:29:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:26.364 15:29:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:26.364 15:29:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:26.364 15:29:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- paths/export.sh@5 -- # export PATH 00:28:26.364 15:29:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.364 15:29:24 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:26.364 15:29:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:26.364 15:29:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:26.364 15:29:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:26.364 15:29:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:26.364 15:29:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:26.364 15:29:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:26.364 15:29:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:26.364 15:29:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:26.364 15:29:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:26.364 15:29:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:26.364 15:29:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:26.364 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:28.901 15:29:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:28.901 15:29:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:28.901 15:29:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:28.901 15:29:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:28.901 15:29:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:28.901 15:29:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:28.901 15:29:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:28.901 15:29:26 -- nvmf/common.sh@294 -- # net_devs=() 00:28:28.901 15:29:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:28.901 15:29:26 -- nvmf/common.sh@295 -- # e810=() 00:28:28.901 15:29:26 -- nvmf/common.sh@295 -- # local -ga e810 00:28:28.901 15:29:26 -- nvmf/common.sh@296 -- # x722=() 00:28:28.901 15:29:26 -- nvmf/common.sh@296 -- # local -ga x722 00:28:28.901 15:29:26 -- nvmf/common.sh@297 -- # mlx=() 00:28:28.901 15:29:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:28.901 15:29:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:28.901 15:29:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:28.902 15:29:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:28.902 15:29:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:28.902 15:29:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:28.902 15:29:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.902 15:29:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:28.902 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:28.902 15:29:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.902 15:29:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:28.902 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:28.902 15:29:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.902 15:29:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.902 15:29:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.902 15:29:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:28.902 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:28.902 15:29:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.902 15:29:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.902 15:29:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.902 15:29:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.902 15:29:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:28.902 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:28.902 15:29:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.902 15:29:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:28.902 15:29:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:28.902 15:29:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:28.902 15:29:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:28.902 15:29:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:28.902 15:29:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:28.902 15:29:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:28.902 15:29:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:28.902 15:29:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:28.902 15:29:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:28.902 15:29:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:28.902 15:29:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:28.902 15:29:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:28.902 15:29:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:28.902 15:29:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:28.902 15:29:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:28.902 15:29:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:28.902 15:29:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:28.902 15:29:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:28.902 15:29:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:28.902 15:29:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:28.902 15:29:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:28.902 15:29:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:28.902 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:28.902 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:28:28.902 00:28:28.902 --- 10.0.0.2 ping statistics --- 00:28:28.902 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.902 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:28:28.902 15:29:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:28.902 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:28.902 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:28:28.902 00:28:28.902 --- 10.0.0.1 ping statistics --- 00:28:28.902 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.902 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:28:28.902 15:29:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:28.902 15:29:27 -- nvmf/common.sh@410 -- # return 0 00:28:28.902 15:29:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:28.902 15:29:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:28.902 15:29:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:28.902 15:29:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:28.902 15:29:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:28.902 15:29:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:28.902 15:29:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:28.902 15:29:27 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:28.902 15:29:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:28.902 15:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:28.902 15:29:27 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:28.902 15:29:27 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:28.902 15:29:27 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:28.902 15:29:27 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:28.902 15:29:27 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:28.902 15:29:27 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:28.902 15:29:27 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:28.902 15:29:27 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:28.902 15:29:27 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:28.902 15:29:27 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:28.902 15:29:27 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:28.902 15:29:27 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:28.902 15:29:27 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:28.902 15:29:27 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:28.902 15:29:27 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:28.902 15:29:27 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:28.902 15:29:27 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:28.902 15:29:27 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:28.902 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.088 15:29:31 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:33.088 15:29:31 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:33.088 15:29:31 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:33.088 15:29:31 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:33.088 EAL: No free 2048 kB hugepages reported on node 1 00:28:37.274 15:29:35 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:37.274 15:29:35 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:37.274 15:29:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:37.274 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.274 15:29:35 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:37.274 15:29:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:37.274 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.274 15:29:35 -- target/identify_passthru.sh@31 -- # nvmfpid=2894745 00:28:37.274 15:29:35 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:37.274 15:29:35 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:37.274 15:29:35 -- target/identify_passthru.sh@35 -- # waitforlisten 2894745 00:28:37.274 15:29:35 -- common/autotest_common.sh@829 -- # '[' -z 2894745 ']' 00:28:37.274 15:29:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:37.274 15:29:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:37.274 15:29:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:37.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:37.274 15:29:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:37.274 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.274 [2024-11-19 15:29:35.645286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:37.274 [2024-11-19 15:29:35.645370] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:37.274 EAL: No free 2048 kB hugepages reported on node 1 00:28:37.274 [2024-11-19 15:29:35.715488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:37.274 [2024-11-19 15:29:35.835471] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:37.274 [2024-11-19 15:29:35.835644] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:37.274 [2024-11-19 15:29:35.835663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:37.274 [2024-11-19 15:29:35.835676] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:37.274 [2024-11-19 15:29:35.835767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:37.274 [2024-11-19 15:29:35.836054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:37.274 [2024-11-19 15:29:35.836124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:37.274 [2024-11-19 15:29:35.836127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:37.533 15:29:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:37.533 15:29:35 -- common/autotest_common.sh@862 -- # return 0 00:28:37.533 15:29:35 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:37.533 15:29:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.533 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.533 INFO: Log level set to 20 00:28:37.533 INFO: Requests: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "method": "nvmf_set_config", 00:28:37.533 "id": 1, 00:28:37.533 "params": { 00:28:37.533 "admin_cmd_passthru": { 00:28:37.533 "identify_ctrlr": true 00:28:37.533 } 00:28:37.533 } 00:28:37.533 } 00:28:37.533 00:28:37.533 INFO: response: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "id": 1, 00:28:37.533 "result": true 00:28:37.533 } 00:28:37.533 00:28:37.533 15:29:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.533 15:29:35 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:37.533 15:29:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.533 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.533 INFO: Setting log level to 20 00:28:37.533 INFO: Setting log level to 20 00:28:37.533 INFO: Log level set to 20 00:28:37.533 INFO: Log level set to 20 00:28:37.533 INFO: Requests: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "method": "framework_start_init", 00:28:37.533 "id": 1 00:28:37.533 } 00:28:37.533 00:28:37.533 INFO: Requests: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "method": "framework_start_init", 00:28:37.533 "id": 1 00:28:37.533 } 00:28:37.533 00:28:37.533 [2024-11-19 15:29:35.987118] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:37.533 INFO: response: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "id": 1, 00:28:37.533 "result": true 00:28:37.533 } 00:28:37.533 00:28:37.533 INFO: response: 00:28:37.533 { 00:28:37.533 "jsonrpc": "2.0", 00:28:37.533 "id": 1, 00:28:37.533 "result": true 00:28:37.533 } 00:28:37.533 00:28:37.533 15:29:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.533 15:29:35 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:37.533 15:29:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.533 15:29:35 -- common/autotest_common.sh@10 -- # set +x 00:28:37.533 INFO: Setting log level to 40 00:28:37.533 INFO: Setting log level to 40 00:28:37.533 INFO: Setting log level to 40 00:28:37.533 [2024-11-19 15:29:35.997235] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:37.533 15:29:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.533 15:29:36 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:37.533 15:29:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:37.533 15:29:36 -- common/autotest_common.sh@10 -- # set +x 00:28:37.533 15:29:36 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:37.533 15:29:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.533 15:29:36 -- common/autotest_common.sh@10 -- # set +x 00:28:40.819 Nvme0n1 00:28:40.819 15:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.819 15:29:38 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:40.819 15:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.819 15:29:38 -- common/autotest_common.sh@10 -- # set +x 00:28:40.819 15:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.819 15:29:38 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:40.819 15:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.819 15:29:38 -- common/autotest_common.sh@10 -- # set +x 00:28:40.819 15:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.819 15:29:38 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:40.819 15:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.819 15:29:38 -- common/autotest_common.sh@10 -- # set +x 00:28:40.819 [2024-11-19 15:29:38.890825] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:40.819 15:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.819 15:29:38 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:40.819 15:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.819 15:29:38 -- common/autotest_common.sh@10 -- # set +x 00:28:40.819 [2024-11-19 15:29:38.898532] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:40.819 [ 00:28:40.819 { 00:28:40.819 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:40.819 "subtype": "Discovery", 00:28:40.819 "listen_addresses": [], 00:28:40.819 "allow_any_host": true, 00:28:40.819 "hosts": [] 00:28:40.819 }, 00:28:40.819 { 00:28:40.819 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:40.819 "subtype": "NVMe", 00:28:40.819 "listen_addresses": [ 00:28:40.819 { 00:28:40.819 "transport": "TCP", 00:28:40.819 "trtype": "TCP", 00:28:40.819 "adrfam": "IPv4", 00:28:40.819 "traddr": "10.0.0.2", 00:28:40.819 "trsvcid": "4420" 00:28:40.819 } 00:28:40.819 ], 00:28:40.819 "allow_any_host": true, 00:28:40.819 "hosts": [], 00:28:40.819 "serial_number": "SPDK00000000000001", 00:28:40.819 "model_number": "SPDK bdev Controller", 00:28:40.819 "max_namespaces": 1, 00:28:40.819 "min_cntlid": 1, 00:28:40.819 "max_cntlid": 65519, 00:28:40.819 "namespaces": [ 00:28:40.819 { 00:28:40.819 "nsid": 1, 00:28:40.819 "bdev_name": "Nvme0n1", 00:28:40.819 "name": "Nvme0n1", 00:28:40.819 "nguid": "AA6933D13A0345998E93367A617BEA85", 00:28:40.819 "uuid": "aa6933d1-3a03-4599-8e93-367a617bea85" 00:28:40.819 } 00:28:40.819 ] 00:28:40.819 } 00:28:40.819 ] 00:28:40.819 15:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.819 15:29:38 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:40.820 15:29:38 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:40.820 15:29:38 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:40.820 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.820 15:29:39 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:40.820 15:29:39 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:40.820 15:29:39 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:40.820 15:29:39 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:40.820 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.820 15:29:39 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:40.820 15:29:39 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:40.820 15:29:39 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:40.820 15:29:39 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:40.820 15:29:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.820 15:29:39 -- common/autotest_common.sh@10 -- # set +x 00:28:40.820 15:29:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.820 15:29:39 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:40.820 15:29:39 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:40.820 15:29:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:40.820 15:29:39 -- nvmf/common.sh@116 -- # sync 00:28:40.820 15:29:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:40.820 15:29:39 -- nvmf/common.sh@119 -- # set +e 00:28:40.820 15:29:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:40.820 15:29:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:40.820 rmmod nvme_tcp 00:28:40.820 rmmod nvme_fabrics 00:28:40.820 rmmod nvme_keyring 00:28:40.820 15:29:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:40.820 15:29:39 -- nvmf/common.sh@123 -- # set -e 00:28:40.820 15:29:39 -- nvmf/common.sh@124 -- # return 0 00:28:40.820 15:29:39 -- nvmf/common.sh@477 -- # '[' -n 2894745 ']' 00:28:40.820 15:29:39 -- nvmf/common.sh@478 -- # killprocess 2894745 00:28:40.820 15:29:39 -- common/autotest_common.sh@936 -- # '[' -z 2894745 ']' 00:28:40.820 15:29:39 -- common/autotest_common.sh@940 -- # kill -0 2894745 00:28:40.820 15:29:39 -- common/autotest_common.sh@941 -- # uname 00:28:40.820 15:29:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:40.820 15:29:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2894745 00:28:41.081 15:29:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:41.081 15:29:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:41.081 15:29:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2894745' 00:28:41.081 killing process with pid 2894745 00:28:41.081 15:29:39 -- common/autotest_common.sh@955 -- # kill 2894745 00:28:41.081 [2024-11-19 15:29:39.404562] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:41.081 15:29:39 -- common/autotest_common.sh@960 -- # wait 2894745 00:28:42.533 15:29:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:42.533 15:29:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:42.533 15:29:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:42.533 15:29:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:42.533 15:29:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:42.533 15:29:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:42.533 15:29:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:42.533 15:29:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:45.066 15:29:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:45.066 00:28:45.066 real 0m18.426s 00:28:45.066 user 0m27.127s 00:28:45.066 sys 0m2.437s 00:28:45.066 15:29:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:45.066 15:29:43 -- common/autotest_common.sh@10 -- # set +x 00:28:45.066 ************************************ 00:28:45.066 END TEST nvmf_identify_passthru 00:28:45.066 ************************************ 00:28:45.066 15:29:43 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:45.066 15:29:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:45.066 15:29:43 -- common/autotest_common.sh@10 -- # set +x 00:28:45.066 ************************************ 00:28:45.066 START TEST nvmf_dif 00:28:45.066 ************************************ 00:28:45.066 15:29:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:45.066 * Looking for test storage... 00:28:45.066 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:45.066 15:29:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:45.066 15:29:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:45.066 15:29:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:45.066 15:29:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:45.066 15:29:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:45.066 15:29:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:45.066 15:29:43 -- scripts/common.sh@335 -- # IFS=.-: 00:28:45.066 15:29:43 -- scripts/common.sh@335 -- # read -ra ver1 00:28:45.066 15:29:43 -- scripts/common.sh@336 -- # IFS=.-: 00:28:45.066 15:29:43 -- scripts/common.sh@336 -- # read -ra ver2 00:28:45.066 15:29:43 -- scripts/common.sh@337 -- # local 'op=<' 00:28:45.066 15:29:43 -- scripts/common.sh@339 -- # ver1_l=2 00:28:45.066 15:29:43 -- scripts/common.sh@340 -- # ver2_l=1 00:28:45.066 15:29:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:45.066 15:29:43 -- scripts/common.sh@343 -- # case "$op" in 00:28:45.066 15:29:43 -- scripts/common.sh@344 -- # : 1 00:28:45.066 15:29:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:45.066 15:29:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:45.066 15:29:43 -- scripts/common.sh@364 -- # decimal 1 00:28:45.066 15:29:43 -- scripts/common.sh@352 -- # local d=1 00:28:45.066 15:29:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:45.066 15:29:43 -- scripts/common.sh@354 -- # echo 1 00:28:45.066 15:29:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:45.066 15:29:43 -- scripts/common.sh@365 -- # decimal 2 00:28:45.066 15:29:43 -- scripts/common.sh@352 -- # local d=2 00:28:45.066 15:29:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:45.066 15:29:43 -- scripts/common.sh@354 -- # echo 2 00:28:45.066 15:29:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:45.066 15:29:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:45.066 15:29:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:45.066 15:29:43 -- scripts/common.sh@367 -- # return 0 00:28:45.066 15:29:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:45.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.066 --rc genhtml_branch_coverage=1 00:28:45.066 --rc genhtml_function_coverage=1 00:28:45.066 --rc genhtml_legend=1 00:28:45.066 --rc geninfo_all_blocks=1 00:28:45.066 --rc geninfo_unexecuted_blocks=1 00:28:45.066 00:28:45.066 ' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:45.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.066 --rc genhtml_branch_coverage=1 00:28:45.066 --rc genhtml_function_coverage=1 00:28:45.066 --rc genhtml_legend=1 00:28:45.066 --rc geninfo_all_blocks=1 00:28:45.066 --rc geninfo_unexecuted_blocks=1 00:28:45.066 00:28:45.066 ' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:45.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.066 --rc genhtml_branch_coverage=1 00:28:45.066 --rc genhtml_function_coverage=1 00:28:45.066 --rc genhtml_legend=1 00:28:45.066 --rc geninfo_all_blocks=1 00:28:45.066 --rc geninfo_unexecuted_blocks=1 00:28:45.066 00:28:45.066 ' 00:28:45.066 15:29:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:45.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:45.066 --rc genhtml_branch_coverage=1 00:28:45.066 --rc genhtml_function_coverage=1 00:28:45.066 --rc genhtml_legend=1 00:28:45.066 --rc geninfo_all_blocks=1 00:28:45.066 --rc geninfo_unexecuted_blocks=1 00:28:45.066 00:28:45.066 ' 00:28:45.066 15:29:43 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:45.066 15:29:43 -- nvmf/common.sh@7 -- # uname -s 00:28:45.066 15:29:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:45.066 15:29:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:45.066 15:29:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:45.066 15:29:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:45.066 15:29:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:45.066 15:29:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:45.066 15:29:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:45.066 15:29:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:45.066 15:29:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:45.066 15:29:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:45.066 15:29:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:45.066 15:29:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:45.066 15:29:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:45.066 15:29:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:45.066 15:29:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:45.066 15:29:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:45.066 15:29:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:45.066 15:29:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:45.066 15:29:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:45.067 15:29:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.067 15:29:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.067 15:29:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.067 15:29:43 -- paths/export.sh@5 -- # export PATH 00:28:45.067 15:29:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.067 15:29:43 -- nvmf/common.sh@46 -- # : 0 00:28:45.067 15:29:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:45.067 15:29:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:45.067 15:29:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:45.067 15:29:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:45.067 15:29:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:45.067 15:29:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:45.067 15:29:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:45.067 15:29:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:45.067 15:29:43 -- target/dif.sh@15 -- # NULL_META=16 00:28:45.067 15:29:43 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:45.067 15:29:43 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:45.067 15:29:43 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:45.067 15:29:43 -- target/dif.sh@135 -- # nvmftestinit 00:28:45.067 15:29:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:45.067 15:29:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:45.067 15:29:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:45.067 15:29:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:45.067 15:29:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:45.067 15:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.067 15:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:45.067 15:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:45.067 15:29:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:45.067 15:29:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:45.067 15:29:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:45.067 15:29:43 -- common/autotest_common.sh@10 -- # set +x 00:28:46.970 15:29:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:46.970 15:29:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:46.970 15:29:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:46.970 15:29:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:46.970 15:29:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:46.970 15:29:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:46.970 15:29:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:46.970 15:29:45 -- nvmf/common.sh@294 -- # net_devs=() 00:28:46.970 15:29:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:46.970 15:29:45 -- nvmf/common.sh@295 -- # e810=() 00:28:46.970 15:29:45 -- nvmf/common.sh@295 -- # local -ga e810 00:28:46.970 15:29:45 -- nvmf/common.sh@296 -- # x722=() 00:28:46.970 15:29:45 -- nvmf/common.sh@296 -- # local -ga x722 00:28:46.970 15:29:45 -- nvmf/common.sh@297 -- # mlx=() 00:28:46.970 15:29:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:46.970 15:29:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:46.970 15:29:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:46.970 15:29:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:46.970 15:29:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:46.970 15:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:46.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:46.970 15:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:46.970 15:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:46.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:46.970 15:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:46.970 15:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:46.970 15:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:46.970 15:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:46.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:46.970 15:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:46.970 15:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:46.970 15:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:46.970 15:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:46.970 15:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:46.970 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:46.970 15:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:46.970 15:29:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:46.970 15:29:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:46.970 15:29:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:46.970 15:29:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:46.970 15:29:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:46.970 15:29:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:46.970 15:29:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:46.970 15:29:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:46.970 15:29:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:46.970 15:29:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:46.970 15:29:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:46.970 15:29:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:46.970 15:29:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:46.970 15:29:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:46.970 15:29:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:46.970 15:29:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:46.970 15:29:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:46.970 15:29:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:46.970 15:29:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:46.970 15:29:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:46.970 15:29:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:46.971 15:29:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:46.971 15:29:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:46.971 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:46.971 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:28:46.971 00:28:46.971 --- 10.0.0.2 ping statistics --- 00:28:46.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:46.971 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:28:46.971 15:29:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:46.971 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:46.971 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:28:46.971 00:28:46.971 --- 10.0.0.1 ping statistics --- 00:28:46.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:46.971 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:28:46.971 15:29:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:46.971 15:29:45 -- nvmf/common.sh@410 -- # return 0 00:28:46.971 15:29:45 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:46.971 15:29:45 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:47.906 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:47.906 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:47.906 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:47.906 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:47.906 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:47.906 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:47.906 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:47.906 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:47.906 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:47.906 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:47.906 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:47.906 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:47.906 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:47.906 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:47.906 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:47.906 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:47.906 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:48.165 15:29:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:48.165 15:29:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:48.165 15:29:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:48.165 15:29:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:48.165 15:29:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:48.165 15:29:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:48.165 15:29:46 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:48.165 15:29:46 -- target/dif.sh@137 -- # nvmfappstart 00:28:48.165 15:29:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:48.165 15:29:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:48.165 15:29:46 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 15:29:46 -- nvmf/common.sh@469 -- # nvmfpid=2898075 00:28:48.165 15:29:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:48.165 15:29:46 -- nvmf/common.sh@470 -- # waitforlisten 2898075 00:28:48.165 15:29:46 -- common/autotest_common.sh@829 -- # '[' -z 2898075 ']' 00:28:48.165 15:29:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:48.165 15:29:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:48.165 15:29:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:48.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:48.165 15:29:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:48.165 15:29:46 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 [2024-11-19 15:29:46.649387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:48.165 [2024-11-19 15:29:46.649475] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:48.165 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.165 [2024-11-19 15:29:46.711851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:48.423 [2024-11-19 15:29:46.821444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:48.423 [2024-11-19 15:29:46.821619] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:48.424 [2024-11-19 15:29:46.821635] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:48.424 [2024-11-19 15:29:46.821647] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:48.424 [2024-11-19 15:29:46.821697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:49.358 15:29:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:49.358 15:29:47 -- common/autotest_common.sh@862 -- # return 0 00:28:49.358 15:29:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:49.358 15:29:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 15:29:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:49.358 15:29:47 -- target/dif.sh@139 -- # create_transport 00:28:49.358 15:29:47 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:49.358 15:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 [2024-11-19 15:29:47.735981] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:49.358 15:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.358 15:29:47 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:49.358 15:29:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:49.358 15:29:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 ************************************ 00:28:49.358 START TEST fio_dif_1_default 00:28:49.358 ************************************ 00:28:49.358 15:29:47 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:49.358 15:29:47 -- target/dif.sh@86 -- # create_subsystems 0 00:28:49.358 15:29:47 -- target/dif.sh@28 -- # local sub 00:28:49.358 15:29:47 -- target/dif.sh@30 -- # for sub in "$@" 00:28:49.358 15:29:47 -- target/dif.sh@31 -- # create_subsystem 0 00:28:49.358 15:29:47 -- target/dif.sh@18 -- # local sub_id=0 00:28:49.358 15:29:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:49.358 15:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 bdev_null0 00:28:49.358 15:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.358 15:29:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:49.358 15:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 15:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.358 15:29:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:49.358 15:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 15:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.358 15:29:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:49.358 15:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.358 15:29:47 -- common/autotest_common.sh@10 -- # set +x 00:28:49.358 [2024-11-19 15:29:47.772222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:49.358 15:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.358 15:29:47 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:49.358 15:29:47 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:49.358 15:29:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:49.358 15:29:47 -- nvmf/common.sh@520 -- # config=() 00:28:49.358 15:29:47 -- nvmf/common.sh@520 -- # local subsystem config 00:28:49.358 15:29:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:49.359 15:29:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:49.359 15:29:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:49.359 { 00:28:49.359 "params": { 00:28:49.359 "name": "Nvme$subsystem", 00:28:49.359 "trtype": "$TEST_TRANSPORT", 00:28:49.359 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:49.359 "adrfam": "ipv4", 00:28:49.359 "trsvcid": "$NVMF_PORT", 00:28:49.359 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:49.359 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:49.359 "hdgst": ${hdgst:-false}, 00:28:49.359 "ddgst": ${ddgst:-false} 00:28:49.359 }, 00:28:49.359 "method": "bdev_nvme_attach_controller" 00:28:49.359 } 00:28:49.359 EOF 00:28:49.359 )") 00:28:49.359 15:29:47 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:49.359 15:29:47 -- target/dif.sh@82 -- # gen_fio_conf 00:28:49.359 15:29:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:49.359 15:29:47 -- target/dif.sh@54 -- # local file 00:28:49.359 15:29:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:49.359 15:29:47 -- target/dif.sh@56 -- # cat 00:28:49.359 15:29:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:49.359 15:29:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:49.359 15:29:47 -- common/autotest_common.sh@1330 -- # shift 00:28:49.359 15:29:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:49.359 15:29:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:49.359 15:29:47 -- nvmf/common.sh@542 -- # cat 00:28:49.359 15:29:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:49.359 15:29:47 -- target/dif.sh@72 -- # (( file <= files )) 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:49.359 15:29:47 -- nvmf/common.sh@544 -- # jq . 00:28:49.359 15:29:47 -- nvmf/common.sh@545 -- # IFS=, 00:28:49.359 15:29:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:49.359 "params": { 00:28:49.359 "name": "Nvme0", 00:28:49.359 "trtype": "tcp", 00:28:49.359 "traddr": "10.0.0.2", 00:28:49.359 "adrfam": "ipv4", 00:28:49.359 "trsvcid": "4420", 00:28:49.359 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:49.359 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:49.359 "hdgst": false, 00:28:49.359 "ddgst": false 00:28:49.359 }, 00:28:49.359 "method": "bdev_nvme_attach_controller" 00:28:49.359 }' 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:49.359 15:29:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:49.359 15:29:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:49.359 15:29:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:49.359 15:29:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:49.359 15:29:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:49.359 15:29:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:49.618 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:49.618 fio-3.35 00:28:49.618 Starting 1 thread 00:28:49.618 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.185 [2024-11-19 15:29:48.520939] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:50.185 [2024-11-19 15:29:48.521035] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:00.156 00:29:00.157 filename0: (groupid=0, jobs=1): err= 0: pid=2898440: Tue Nov 19 15:29:58 2024 00:29:00.157 read: IOPS=97, BW=392KiB/s (401kB/s)(3920KiB/10010msec) 00:29:00.157 slat (nsec): min=5968, max=84573, avg=8589.18, stdev=3889.50 00:29:00.157 clat (usec): min=597, max=43454, avg=40828.08, stdev=2582.26 00:29:00.157 lat (usec): min=604, max=43490, avg=40836.67, stdev=2582.36 00:29:00.157 clat percentiles (usec): 00:29:00.157 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:00.157 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:00.157 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:00.157 | 99.00th=[41681], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:29:00.157 | 99.99th=[43254] 00:29:00.157 bw ( KiB/s): min= 384, max= 416, per=99.59%, avg=390.40, stdev=13.13, samples=20 00:29:00.157 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:29:00.157 lat (usec) : 750=0.41% 00:29:00.157 lat (msec) : 50=99.59% 00:29:00.157 cpu : usr=91.75%, sys=7.97%, ctx=15, majf=0, minf=308 00:29:00.157 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.157 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.157 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.157 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.157 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:00.157 00:29:00.157 Run status group 0 (all jobs): 00:29:00.157 READ: bw=392KiB/s (401kB/s), 392KiB/s-392KiB/s (401kB/s-401kB/s), io=3920KiB (4014kB), run=10010-10010msec 00:29:00.416 15:29:58 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:00.416 15:29:58 -- target/dif.sh@43 -- # local sub 00:29:00.416 15:29:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:00.416 15:29:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:00.416 15:29:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:00.416 15:29:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:00.416 15:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.416 15:29:58 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:00.676 15:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:58 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 00:29:00.676 real 0m11.249s 00:29:00.676 user 0m10.529s 00:29:00.676 sys 0m1.039s 00:29:00.676 15:29:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:00.676 15:29:58 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 ************************************ 00:29:00.676 END TEST fio_dif_1_default 00:29:00.676 ************************************ 00:29:00.676 15:29:59 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:00.676 15:29:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:00.676 15:29:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 ************************************ 00:29:00.676 START TEST fio_dif_1_multi_subsystems 00:29:00.676 ************************************ 00:29:00.676 15:29:59 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:00.676 15:29:59 -- target/dif.sh@92 -- # local files=1 00:29:00.676 15:29:59 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:00.676 15:29:59 -- target/dif.sh@28 -- # local sub 00:29:00.676 15:29:59 -- target/dif.sh@30 -- # for sub in "$@" 00:29:00.676 15:29:59 -- target/dif.sh@31 -- # create_subsystem 0 00:29:00.676 15:29:59 -- target/dif.sh@18 -- # local sub_id=0 00:29:00.676 15:29:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 bdev_null0 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 [2024-11-19 15:29:59.048593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@30 -- # for sub in "$@" 00:29:00.676 15:29:59 -- target/dif.sh@31 -- # create_subsystem 1 00:29:00.676 15:29:59 -- target/dif.sh@18 -- # local sub_id=1 00:29:00.676 15:29:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 bdev_null1 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:00.676 15:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.676 15:29:59 -- common/autotest_common.sh@10 -- # set +x 00:29:00.676 15:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.676 15:29:59 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:00.676 15:29:59 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:00.676 15:29:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.676 15:29:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:00.676 15:29:59 -- nvmf/common.sh@520 -- # config=() 00:29:00.676 15:29:59 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.676 15:29:59 -- target/dif.sh@82 -- # gen_fio_conf 00:29:00.676 15:29:59 -- nvmf/common.sh@520 -- # local subsystem config 00:29:00.676 15:29:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:00.676 15:29:59 -- target/dif.sh@54 -- # local file 00:29:00.676 15:29:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:00.676 15:29:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:00.676 15:29:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:00.676 15:29:59 -- target/dif.sh@56 -- # cat 00:29:00.676 15:29:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:00.676 { 00:29:00.676 "params": { 00:29:00.676 "name": "Nvme$subsystem", 00:29:00.677 "trtype": "$TEST_TRANSPORT", 00:29:00.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:00.677 "adrfam": "ipv4", 00:29:00.677 "trsvcid": "$NVMF_PORT", 00:29:00.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:00.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:00.677 "hdgst": ${hdgst:-false}, 00:29:00.677 "ddgst": ${ddgst:-false} 00:29:00.677 }, 00:29:00.677 "method": "bdev_nvme_attach_controller" 00:29:00.677 } 00:29:00.677 EOF 00:29:00.677 )") 00:29:00.677 15:29:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.677 15:29:59 -- common/autotest_common.sh@1330 -- # shift 00:29:00.677 15:29:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:00.677 15:29:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:00.677 15:29:59 -- nvmf/common.sh@542 -- # cat 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.677 15:29:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:00.677 15:29:59 -- target/dif.sh@72 -- # (( file <= files )) 00:29:00.677 15:29:59 -- target/dif.sh@73 -- # cat 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:00.677 15:29:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:00.677 15:29:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:00.677 { 00:29:00.677 "params": { 00:29:00.677 "name": "Nvme$subsystem", 00:29:00.677 "trtype": "$TEST_TRANSPORT", 00:29:00.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:00.677 "adrfam": "ipv4", 00:29:00.677 "trsvcid": "$NVMF_PORT", 00:29:00.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:00.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:00.677 "hdgst": ${hdgst:-false}, 00:29:00.677 "ddgst": ${ddgst:-false} 00:29:00.677 }, 00:29:00.677 "method": "bdev_nvme_attach_controller" 00:29:00.677 } 00:29:00.677 EOF 00:29:00.677 )") 00:29:00.677 15:29:59 -- target/dif.sh@72 -- # (( file++ )) 00:29:00.677 15:29:59 -- target/dif.sh@72 -- # (( file <= files )) 00:29:00.677 15:29:59 -- nvmf/common.sh@542 -- # cat 00:29:00.677 15:29:59 -- nvmf/common.sh@544 -- # jq . 00:29:00.677 15:29:59 -- nvmf/common.sh@545 -- # IFS=, 00:29:00.677 15:29:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:00.677 "params": { 00:29:00.677 "name": "Nvme0", 00:29:00.677 "trtype": "tcp", 00:29:00.677 "traddr": "10.0.0.2", 00:29:00.677 "adrfam": "ipv4", 00:29:00.677 "trsvcid": "4420", 00:29:00.677 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:00.677 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:00.677 "hdgst": false, 00:29:00.677 "ddgst": false 00:29:00.677 }, 00:29:00.677 "method": "bdev_nvme_attach_controller" 00:29:00.677 },{ 00:29:00.677 "params": { 00:29:00.677 "name": "Nvme1", 00:29:00.677 "trtype": "tcp", 00:29:00.677 "traddr": "10.0.0.2", 00:29:00.677 "adrfam": "ipv4", 00:29:00.677 "trsvcid": "4420", 00:29:00.677 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:00.677 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:00.677 "hdgst": false, 00:29:00.677 "ddgst": false 00:29:00.677 }, 00:29:00.677 "method": "bdev_nvme_attach_controller" 00:29:00.677 }' 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:00.677 15:29:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:00.677 15:29:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:00.677 15:29:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:00.677 15:29:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:00.677 15:29:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:00.677 15:29:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:00.936 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:00.936 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:00.936 fio-3.35 00:29:00.936 Starting 2 threads 00:29:00.936 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.502 [2024-11-19 15:30:00.000631] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:01.502 [2024-11-19 15:30:00.000702] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:13.703 00:29:13.703 filename0: (groupid=0, jobs=1): err= 0: pid=2899880: Tue Nov 19 15:30:10 2024 00:29:13.703 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10010msec) 00:29:13.703 slat (nsec): min=4412, max=75123, avg=9024.25, stdev=3154.59 00:29:13.703 clat (usec): min=560, max=47702, avg=21089.62, stdev=20378.35 00:29:13.703 lat (usec): min=567, max=47713, avg=21098.64, stdev=20378.00 00:29:13.703 clat percentiles (usec): 00:29:13.703 | 1.00th=[ 578], 5.00th=[ 594], 10.00th=[ 611], 20.00th=[ 627], 00:29:13.703 | 30.00th=[ 644], 40.00th=[ 660], 50.00th=[41157], 60.00th=[41157], 00:29:13.703 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:13.703 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:29:13.703 | 99.99th=[47449] 00:29:13.703 bw ( KiB/s): min= 672, max= 832, per=49.91%, avg=756.80, stdev=34.86, samples=20 00:29:13.703 iops : min= 168, max= 208, avg=189.20, stdev= 8.72, samples=20 00:29:13.703 lat (usec) : 750=49.79% 00:29:13.703 lat (msec) : 50=50.21% 00:29:13.703 cpu : usr=95.38%, sys=4.30%, ctx=17, majf=0, minf=163 00:29:13.703 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.703 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.703 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.703 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.703 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:13.703 filename1: (groupid=0, jobs=1): err= 0: pid=2899881: Tue Nov 19 15:30:10 2024 00:29:13.703 read: IOPS=189, BW=757KiB/s (776kB/s)(7584KiB/10013msec) 00:29:13.703 slat (nsec): min=3601, max=41018, avg=9276.03, stdev=3367.31 00:29:13.703 clat (usec): min=563, max=47726, avg=21095.40, stdev=20283.42 00:29:13.703 lat (usec): min=571, max=47767, avg=21104.67, stdev=20283.51 00:29:13.703 clat percentiles (usec): 00:29:13.703 | 1.00th=[ 594], 5.00th=[ 619], 10.00th=[ 635], 20.00th=[ 717], 00:29:13.703 | 30.00th=[ 758], 40.00th=[ 824], 50.00th=[40633], 60.00th=[41157], 00:29:13.703 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:13.703 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47973], 99.95th=[47973], 00:29:13.703 | 99.99th=[47973] 00:29:13.703 bw ( KiB/s): min= 672, max= 768, per=49.91%, avg=756.80, stdev=28.00, samples=20 00:29:13.703 iops : min= 168, max= 192, avg=189.20, stdev= 7.00, samples=20 00:29:13.703 lat (usec) : 750=25.84%, 1000=23.73% 00:29:13.703 lat (msec) : 2=0.21%, 50=50.21% 00:29:13.703 cpu : usr=95.55%, sys=4.14%, ctx=15, majf=0, minf=158 00:29:13.703 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.704 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.704 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:13.704 00:29:13.704 Run status group 0 (all jobs): 00:29:13.704 READ: bw=1515KiB/s (1551kB/s), 757KiB/s-758KiB/s (776kB/s-776kB/s), io=14.8MiB (15.5MB), run=10010-10013msec 00:29:13.704 15:30:10 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:13.704 15:30:10 -- target/dif.sh@43 -- # local sub 00:29:13.704 15:30:10 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.704 15:30:10 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:13.704 15:30:10 -- target/dif.sh@36 -- # local sub_id=0 00:29:13.704 15:30:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.704 15:30:10 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:13.704 15:30:10 -- target/dif.sh@36 -- # local sub_id=1 00:29:13.704 15:30:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 00:29:13.704 real 0m11.458s 00:29:13.704 user 0m20.521s 00:29:13.704 sys 0m1.167s 00:29:13.704 15:30:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 ************************************ 00:29:13.704 END TEST fio_dif_1_multi_subsystems 00:29:13.704 ************************************ 00:29:13.704 15:30:10 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:13.704 15:30:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:13.704 15:30:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 ************************************ 00:29:13.704 START TEST fio_dif_rand_params 00:29:13.704 ************************************ 00:29:13.704 15:30:10 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:13.704 15:30:10 -- target/dif.sh@100 -- # local NULL_DIF 00:29:13.704 15:30:10 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:13.704 15:30:10 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:13.704 15:30:10 -- target/dif.sh@103 -- # bs=128k 00:29:13.704 15:30:10 -- target/dif.sh@103 -- # numjobs=3 00:29:13.704 15:30:10 -- target/dif.sh@103 -- # iodepth=3 00:29:13.704 15:30:10 -- target/dif.sh@103 -- # runtime=5 00:29:13.704 15:30:10 -- target/dif.sh@105 -- # create_subsystems 0 00:29:13.704 15:30:10 -- target/dif.sh@28 -- # local sub 00:29:13.704 15:30:10 -- target/dif.sh@30 -- # for sub in "$@" 00:29:13.704 15:30:10 -- target/dif.sh@31 -- # create_subsystem 0 00:29:13.704 15:30:10 -- target/dif.sh@18 -- # local sub_id=0 00:29:13.704 15:30:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 bdev_null0 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:13.704 15:30:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.704 15:30:10 -- common/autotest_common.sh@10 -- # set +x 00:29:13.704 [2024-11-19 15:30:10.537966] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:13.704 15:30:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.704 15:30:10 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:13.704 15:30:10 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:13.704 15:30:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:13.704 15:30:10 -- nvmf/common.sh@520 -- # config=() 00:29:13.704 15:30:10 -- nvmf/common.sh@520 -- # local subsystem config 00:29:13.704 15:30:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:13.704 15:30:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:13.704 { 00:29:13.704 "params": { 00:29:13.704 "name": "Nvme$subsystem", 00:29:13.704 "trtype": "$TEST_TRANSPORT", 00:29:13.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:13.704 "adrfam": "ipv4", 00:29:13.704 "trsvcid": "$NVMF_PORT", 00:29:13.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:13.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:13.704 "hdgst": ${hdgst:-false}, 00:29:13.704 "ddgst": ${ddgst:-false} 00:29:13.704 }, 00:29:13.704 "method": "bdev_nvme_attach_controller" 00:29:13.704 } 00:29:13.704 EOF 00:29:13.704 )") 00:29:13.704 15:30:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.704 15:30:10 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.704 15:30:10 -- target/dif.sh@82 -- # gen_fio_conf 00:29:13.704 15:30:10 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:13.704 15:30:10 -- target/dif.sh@54 -- # local file 00:29:13.704 15:30:10 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:13.704 15:30:10 -- target/dif.sh@56 -- # cat 00:29:13.704 15:30:10 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:13.704 15:30:10 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.704 15:30:10 -- common/autotest_common.sh@1330 -- # shift 00:29:13.704 15:30:10 -- nvmf/common.sh@542 -- # cat 00:29:13.704 15:30:10 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:13.704 15:30:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.704 15:30:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:13.704 15:30:10 -- target/dif.sh@72 -- # (( file <= files )) 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.704 15:30:10 -- nvmf/common.sh@544 -- # jq . 00:29:13.704 15:30:10 -- nvmf/common.sh@545 -- # IFS=, 00:29:13.704 15:30:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:13.704 "params": { 00:29:13.704 "name": "Nvme0", 00:29:13.704 "trtype": "tcp", 00:29:13.704 "traddr": "10.0.0.2", 00:29:13.704 "adrfam": "ipv4", 00:29:13.704 "trsvcid": "4420", 00:29:13.704 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:13.704 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:13.704 "hdgst": false, 00:29:13.704 "ddgst": false 00:29:13.704 }, 00:29:13.704 "method": "bdev_nvme_attach_controller" 00:29:13.704 }' 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.704 15:30:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.704 15:30:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.704 15:30:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.704 15:30:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.704 15:30:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:13.704 15:30:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.704 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:13.704 ... 00:29:13.704 fio-3.35 00:29:13.704 Starting 3 threads 00:29:13.704 EAL: No free 2048 kB hugepages reported on node 1 00:29:13.704 [2024-11-19 15:30:11.339101] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:13.704 [2024-11-19 15:30:11.339148] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:18.967 00:29:18.967 filename0: (groupid=0, jobs=1): err= 0: pid=2901938: Tue Nov 19 15:30:16 2024 00:29:18.967 read: IOPS=221, BW=27.7MiB/s (29.1MB/s)(140MiB/5043msec) 00:29:18.967 slat (nsec): min=7175, max=37640, avg=13169.38, stdev=3714.24 00:29:18.967 clat (usec): min=4506, max=59536, avg=13465.93, stdev=7771.72 00:29:18.967 lat (usec): min=4518, max=59549, avg=13479.10, stdev=7771.60 00:29:18.967 clat percentiles (usec): 00:29:18.967 | 1.00th=[ 5145], 5.00th=[ 7504], 10.00th=[ 8455], 20.00th=[ 9372], 00:29:18.967 | 30.00th=[10814], 40.00th=[11600], 50.00th=[12387], 60.00th=[13173], 00:29:18.967 | 70.00th=[13960], 80.00th=[15008], 90.00th=[16057], 95.00th=[17171], 00:29:18.967 | 99.00th=[52691], 99.50th=[54789], 99.90th=[58459], 99.95th=[59507], 00:29:18.967 | 99.99th=[59507] 00:29:18.967 bw ( KiB/s): min=18432, max=34304, per=33.65%, avg=28595.20, stdev=5016.63, samples=10 00:29:18.967 iops : min= 144, max= 268, avg=223.40, stdev=39.19, samples=10 00:29:18.968 lat (msec) : 10=23.32%, 20=73.01%, 50=1.61%, 100=2.06% 00:29:18.968 cpu : usr=91.71%, sys=7.81%, ctx=9, majf=0, minf=80 00:29:18.968 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:18.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 issued rwts: total=1119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.968 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:18.968 filename0: (groupid=0, jobs=1): err= 0: pid=2901939: Tue Nov 19 15:30:16 2024 00:29:18.968 read: IOPS=217, BW=27.1MiB/s (28.5MB/s)(137MiB/5046msec) 00:29:18.968 slat (nsec): min=6513, max=33642, avg=12732.82, stdev=3242.42 00:29:18.968 clat (usec): min=4665, max=58606, avg=13755.69, stdev=9249.27 00:29:18.968 lat (usec): min=4676, max=58624, avg=13768.43, stdev=9249.16 00:29:18.968 clat percentiles (usec): 00:29:18.968 | 1.00th=[ 5211], 5.00th=[ 7439], 10.00th=[ 8455], 20.00th=[ 9634], 00:29:18.968 | 30.00th=[10814], 40.00th=[11338], 50.00th=[11863], 60.00th=[12387], 00:29:18.968 | 70.00th=[13042], 80.00th=[14222], 90.00th=[15926], 95.00th=[46924], 00:29:18.968 | 99.00th=[53216], 99.50th=[53740], 99.90th=[58459], 99.95th=[58459], 00:29:18.968 | 99.99th=[58459] 00:29:18.968 bw ( KiB/s): min=19968, max=35584, per=32.93%, avg=27980.80, stdev=4821.22, samples=10 00:29:18.968 iops : min= 156, max= 278, avg=218.60, stdev=37.67, samples=10 00:29:18.968 lat (msec) : 10=21.81%, 20=72.81%, 50=1.92%, 100=3.47% 00:29:18.968 cpu : usr=91.58%, sys=7.93%, ctx=10, majf=0, minf=62 00:29:18.968 IO depths : 1=1.6%, 2=98.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:18.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 issued rwts: total=1096,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.968 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:18.968 filename0: (groupid=0, jobs=1): err= 0: pid=2901940: Tue Nov 19 15:30:16 2024 00:29:18.968 read: IOPS=226, BW=28.4MiB/s (29.7MB/s)(142MiB/5004msec) 00:29:18.968 slat (nsec): min=6095, max=37262, avg=12866.86, stdev=3585.03 00:29:18.968 clat (usec): min=4612, max=89313, avg=13206.00, stdev=9053.56 00:29:18.968 lat (usec): min=4624, max=89347, avg=13218.86, stdev=9053.72 00:29:18.968 clat percentiles (usec): 00:29:18.968 | 1.00th=[ 5211], 5.00th=[ 7373], 10.00th=[ 8160], 20.00th=[ 9241], 00:29:18.968 | 30.00th=[10290], 40.00th=[11207], 50.00th=[11731], 60.00th=[12256], 00:29:18.968 | 70.00th=[12780], 80.00th=[13829], 90.00th=[15401], 95.00th=[16909], 00:29:18.968 | 99.00th=[53740], 99.50th=[55837], 99.90th=[88605], 99.95th=[89654], 00:29:18.968 | 99.99th=[89654] 00:29:18.968 bw ( KiB/s): min=22016, max=34048, per=34.11%, avg=28984.40, stdev=3637.53, samples=10 00:29:18.968 iops : min= 172, max= 266, avg=226.40, stdev=28.45, samples=10 00:29:18.968 lat (msec) : 10=25.46%, 20=70.31%, 50=1.23%, 100=3.00% 00:29:18.968 cpu : usr=91.33%, sys=8.18%, ctx=12, majf=0, minf=146 00:29:18.968 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:18.968 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.968 issued rwts: total=1135,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.968 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:18.968 00:29:18.968 Run status group 0 (all jobs): 00:29:18.968 READ: bw=83.0MiB/s (87.0MB/s), 27.1MiB/s-28.4MiB/s (28.5MB/s-29.7MB/s), io=419MiB (439MB), run=5004-5046msec 00:29:18.968 15:30:16 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:18.968 15:30:16 -- target/dif.sh@43 -- # local sub 00:29:18.968 15:30:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.968 15:30:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:18.968 15:30:16 -- target/dif.sh@36 -- # local sub_id=0 00:29:18.968 15:30:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # bs=4k 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # numjobs=8 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # iodepth=16 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # runtime= 00:29:18.968 15:30:16 -- target/dif.sh@109 -- # files=2 00:29:18.968 15:30:16 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:18.968 15:30:16 -- target/dif.sh@28 -- # local sub 00:29:18.968 15:30:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.968 15:30:16 -- target/dif.sh@31 -- # create_subsystem 0 00:29:18.968 15:30:16 -- target/dif.sh@18 -- # local sub_id=0 00:29:18.968 15:30:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 bdev_null0 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 [2024-11-19 15:30:16.848376] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.968 15:30:16 -- target/dif.sh@31 -- # create_subsystem 1 00:29:18.968 15:30:16 -- target/dif.sh@18 -- # local sub_id=1 00:29:18.968 15:30:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 bdev_null1 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.968 15:30:16 -- target/dif.sh@31 -- # create_subsystem 2 00:29:18.968 15:30:16 -- target/dif.sh@18 -- # local sub_id=2 00:29:18.968 15:30:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 bdev_null2 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:18.968 15:30:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.968 15:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:18.968 15:30:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.968 15:30:16 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:18.968 15:30:16 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:18.968 15:30:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:18.968 15:30:16 -- nvmf/common.sh@520 -- # config=() 00:29:18.968 15:30:16 -- nvmf/common.sh@520 -- # local subsystem config 00:29:18.968 15:30:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.968 15:30:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.968 15:30:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.968 { 00:29:18.968 "params": { 00:29:18.968 "name": "Nvme$subsystem", 00:29:18.968 "trtype": "$TEST_TRANSPORT", 00:29:18.968 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.968 "adrfam": "ipv4", 00:29:18.968 "trsvcid": "$NVMF_PORT", 00:29:18.968 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.968 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.968 "hdgst": ${hdgst:-false}, 00:29:18.968 "ddgst": ${ddgst:-false} 00:29:18.968 }, 00:29:18.968 "method": "bdev_nvme_attach_controller" 00:29:18.968 } 00:29:18.968 EOF 00:29:18.968 )") 00:29:18.968 15:30:16 -- target/dif.sh@82 -- # gen_fio_conf 00:29:18.969 15:30:16 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.969 15:30:16 -- target/dif.sh@54 -- # local file 00:29:18.969 15:30:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:18.969 15:30:16 -- target/dif.sh@56 -- # cat 00:29:18.969 15:30:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:18.969 15:30:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:18.969 15:30:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.969 15:30:16 -- common/autotest_common.sh@1330 -- # shift 00:29:18.969 15:30:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:18.969 15:30:16 -- nvmf/common.sh@542 -- # cat 00:29:18.969 15:30:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.969 15:30:16 -- target/dif.sh@73 -- # cat 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.969 15:30:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.969 15:30:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.969 { 00:29:18.969 "params": { 00:29:18.969 "name": "Nvme$subsystem", 00:29:18.969 "trtype": "$TEST_TRANSPORT", 00:29:18.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.969 "adrfam": "ipv4", 00:29:18.969 "trsvcid": "$NVMF_PORT", 00:29:18.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.969 "hdgst": ${hdgst:-false}, 00:29:18.969 "ddgst": ${ddgst:-false} 00:29:18.969 }, 00:29:18.969 "method": "bdev_nvme_attach_controller" 00:29:18.969 } 00:29:18.969 EOF 00:29:18.969 )") 00:29:18.969 15:30:16 -- nvmf/common.sh@542 -- # cat 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.969 15:30:16 -- target/dif.sh@73 -- # cat 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:18.969 15:30:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.969 15:30:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.969 15:30:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.969 { 00:29:18.969 "params": { 00:29:18.969 "name": "Nvme$subsystem", 00:29:18.969 "trtype": "$TEST_TRANSPORT", 00:29:18.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.969 "adrfam": "ipv4", 00:29:18.969 "trsvcid": "$NVMF_PORT", 00:29:18.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.969 "hdgst": ${hdgst:-false}, 00:29:18.969 "ddgst": ${ddgst:-false} 00:29:18.969 }, 00:29:18.969 "method": "bdev_nvme_attach_controller" 00:29:18.969 } 00:29:18.969 EOF 00:29:18.969 )") 00:29:18.969 15:30:16 -- nvmf/common.sh@542 -- # cat 00:29:18.969 15:30:16 -- nvmf/common.sh@544 -- # jq . 00:29:18.969 15:30:16 -- nvmf/common.sh@545 -- # IFS=, 00:29:18.969 15:30:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:18.969 "params": { 00:29:18.969 "name": "Nvme0", 00:29:18.969 "trtype": "tcp", 00:29:18.969 "traddr": "10.0.0.2", 00:29:18.969 "adrfam": "ipv4", 00:29:18.969 "trsvcid": "4420", 00:29:18.969 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:18.969 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:18.969 "hdgst": false, 00:29:18.969 "ddgst": false 00:29:18.969 }, 00:29:18.969 "method": "bdev_nvme_attach_controller" 00:29:18.969 },{ 00:29:18.969 "params": { 00:29:18.969 "name": "Nvme1", 00:29:18.969 "trtype": "tcp", 00:29:18.969 "traddr": "10.0.0.2", 00:29:18.969 "adrfam": "ipv4", 00:29:18.969 "trsvcid": "4420", 00:29:18.969 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:18.969 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:18.969 "hdgst": false, 00:29:18.969 "ddgst": false 00:29:18.969 }, 00:29:18.969 "method": "bdev_nvme_attach_controller" 00:29:18.969 },{ 00:29:18.969 "params": { 00:29:18.969 "name": "Nvme2", 00:29:18.969 "trtype": "tcp", 00:29:18.969 "traddr": "10.0.0.2", 00:29:18.969 "adrfam": "ipv4", 00:29:18.969 "trsvcid": "4420", 00:29:18.969 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:18.969 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:18.969 "hdgst": false, 00:29:18.969 "ddgst": false 00:29:18.969 }, 00:29:18.969 "method": "bdev_nvme_attach_controller" 00:29:18.969 }' 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.969 15:30:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.969 15:30:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.969 15:30:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.969 15:30:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.969 15:30:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:18.969 15:30:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.969 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:18.969 ... 00:29:18.969 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:18.969 ... 00:29:18.969 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:18.969 ... 00:29:18.969 fio-3.35 00:29:18.969 Starting 24 threads 00:29:18.969 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.536 [2024-11-19 15:30:17.984240] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:19.536 [2024-11-19 15:30:17.984295] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:31.749 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902823: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=491, BW=1967KiB/s (2014kB/s)(19.2MiB/10021msec) 00:29:31.749 slat (usec): min=7, max=167, avg=35.50, stdev=21.59 00:29:31.749 clat (usec): min=18006, max=42089, avg=32259.63, stdev=1262.53 00:29:31.749 lat (usec): min=18014, max=42146, avg=32295.13, stdev=1262.23 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.749 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:31.749 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[33817], 00:29:31.749 | 99.00th=[34866], 99.50th=[38536], 99.90th=[40633], 99.95th=[40633], 00:29:31.749 | 99.99th=[42206] 00:29:31.749 bw ( KiB/s): min= 1792, max= 2048, per=4.17%, avg=1964.80, stdev=75.15, samples=20 00:29:31.749 iops : min= 448, max= 512, avg=491.20, stdev=18.79, samples=20 00:29:31.749 lat (msec) : 20=0.32%, 50=99.68% 00:29:31.749 cpu : usr=96.54%, sys=1.95%, ctx=170, majf=0, minf=91 00:29:31.749 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4928,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902824: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=492, BW=1969KiB/s (2016kB/s)(19.2MiB/10009msec) 00:29:31.749 slat (usec): min=8, max=246, avg=49.25, stdev=24.76 00:29:31.749 clat (usec): min=9018, max=56943, avg=32023.93, stdev=2342.63 00:29:31.749 lat (usec): min=9045, max=56979, avg=32073.18, stdev=2344.58 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[24773], 5.00th=[31327], 10.00th=[31327], 20.00th=[31589], 00:29:31.749 | 30.00th=[31851], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:29:31.749 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.749 | 99.00th=[34866], 99.50th=[39584], 99.90th=[56886], 99.95th=[56886], 00:29:31.749 | 99.99th=[56886] 00:29:31.749 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.749 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.749 lat (msec) : 10=0.28%, 20=0.37%, 50=98.98%, 100=0.37% 00:29:31.749 cpu : usr=97.08%, sys=1.70%, ctx=476, majf=0, minf=68 00:29:31.749 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4926,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902825: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=494, BW=1978KiB/s (2026kB/s)(19.4MiB/10029msec) 00:29:31.749 slat (usec): min=6, max=142, avg=31.81, stdev=21.40 00:29:31.749 clat (usec): min=4666, max=46732, avg=32087.30, stdev=2488.19 00:29:31.749 lat (usec): min=4683, max=46812, avg=32119.11, stdev=2489.15 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[26608], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.749 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:31.749 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[33817], 00:29:31.749 | 99.00th=[34866], 99.50th=[35390], 99.90th=[41157], 99.95th=[41681], 00:29:31.749 | 99.99th=[46924] 00:29:31.749 bw ( KiB/s): min= 1920, max= 2048, per=4.20%, avg=1977.60, stdev=65.33, samples=20 00:29:31.749 iops : min= 480, max= 512, avg=494.40, stdev=16.33, samples=20 00:29:31.749 lat (msec) : 10=0.60%, 20=0.36%, 50=99.03% 00:29:31.749 cpu : usr=96.91%, sys=1.90%, ctx=63, majf=0, minf=103 00:29:31.749 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902826: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.749 slat (usec): min=10, max=242, avg=54.94, stdev=43.12 00:29:31.749 clat (usec): min=26654, max=45162, avg=31976.38, stdev=1036.84 00:29:31.749 lat (usec): min=26702, max=45182, avg=32031.32, stdev=1043.54 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:29:31.749 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:29:31.749 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32637], 95.00th=[33424], 00:29:31.749 | 99.00th=[34866], 99.50th=[35390], 99.90th=[45351], 99.95th=[45351], 00:29:31.749 | 99.99th=[45351] 00:29:31.749 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.749 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.749 lat (msec) : 50=100.00% 00:29:31.749 cpu : usr=98.54%, sys=0.95%, ctx=32, majf=0, minf=73 00:29:31.749 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902827: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=489, BW=1958KiB/s (2005kB/s)(19.1MiB/10001msec) 00:29:31.749 slat (usec): min=8, max=158, avg=48.94, stdev=15.46 00:29:31.749 clat (usec): min=30380, max=74344, avg=32220.98, stdev=2502.42 00:29:31.749 lat (usec): min=30403, max=74369, avg=32269.92, stdev=2501.06 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31327], 20.00th=[31589], 00:29:31.749 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.749 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33424], 00:29:31.749 | 99.00th=[34866], 99.50th=[35390], 99.90th=[73925], 99.95th=[73925], 00:29:31.749 | 99.99th=[73925] 00:29:31.749 bw ( KiB/s): min= 1664, max= 2048, per=4.14%, avg=1953.68, stdev=93.89, samples=19 00:29:31.749 iops : min= 416, max= 512, avg=488.42, stdev=23.47, samples=19 00:29:31.749 lat (msec) : 50=99.67%, 100=0.33% 00:29:31.749 cpu : usr=98.63%, sys=0.94%, ctx=33, majf=0, minf=56 00:29:31.749 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902828: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=493, BW=1975KiB/s (2022kB/s)(19.3MiB/10006msec) 00:29:31.749 slat (usec): min=7, max=120, avg=48.42, stdev=18.41 00:29:31.749 clat (usec): min=8922, max=62643, avg=31947.46, stdev=3004.16 00:29:31.749 lat (usec): min=8937, max=62682, avg=31995.88, stdev=3006.61 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[19006], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:29:31.749 | 30.00th=[31851], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:29:31.749 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.749 | 99.00th=[34866], 99.50th=[53740], 99.90th=[62653], 99.95th=[62653], 00:29:31.749 | 99.99th=[62653] 00:29:31.749 bw ( KiB/s): min= 1664, max= 2096, per=4.17%, avg=1965.47, stdev=101.79, samples=19 00:29:31.749 iops : min= 416, max= 524, avg=491.37, stdev=25.45, samples=19 00:29:31.749 lat (msec) : 10=0.32%, 20=1.09%, 50=98.02%, 100=0.57% 00:29:31.749 cpu : usr=97.59%, sys=1.37%, ctx=103, majf=0, minf=91 00:29:31.749 IO depths : 1=5.6%, 2=11.6%, 4=24.2%, 8=51.6%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:31.749 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.749 issued rwts: total=4940,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.749 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.749 filename0: (groupid=0, jobs=1): err= 0: pid=2902829: Tue Nov 19 15:30:28 2024 00:29:31.749 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.749 slat (usec): min=7, max=232, avg=44.83, stdev=38.13 00:29:31.749 clat (usec): min=28298, max=45668, avg=32115.00, stdev=1021.94 00:29:31.749 lat (usec): min=28341, max=45704, avg=32159.83, stdev=1024.01 00:29:31.749 clat percentiles (usec): 00:29:31.749 | 1.00th=[31065], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.749 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:29:31.749 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.749 | 99.00th=[34866], 99.50th=[35390], 99.90th=[44827], 99.95th=[44827], 00:29:31.750 | 99.99th=[45876] 00:29:31.750 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=73.20, samples=19 00:29:31.750 iops : min= 448, max= 512, avg=490.11, stdev=18.30, samples=19 00:29:31.750 lat (msec) : 50=100.00% 00:29:31.750 cpu : usr=98.08%, sys=1.15%, ctx=245, majf=0, minf=69 00:29:31.750 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename0: (groupid=0, jobs=1): err= 0: pid=2902830: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.750 slat (usec): min=7, max=109, avg=45.09, stdev=19.82 00:29:31.750 clat (usec): min=28729, max=44940, avg=32212.32, stdev=1006.39 00:29:31.750 lat (usec): min=28757, max=44973, avg=32257.40, stdev=1004.82 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[31065], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.750 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.750 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.750 | 99.00th=[34866], 99.50th=[34866], 99.90th=[44827], 99.95th=[44827], 00:29:31.750 | 99.99th=[44827] 00:29:31.750 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.750 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.750 lat (msec) : 50=100.00% 00:29:31.750 cpu : usr=98.52%, sys=1.05%, ctx=16, majf=0, minf=90 00:29:31.750 IO depths : 1=5.9%, 2=12.1%, 4=24.9%, 8=50.5%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902831: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=494, BW=1978KiB/s (2026kB/s)(19.4MiB/10028msec) 00:29:31.750 slat (usec): min=6, max=204, avg=30.69, stdev=26.89 00:29:31.750 clat (usec): min=4525, max=41192, avg=32065.68, stdev=2584.52 00:29:31.750 lat (usec): min=4561, max=41226, avg=32096.38, stdev=2583.20 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[23462], 5.00th=[31065], 10.00th=[31327], 20.00th=[31851], 00:29:31.750 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:31.750 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[34341], 00:29:31.750 | 99.00th=[34866], 99.50th=[38011], 99.90th=[41157], 99.95th=[41157], 00:29:31.750 | 99.99th=[41157] 00:29:31.750 bw ( KiB/s): min= 1920, max= 2048, per=4.20%, avg=1977.60, stdev=65.33, samples=20 00:29:31.750 iops : min= 480, max= 512, avg=494.40, stdev=16.33, samples=20 00:29:31.750 lat (msec) : 10=0.65%, 20=0.32%, 50=99.03% 00:29:31.750 cpu : usr=97.97%, sys=1.27%, ctx=95, majf=0, minf=118 00:29:31.750 IO depths : 1=5.7%, 2=11.9%, 4=24.7%, 8=50.9%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902832: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=491, BW=1964KiB/s (2011kB/s)(19.2MiB/10004msec) 00:29:31.750 slat (usec): min=7, max=102, avg=47.04, stdev=15.47 00:29:31.750 clat (usec): min=15666, max=68717, avg=32151.04, stdev=2051.90 00:29:31.750 lat (usec): min=15691, max=68735, avg=32198.08, stdev=2051.73 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.750 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.750 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.750 | 99.00th=[34866], 99.50th=[35390], 99.90th=[60556], 99.95th=[60556], 00:29:31.750 | 99.99th=[68682] 00:29:31.750 bw ( KiB/s): min= 1664, max= 2048, per=4.16%, avg=1960.42, stdev=95.91, samples=19 00:29:31.750 iops : min= 416, max= 512, avg=490.11, stdev=23.98, samples=19 00:29:31.750 lat (msec) : 20=0.33%, 50=99.35%, 100=0.33% 00:29:31.750 cpu : usr=98.93%, sys=0.66%, ctx=13, majf=0, minf=62 00:29:31.750 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902833: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=491, BW=1966KiB/s (2014kB/s)(19.2MiB/10024msec) 00:29:31.750 slat (usec): min=7, max=222, avg=41.30, stdev=23.68 00:29:31.750 clat (usec): min=20839, max=40616, avg=32206.02, stdev=1073.20 00:29:31.750 lat (usec): min=20846, max=40706, avg=32247.32, stdev=1071.90 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.750 | 30.00th=[31851], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:31.750 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[33817], 00:29:31.750 | 99.00th=[34866], 99.50th=[34866], 99.90th=[40109], 99.95th=[40633], 00:29:31.750 | 99.99th=[40633] 00:29:31.750 bw ( KiB/s): min= 1792, max= 2048, per=4.17%, avg=1964.80, stdev=75.15, samples=20 00:29:31.750 iops : min= 448, max= 512, avg=491.20, stdev=18.79, samples=20 00:29:31.750 lat (msec) : 50=100.00% 00:29:31.750 cpu : usr=94.51%, sys=2.86%, ctx=324, majf=0, minf=74 00:29:31.750 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4928,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902834: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=490, BW=1963KiB/s (2010kB/s)(19.2MiB/10010msec) 00:29:31.750 slat (usec): min=15, max=143, avg=49.71, stdev=15.35 00:29:31.750 clat (usec): min=15635, max=67184, avg=32156.04, stdev=2304.81 00:29:31.750 lat (usec): min=15671, max=67215, avg=32205.75, stdev=2304.75 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31327], 20.00th=[31589], 00:29:31.750 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.750 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33424], 00:29:31.750 | 99.00th=[34866], 99.50th=[35390], 99.90th=[66847], 99.95th=[67634], 00:29:31.750 | 99.99th=[67634] 00:29:31.750 bw ( KiB/s): min= 1664, max= 2048, per=4.16%, avg=1960.42, stdev=95.91, samples=19 00:29:31.750 iops : min= 416, max= 512, avg=490.11, stdev=23.98, samples=19 00:29:31.750 lat (msec) : 20=0.33%, 50=99.35%, 100=0.33% 00:29:31.750 cpu : usr=98.43%, sys=0.99%, ctx=36, majf=0, minf=67 00:29:31.750 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902835: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.750 slat (usec): min=11, max=125, avg=47.79, stdev=15.01 00:29:31.750 clat (usec): min=30391, max=45150, avg=32177.54, stdev=1012.49 00:29:31.750 lat (usec): min=30445, max=45170, avg=32225.33, stdev=1010.78 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.750 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.750 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.750 | 99.00th=[34866], 99.50th=[35390], 99.90th=[44827], 99.95th=[45351], 00:29:31.750 | 99.99th=[45351] 00:29:31.750 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.750 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.750 lat (msec) : 50=100.00% 00:29:31.750 cpu : usr=95.63%, sys=2.50%, ctx=283, majf=0, minf=97 00:29:31.750 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902836: Tue Nov 19 15:30:28 2024 00:29:31.750 read: IOPS=492, BW=1970KiB/s (2017kB/s)(19.2MiB/10006msec) 00:29:31.750 slat (usec): min=9, max=144, avg=48.21, stdev=14.71 00:29:31.750 clat (usec): min=8972, max=53904, avg=32031.26, stdev=2132.73 00:29:31.750 lat (usec): min=9008, max=53944, avg=32079.47, stdev=2133.99 00:29:31.750 clat percentiles (usec): 00:29:31.750 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:29:31.750 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.750 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33424], 00:29:31.750 | 99.00th=[34866], 99.50th=[35390], 99.90th=[53740], 99.95th=[53740], 00:29:31.750 | 99.99th=[53740] 00:29:31.750 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.750 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.750 lat (msec) : 10=0.32%, 20=0.32%, 50=99.03%, 100=0.32% 00:29:31.750 cpu : usr=98.02%, sys=1.23%, ctx=192, majf=0, minf=78 00:29:31.750 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.750 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.750 issued rwts: total=4928,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.750 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.750 filename1: (groupid=0, jobs=1): err= 0: pid=2902837: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.751 slat (usec): min=12, max=197, avg=45.94, stdev=21.85 00:29:31.751 clat (usec): min=29908, max=44665, avg=32207.21, stdev=929.44 00:29:31.751 lat (usec): min=29929, max=44715, avg=32253.15, stdev=927.70 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[31065], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.751 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.751 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.751 | 99.00th=[34866], 99.50th=[34866], 99.90th=[44303], 99.95th=[44303], 00:29:31.751 | 99.99th=[44827] 00:29:31.751 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.751 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.751 lat (msec) : 50=100.00% 00:29:31.751 cpu : usr=98.35%, sys=1.02%, ctx=70, majf=0, minf=63 00:29:31.751 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename1: (groupid=0, jobs=1): err= 0: pid=2902838: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=491, BW=1964KiB/s (2012kB/s)(19.2MiB/10002msec) 00:29:31.751 slat (usec): min=7, max=217, avg=27.78, stdev=27.68 00:29:31.751 clat (usec): min=15651, max=78306, avg=32317.59, stdev=2142.00 00:29:31.751 lat (usec): min=15670, max=78350, avg=32345.37, stdev=2139.92 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[30016], 5.00th=[31065], 10.00th=[31327], 20.00th=[31851], 00:29:31.751 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:31.751 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[34341], 00:29:31.751 | 99.00th=[35390], 99.50th=[39060], 99.90th=[58459], 99.95th=[58459], 00:29:31.751 | 99.99th=[78119] 00:29:31.751 bw ( KiB/s): min= 1664, max= 2048, per=4.16%, avg=1960.42, stdev=95.91, samples=19 00:29:31.751 iops : min= 416, max= 512, avg=490.11, stdev=23.98, samples=19 00:29:31.751 lat (msec) : 20=0.33%, 50=99.35%, 100=0.33% 00:29:31.751 cpu : usr=96.16%, sys=2.07%, ctx=216, majf=0, minf=86 00:29:31.751 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902839: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=496, BW=1985KiB/s (2033kB/s)(19.4MiB/10027msec) 00:29:31.751 slat (usec): min=5, max=123, avg=20.56, stdev=11.39 00:29:31.751 clat (usec): min=3949, max=41546, avg=32041.67, stdev=3027.69 00:29:31.751 lat (usec): min=3996, max=41563, avg=32062.24, stdev=3026.86 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[11076], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.751 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:31.751 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[33817], 00:29:31.751 | 99.00th=[34866], 99.50th=[35914], 99.90th=[41157], 99.95th=[41681], 00:29:31.751 | 99.99th=[41681] 00:29:31.751 bw ( KiB/s): min= 1920, max= 2176, per=4.21%, avg=1984.00, stdev=77.69, samples=20 00:29:31.751 iops : min= 480, max= 544, avg=496.00, stdev=19.42, samples=20 00:29:31.751 lat (msec) : 4=0.04%, 10=0.92%, 20=0.32%, 50=98.71% 00:29:31.751 cpu : usr=96.82%, sys=1.73%, ctx=120, majf=0, minf=128 00:29:31.751 IO depths : 1=5.9%, 2=12.1%, 4=24.8%, 8=50.6%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902840: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.751 slat (usec): min=7, max=154, avg=34.43, stdev=18.80 00:29:31.751 clat (usec): min=28632, max=44911, avg=32320.07, stdev=1030.91 00:29:31.751 lat (usec): min=28688, max=44945, avg=32354.50, stdev=1028.32 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[31065], 5.00th=[31327], 10.00th=[31589], 20.00th=[31851], 00:29:31.751 | 30.00th=[31851], 40.00th=[32113], 50.00th=[32113], 60.00th=[32375], 00:29:31.751 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[34341], 00:29:31.751 | 99.00th=[34866], 99.50th=[35914], 99.90th=[44827], 99.95th=[44827], 00:29:31.751 | 99.99th=[44827] 00:29:31.751 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.751 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.751 lat (msec) : 50=100.00% 00:29:31.751 cpu : usr=96.23%, sys=1.96%, ctx=303, majf=0, minf=90 00:29:31.751 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902841: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=490, BW=1961KiB/s (2008kB/s)(19.2MiB/10006msec) 00:29:31.751 slat (usec): min=7, max=209, avg=37.17, stdev=30.31 00:29:31.751 clat (usec): min=7254, max=86069, avg=32400.32, stdev=3859.72 00:29:31.751 lat (usec): min=7263, max=86117, avg=32437.49, stdev=3860.31 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[18220], 5.00th=[30802], 10.00th=[31327], 20.00th=[31851], 00:29:31.751 | 30.00th=[32113], 40.00th=[32113], 50.00th=[32375], 60.00th=[32375], 00:29:31.751 | 70.00th=[32637], 80.00th=[32637], 90.00th=[33162], 95.00th=[34341], 00:29:31.751 | 99.00th=[51643], 99.50th=[61604], 99.90th=[62129], 99.95th=[62653], 00:29:31.751 | 99.99th=[86508] 00:29:31.751 bw ( KiB/s): min= 1664, max= 2048, per=4.14%, avg=1952.84, stdev=86.78, samples=19 00:29:31.751 iops : min= 416, max= 512, avg=488.21, stdev=21.69, samples=19 00:29:31.751 lat (msec) : 10=0.24%, 20=1.30%, 50=97.39%, 100=1.06% 00:29:31.751 cpu : usr=98.53%, sys=0.96%, ctx=23, majf=0, minf=91 00:29:31.751 IO depths : 1=0.1%, 2=2.0%, 4=8.3%, 8=73.3%, 16=16.3%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=91.0%, 8=7.1%, 16=1.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4906,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902842: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=490, BW=1963KiB/s (2010kB/s)(19.2MiB/10010msec) 00:29:31.751 slat (usec): min=7, max=152, avg=48.51, stdev=19.44 00:29:31.751 clat (usec): min=12800, max=66974, avg=32156.32, stdev=2325.38 00:29:31.751 lat (usec): min=12811, max=67007, avg=32204.83, stdev=2324.53 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.751 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.751 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.751 | 99.00th=[34866], 99.50th=[35390], 99.90th=[66847], 99.95th=[66847], 00:29:31.751 | 99.99th=[66847] 00:29:31.751 bw ( KiB/s): min= 1667, max= 2048, per=4.16%, avg=1960.58, stdev=95.39, samples=19 00:29:31.751 iops : min= 416, max= 512, avg=490.11, stdev=23.98, samples=19 00:29:31.751 lat (msec) : 20=0.33%, 50=99.35%, 100=0.33% 00:29:31.751 cpu : usr=98.50%, sys=0.92%, ctx=33, majf=0, minf=73 00:29:31.751 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902843: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=491, BW=1967KiB/s (2014kB/s)(19.2MiB/10021msec) 00:29:31.751 slat (usec): min=8, max=116, avg=48.61, stdev=21.25 00:29:31.751 clat (usec): min=18054, max=40620, avg=32157.60, stdev=1167.86 00:29:31.751 lat (usec): min=18063, max=40727, avg=32206.21, stdev=1168.37 00:29:31.751 clat percentiles (usec): 00:29:31.751 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.751 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.751 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32900], 95.00th=[33817], 00:29:31.751 | 99.00th=[34866], 99.50th=[35390], 99.90th=[40633], 99.95th=[40633], 00:29:31.751 | 99.99th=[40633] 00:29:31.751 bw ( KiB/s): min= 1792, max= 2048, per=4.17%, avg=1964.80, stdev=75.15, samples=20 00:29:31.751 iops : min= 448, max= 512, avg=491.20, stdev=18.79, samples=20 00:29:31.751 lat (msec) : 20=0.32%, 50=99.68% 00:29:31.751 cpu : usr=98.69%, sys=0.88%, ctx=20, majf=0, minf=98 00:29:31.751 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.751 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.751 issued rwts: total=4928,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.751 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.751 filename2: (groupid=0, jobs=1): err= 0: pid=2902844: Tue Nov 19 15:30:28 2024 00:29:31.751 read: IOPS=491, BW=1964KiB/s (2012kB/s)(19.2MiB/10006msec) 00:29:31.751 slat (usec): min=7, max=125, avg=40.89, stdev=24.76 00:29:31.751 clat (usec): min=8921, max=62502, avg=32264.25, stdev=3016.99 00:29:31.751 lat (usec): min=8929, max=62537, avg=32305.14, stdev=3018.23 00:29:31.751 clat percentiles (usec): 00:29:31.752 | 1.00th=[23200], 5.00th=[31327], 10.00th=[31589], 20.00th=[31589], 00:29:31.752 | 30.00th=[31851], 40.00th=[31851], 50.00th=[32113], 60.00th=[32113], 00:29:31.752 | 70.00th=[32375], 80.00th=[32637], 90.00th=[32900], 95.00th=[34341], 00:29:31.752 | 99.00th=[41681], 99.50th=[55313], 99.90th=[62129], 99.95th=[62653], 00:29:31.752 | 99.99th=[62653] 00:29:31.752 bw ( KiB/s): min= 1632, max= 2048, per=4.15%, avg=1954.53, stdev=91.76, samples=19 00:29:31.752 iops : min= 408, max= 512, avg=488.63, stdev=22.94, samples=19 00:29:31.752 lat (msec) : 10=0.33%, 20=0.39%, 50=98.64%, 100=0.65% 00:29:31.752 cpu : usr=98.70%, sys=0.89%, ctx=13, majf=0, minf=59 00:29:31.752 IO depths : 1=3.0%, 2=5.9%, 4=13.2%, 8=65.5%, 16=12.4%, 32=0.0%, >=64=0.0% 00:29:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 complete : 0=0.0%, 4=91.8%, 8=5.2%, 16=3.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 issued rwts: total=4914,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.752 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.752 filename2: (groupid=0, jobs=1): err= 0: pid=2902845: Tue Nov 19 15:30:28 2024 00:29:31.752 read: IOPS=492, BW=1969KiB/s (2016kB/s)(19.2MiB/10009msec) 00:29:31.752 slat (usec): min=9, max=186, avg=53.33, stdev=21.76 00:29:31.752 clat (usec): min=8965, max=56637, avg=31973.11, stdev=2170.28 00:29:31.752 lat (usec): min=8987, max=56684, avg=32026.44, stdev=2172.51 00:29:31.752 clat percentiles (usec): 00:29:31.752 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31327], 20.00th=[31589], 00:29:31.752 | 30.00th=[31589], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:29:31.752 | 70.00th=[32113], 80.00th=[32375], 90.00th=[32637], 95.00th=[33424], 00:29:31.752 | 99.00th=[34866], 99.50th=[34866], 99.90th=[56361], 99.95th=[56361], 00:29:31.752 | 99.99th=[56886] 00:29:31.752 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.752 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.752 lat (msec) : 10=0.28%, 20=0.32%, 50=99.07%, 100=0.32% 00:29:31.752 cpu : usr=98.86%, sys=0.72%, ctx=15, majf=0, minf=61 00:29:31.752 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 issued rwts: total=4926,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.752 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.752 filename2: (groupid=0, jobs=1): err= 0: pid=2902846: Tue Nov 19 15:30:28 2024 00:29:31.752 read: IOPS=490, BW=1963KiB/s (2011kB/s)(19.2MiB/10007msec) 00:29:31.752 slat (usec): min=11, max=135, avg=53.73, stdev=18.38 00:29:31.752 clat (usec): min=30414, max=45111, avg=32117.46, stdev=1010.02 00:29:31.752 lat (usec): min=30445, max=45131, avg=32171.19, stdev=1009.93 00:29:31.752 clat percentiles (usec): 00:29:31.752 | 1.00th=[30802], 5.00th=[31327], 10.00th=[31327], 20.00th=[31589], 00:29:31.752 | 30.00th=[31851], 40.00th=[31851], 50.00th=[31851], 60.00th=[32113], 00:29:31.752 | 70.00th=[32375], 80.00th=[32375], 90.00th=[32637], 95.00th=[33817], 00:29:31.752 | 99.00th=[34866], 99.50th=[35390], 99.90th=[44827], 99.95th=[44827], 00:29:31.752 | 99.99th=[45351] 00:29:31.752 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1960.42, stdev=74.55, samples=19 00:29:31.752 iops : min= 448, max= 512, avg=490.11, stdev=18.64, samples=19 00:29:31.752 lat (msec) : 50=100.00% 00:29:31.752 cpu : usr=98.73%, sys=0.86%, ctx=19, majf=0, minf=55 00:29:31.752 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.752 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.752 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:31.752 00:29:31.752 Run status group 0 (all jobs): 00:29:31.752 READ: bw=46.0MiB/s (48.3MB/s), 1958KiB/s-1985KiB/s (2005kB/s-2033kB/s), io=462MiB (484MB), run=10001-10029msec 00:29:31.752 15:30:28 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:31.752 15:30:28 -- target/dif.sh@43 -- # local sub 00:29:31.752 15:30:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.752 15:30:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:31.752 15:30:28 -- target/dif.sh@36 -- # local sub_id=0 00:29:31.752 15:30:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.752 15:30:28 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:31.752 15:30:28 -- target/dif.sh@36 -- # local sub_id=1 00:29:31.752 15:30:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:31.752 15:30:28 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:31.752 15:30:28 -- target/dif.sh@36 -- # local sub_id=2 00:29:31.752 15:30:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # numjobs=2 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # iodepth=8 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # runtime=5 00:29:31.752 15:30:28 -- target/dif.sh@115 -- # files=1 00:29:31.752 15:30:28 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:31.752 15:30:28 -- target/dif.sh@28 -- # local sub 00:29:31.752 15:30:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:31.752 15:30:28 -- target/dif.sh@31 -- # create_subsystem 0 00:29:31.752 15:30:28 -- target/dif.sh@18 -- # local sub_id=0 00:29:31.752 15:30:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 bdev_null0 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 [2024-11-19 15:30:28.535414] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:31.752 15:30:28 -- target/dif.sh@31 -- # create_subsystem 1 00:29:31.752 15:30:28 -- target/dif.sh@18 -- # local sub_id=1 00:29:31.752 15:30:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 bdev_null1 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:31.752 15:30:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.752 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:29:31.752 15:30:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.752 15:30:28 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:31.752 15:30:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.752 15:30:28 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.752 15:30:28 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:31.752 15:30:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:31.752 15:30:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:31.752 15:30:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:31.752 15:30:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:31.752 15:30:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.752 15:30:28 -- target/dif.sh@82 -- # gen_fio_conf 00:29:31.752 15:30:28 -- nvmf/common.sh@520 -- # config=() 00:29:31.753 15:30:28 -- common/autotest_common.sh@1330 -- # shift 00:29:31.753 15:30:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:31.753 15:30:28 -- nvmf/common.sh@520 -- # local subsystem config 00:29:31.753 15:30:28 -- target/dif.sh@54 -- # local file 00:29:31.753 15:30:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.753 15:30:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:31.753 15:30:28 -- target/dif.sh@56 -- # cat 00:29:31.753 15:30:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:31.753 { 00:29:31.753 "params": { 00:29:31.753 "name": "Nvme$subsystem", 00:29:31.753 "trtype": "$TEST_TRANSPORT", 00:29:31.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:31.753 "adrfam": "ipv4", 00:29:31.753 "trsvcid": "$NVMF_PORT", 00:29:31.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:31.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:31.753 "hdgst": ${hdgst:-false}, 00:29:31.753 "ddgst": ${ddgst:-false} 00:29:31.753 }, 00:29:31.753 "method": "bdev_nvme_attach_controller" 00:29:31.753 } 00:29:31.753 EOF 00:29:31.753 )") 00:29:31.753 15:30:28 -- nvmf/common.sh@542 -- # cat 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.753 15:30:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:31.753 15:30:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:31.753 15:30:28 -- target/dif.sh@73 -- # cat 00:29:31.753 15:30:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:31.753 15:30:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:31.753 { 00:29:31.753 "params": { 00:29:31.753 "name": "Nvme$subsystem", 00:29:31.753 "trtype": "$TEST_TRANSPORT", 00:29:31.753 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:31.753 "adrfam": "ipv4", 00:29:31.753 "trsvcid": "$NVMF_PORT", 00:29:31.753 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:31.753 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:31.753 "hdgst": ${hdgst:-false}, 00:29:31.753 "ddgst": ${ddgst:-false} 00:29:31.753 }, 00:29:31.753 "method": "bdev_nvme_attach_controller" 00:29:31.753 } 00:29:31.753 EOF 00:29:31.753 )") 00:29:31.753 15:30:28 -- target/dif.sh@72 -- # (( file++ )) 00:29:31.753 15:30:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:31.753 15:30:28 -- nvmf/common.sh@542 -- # cat 00:29:31.753 15:30:28 -- nvmf/common.sh@544 -- # jq . 00:29:31.753 15:30:28 -- nvmf/common.sh@545 -- # IFS=, 00:29:31.753 15:30:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:31.753 "params": { 00:29:31.753 "name": "Nvme0", 00:29:31.753 "trtype": "tcp", 00:29:31.753 "traddr": "10.0.0.2", 00:29:31.753 "adrfam": "ipv4", 00:29:31.753 "trsvcid": "4420", 00:29:31.753 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:31.753 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:31.753 "hdgst": false, 00:29:31.753 "ddgst": false 00:29:31.753 }, 00:29:31.753 "method": "bdev_nvme_attach_controller" 00:29:31.753 },{ 00:29:31.753 "params": { 00:29:31.753 "name": "Nvme1", 00:29:31.753 "trtype": "tcp", 00:29:31.753 "traddr": "10.0.0.2", 00:29:31.753 "adrfam": "ipv4", 00:29:31.753 "trsvcid": "4420", 00:29:31.753 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:31.753 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:31.753 "hdgst": false, 00:29:31.753 "ddgst": false 00:29:31.753 }, 00:29:31.753 "method": "bdev_nvme_attach_controller" 00:29:31.753 }' 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.753 15:30:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.753 15:30:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.753 15:30:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.753 15:30:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.753 15:30:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:31.753 15:30:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:31.753 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:31.753 ... 00:29:31.753 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:31.753 ... 00:29:31.753 fio-3.35 00:29:31.753 Starting 4 threads 00:29:31.753 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.753 [2024-11-19 15:30:29.477265] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:31.753 [2024-11-19 15:30:29.477320] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:37.023 00:29:37.023 filename0: (groupid=0, jobs=1): err= 0: pid=2904146: Tue Nov 19 15:30:34 2024 00:29:37.023 read: IOPS=1881, BW=14.7MiB/s (15.4MB/s)(73.6MiB/5003msec) 00:29:37.023 slat (usec): min=5, max=1884, avg=14.59, stdev=21.08 00:29:37.023 clat (usec): min=861, max=8726, avg=4200.90, stdev=642.04 00:29:37.023 lat (usec): min=879, max=8761, avg=4215.49, stdev=642.57 00:29:37.023 clat percentiles (usec): 00:29:37.023 | 1.00th=[ 2442], 5.00th=[ 3130], 10.00th=[ 3392], 20.00th=[ 3720], 00:29:37.023 | 30.00th=[ 3982], 40.00th=[ 4146], 50.00th=[ 4293], 60.00th=[ 4424], 00:29:37.023 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4752], 95.00th=[ 5014], 00:29:37.023 | 99.00th=[ 6128], 99.50th=[ 6652], 99.90th=[ 7439], 99.95th=[ 8455], 00:29:37.023 | 99.99th=[ 8717] 00:29:37.023 bw ( KiB/s): min=14176, max=17120, per=26.06%, avg=15056.00, stdev=912.11, samples=10 00:29:37.023 iops : min= 1772, max= 2140, avg=1882.00, stdev=114.01, samples=10 00:29:37.023 lat (usec) : 1000=0.01% 00:29:37.023 lat (msec) : 2=0.31%, 4=30.09%, 10=69.59% 00:29:37.023 cpu : usr=95.48%, sys=4.04%, ctx=12, majf=0, minf=59 00:29:37.023 IO depths : 1=0.2%, 2=13.4%, 4=58.6%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.023 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 issued rwts: total=9415,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.023 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.023 filename0: (groupid=0, jobs=1): err= 0: pid=2904147: Tue Nov 19 15:30:34 2024 00:29:37.023 read: IOPS=1776, BW=13.9MiB/s (14.6MB/s)(69.4MiB/5002msec) 00:29:37.023 slat (nsec): min=5140, max=72024, avg=16400.19, stdev=9530.18 00:29:37.023 clat (usec): min=913, max=8218, avg=4447.18, stdev=748.11 00:29:37.023 lat (usec): min=926, max=8231, avg=4463.58, stdev=747.93 00:29:37.023 clat percentiles (usec): 00:29:37.023 | 1.00th=[ 2671], 5.00th=[ 3458], 10.00th=[ 3720], 20.00th=[ 4015], 00:29:37.023 | 30.00th=[ 4178], 40.00th=[ 4293], 50.00th=[ 4424], 60.00th=[ 4490], 00:29:37.023 | 70.00th=[ 4555], 80.00th=[ 4686], 90.00th=[ 5211], 95.00th=[ 5932], 00:29:37.023 | 99.00th=[ 7177], 99.50th=[ 7570], 99.90th=[ 7963], 99.95th=[ 8029], 00:29:37.023 | 99.99th=[ 8225] 00:29:37.023 bw ( KiB/s): min=13648, max=15088, per=24.65%, avg=14241.78, stdev=456.45, samples=9 00:29:37.023 iops : min= 1706, max= 1886, avg=1780.22, stdev=57.06, samples=9 00:29:37.023 lat (usec) : 1000=0.06% 00:29:37.023 lat (msec) : 2=0.43%, 4=18.11%, 10=81.40% 00:29:37.023 cpu : usr=94.56%, sys=4.90%, ctx=12, majf=0, minf=55 00:29:37.023 IO depths : 1=0.1%, 2=10.3%, 4=60.6%, 8=29.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.023 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 complete : 0=0.0%, 4=93.5%, 8=6.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 issued rwts: total=8888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.023 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.023 filename1: (groupid=0, jobs=1): err= 0: pid=2904148: Tue Nov 19 15:30:34 2024 00:29:37.023 read: IOPS=1769, BW=13.8MiB/s (14.5MB/s)(69.2MiB/5003msec) 00:29:37.023 slat (nsec): min=5143, max=72305, avg=15285.32, stdev=8614.85 00:29:37.023 clat (usec): min=820, max=8149, avg=4469.21, stdev=664.61 00:29:37.023 lat (usec): min=833, max=8182, avg=4484.49, stdev=664.13 00:29:37.023 clat percentiles (usec): 00:29:37.023 | 1.00th=[ 2835], 5.00th=[ 3621], 10.00th=[ 3851], 20.00th=[ 4080], 00:29:37.023 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:29:37.023 | 70.00th=[ 4555], 80.00th=[ 4686], 90.00th=[ 5145], 95.00th=[ 5669], 00:29:37.023 | 99.00th=[ 6980], 99.50th=[ 7308], 99.90th=[ 7832], 99.95th=[ 8094], 00:29:37.023 | 99.99th=[ 8160] 00:29:37.023 bw ( KiB/s): min=13616, max=14704, per=24.50%, avg=14155.20, stdev=296.76, samples=10 00:29:37.023 iops : min= 1702, max= 1838, avg=1769.40, stdev=37.10, samples=10 00:29:37.023 lat (usec) : 1000=0.02% 00:29:37.023 lat (msec) : 2=0.25%, 4=14.72%, 10=85.01% 00:29:37.023 cpu : usr=95.18%, sys=4.28%, ctx=8, majf=0, minf=43 00:29:37.023 IO depths : 1=0.1%, 2=10.7%, 4=61.4%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.023 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 issued rwts: total=8853,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.023 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.023 filename1: (groupid=0, jobs=1): err= 0: pid=2904149: Tue Nov 19 15:30:34 2024 00:29:37.023 read: IOPS=1793, BW=14.0MiB/s (14.7MB/s)(70.1MiB/5001msec) 00:29:37.023 slat (nsec): min=6186, max=75926, avg=18251.56, stdev=8497.75 00:29:37.023 clat (usec): min=827, max=8126, avg=4395.09, stdev=655.91 00:29:37.023 lat (usec): min=846, max=8134, avg=4413.34, stdev=655.97 00:29:37.023 clat percentiles (usec): 00:29:37.023 | 1.00th=[ 2835], 5.00th=[ 3425], 10.00th=[ 3720], 20.00th=[ 4015], 00:29:37.023 | 30.00th=[ 4178], 40.00th=[ 4293], 50.00th=[ 4424], 60.00th=[ 4490], 00:29:37.023 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 5080], 95.00th=[ 5538], 00:29:37.023 | 99.00th=[ 6783], 99.50th=[ 7046], 99.90th=[ 7767], 99.95th=[ 7898], 00:29:37.023 | 99.99th=[ 8160] 00:29:37.023 bw ( KiB/s): min=13995, max=15120, per=24.84%, avg=14348.30, stdev=381.52, samples=10 00:29:37.023 iops : min= 1749, max= 1890, avg=1793.50, stdev=47.73, samples=10 00:29:37.023 lat (usec) : 1000=0.01% 00:29:37.023 lat (msec) : 2=0.41%, 4=18.81%, 10=80.77% 00:29:37.023 cpu : usr=95.30%, sys=4.18%, ctx=12, majf=0, minf=27 00:29:37.023 IO depths : 1=0.1%, 2=14.1%, 4=58.0%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.023 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.023 issued rwts: total=8971,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.023 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:37.023 00:29:37.023 Run status group 0 (all jobs): 00:29:37.023 READ: bw=56.4MiB/s (59.2MB/s), 13.8MiB/s-14.7MiB/s (14.5MB/s-15.4MB/s), io=282MiB (296MB), run=5001-5003msec 00:29:37.023 15:30:34 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:37.023 15:30:34 -- target/dif.sh@43 -- # local sub 00:29:37.023 15:30:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.023 15:30:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:37.023 15:30:34 -- target/dif.sh@36 -- # local sub_id=0 00:29:37.023 15:30:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:37.023 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.023 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.023 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.023 15:30:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:37.023 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.023 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.023 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.023 15:30:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.023 15:30:34 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:37.023 15:30:34 -- target/dif.sh@36 -- # local sub_id=1 00:29:37.023 15:30:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:37.023 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.023 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.023 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.023 15:30:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:37.023 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.023 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.023 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.023 00:29:37.023 real 0m24.429s 00:29:37.023 user 4m32.407s 00:29:37.023 sys 0m6.371s 00:29:37.023 15:30:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.023 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.023 ************************************ 00:29:37.024 END TEST fio_dif_rand_params 00:29:37.024 ************************************ 00:29:37.024 15:30:34 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:37.024 15:30:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:37.024 15:30:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:37.024 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.024 ************************************ 00:29:37.024 START TEST fio_dif_digest 00:29:37.024 ************************************ 00:29:37.024 15:30:34 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:37.024 15:30:34 -- target/dif.sh@123 -- # local NULL_DIF 00:29:37.024 15:30:34 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:37.024 15:30:34 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:37.024 15:30:34 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:37.024 15:30:34 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:37.024 15:30:34 -- target/dif.sh@127 -- # numjobs=3 00:29:37.024 15:30:34 -- target/dif.sh@127 -- # iodepth=3 00:29:37.024 15:30:34 -- target/dif.sh@127 -- # runtime=10 00:29:37.024 15:30:34 -- target/dif.sh@128 -- # hdgst=true 00:29:37.024 15:30:34 -- target/dif.sh@128 -- # ddgst=true 00:29:37.024 15:30:34 -- target/dif.sh@130 -- # create_subsystems 0 00:29:37.024 15:30:34 -- target/dif.sh@28 -- # local sub 00:29:37.024 15:30:34 -- target/dif.sh@30 -- # for sub in "$@" 00:29:37.024 15:30:34 -- target/dif.sh@31 -- # create_subsystem 0 00:29:37.024 15:30:34 -- target/dif.sh@18 -- # local sub_id=0 00:29:37.024 15:30:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:37.024 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.024 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.024 bdev_null0 00:29:37.024 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.024 15:30:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:37.024 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.024 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.024 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.024 15:30:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:37.024 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.024 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.024 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.024 15:30:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:37.024 15:30:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.024 15:30:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.024 [2024-11-19 15:30:34.991788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:37.024 15:30:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.024 15:30:34 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:37.024 15:30:34 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:37.024 15:30:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:37.024 15:30:34 -- nvmf/common.sh@520 -- # config=() 00:29:37.024 15:30:34 -- nvmf/common.sh@520 -- # local subsystem config 00:29:37.024 15:30:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:37.024 15:30:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.024 15:30:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:37.024 { 00:29:37.024 "params": { 00:29:37.024 "name": "Nvme$subsystem", 00:29:37.024 "trtype": "$TEST_TRANSPORT", 00:29:37.024 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:37.024 "adrfam": "ipv4", 00:29:37.024 "trsvcid": "$NVMF_PORT", 00:29:37.024 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:37.024 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:37.024 "hdgst": ${hdgst:-false}, 00:29:37.024 "ddgst": ${ddgst:-false} 00:29:37.024 }, 00:29:37.024 "method": "bdev_nvme_attach_controller" 00:29:37.024 } 00:29:37.024 EOF 00:29:37.024 )") 00:29:37.024 15:30:34 -- target/dif.sh@82 -- # gen_fio_conf 00:29:37.024 15:30:34 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.024 15:30:34 -- target/dif.sh@54 -- # local file 00:29:37.024 15:30:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:37.024 15:30:34 -- target/dif.sh@56 -- # cat 00:29:37.024 15:30:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:37.024 15:30:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:37.024 15:30:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.024 15:30:34 -- common/autotest_common.sh@1330 -- # shift 00:29:37.024 15:30:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:37.024 15:30:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:37.024 15:30:34 -- nvmf/common.sh@542 -- # cat 00:29:37.024 15:30:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:37.024 15:30:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.024 15:30:34 -- target/dif.sh@72 -- # (( file <= files )) 00:29:37.024 15:30:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:37.024 15:30:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:37.024 15:30:35 -- nvmf/common.sh@544 -- # jq . 00:29:37.024 15:30:35 -- nvmf/common.sh@545 -- # IFS=, 00:29:37.024 15:30:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:37.024 "params": { 00:29:37.024 "name": "Nvme0", 00:29:37.024 "trtype": "tcp", 00:29:37.024 "traddr": "10.0.0.2", 00:29:37.024 "adrfam": "ipv4", 00:29:37.024 "trsvcid": "4420", 00:29:37.024 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:37.024 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:37.024 "hdgst": true, 00:29:37.024 "ddgst": true 00:29:37.024 }, 00:29:37.024 "method": "bdev_nvme_attach_controller" 00:29:37.024 }' 00:29:37.024 15:30:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:37.024 15:30:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:37.024 15:30:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:37.024 15:30:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:37.024 15:30:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:37.024 15:30:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:37.024 15:30:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:37.024 15:30:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:37.024 15:30:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:37.024 15:30:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:37.024 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:37.024 ... 00:29:37.024 fio-3.35 00:29:37.024 Starting 3 threads 00:29:37.024 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.282 [2024-11-19 15:30:35.693469] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:37.282 [2024-11-19 15:30:35.693549] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:49.486 00:29:49.486 filename0: (groupid=0, jobs=1): err= 0: pid=2905036: Tue Nov 19 15:30:45 2024 00:29:49.486 read: IOPS=207, BW=26.0MiB/s (27.2MB/s)(261MiB/10046msec) 00:29:49.486 slat (nsec): min=6465, max=57487, avg=15617.85, stdev=3981.23 00:29:49.486 clat (usec): min=8475, max=51061, avg=14407.95, stdev=1467.51 00:29:49.486 lat (usec): min=8487, max=51074, avg=14423.57, stdev=1467.57 00:29:49.486 clat percentiles (usec): 00:29:49.486 | 1.00th=[11994], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:29:49.486 | 30.00th=[13960], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:29:49.486 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15533], 95.00th=[15926], 00:29:49.486 | 99.00th=[16712], 99.50th=[16909], 99.90th=[23987], 99.95th=[45351], 00:29:49.486 | 99.99th=[51119] 00:29:49.486 bw ( KiB/s): min=25856, max=27648, per=33.18%, avg=26675.20, stdev=509.30, samples=20 00:29:49.486 iops : min= 202, max= 216, avg=208.40, stdev= 3.98, samples=20 00:29:49.486 lat (msec) : 10=0.48%, 20=99.28%, 50=0.19%, 100=0.05% 00:29:49.486 cpu : usr=95.10%, sys=4.40%, ctx=23, majf=0, minf=158 00:29:49.486 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.486 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 issued rwts: total=2086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.486 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.486 filename0: (groupid=0, jobs=1): err= 0: pid=2905037: Tue Nov 19 15:30:45 2024 00:29:49.486 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10045msec) 00:29:49.486 slat (nsec): min=6953, max=36013, avg=15451.45, stdev=3684.96 00:29:49.486 clat (usec): min=9237, max=56584, avg=14581.95, stdev=1558.83 00:29:49.486 lat (usec): min=9249, max=56601, avg=14597.40, stdev=1559.01 00:29:49.486 clat percentiles (usec): 00:29:49.486 | 1.00th=[11863], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:29:49.486 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14484], 60.00th=[14746], 00:29:49.486 | 70.00th=[15008], 80.00th=[15401], 90.00th=[15795], 95.00th=[16188], 00:29:49.486 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19268], 99.95th=[47449], 00:29:49.486 | 99.99th=[56361] 00:29:49.486 bw ( KiB/s): min=25344, max=27648, per=32.78%, avg=26357.70, stdev=608.77, samples=20 00:29:49.486 iops : min= 198, max= 216, avg=205.90, stdev= 4.79, samples=20 00:29:49.486 lat (msec) : 10=0.34%, 20=99.56%, 50=0.05%, 100=0.05% 00:29:49.486 cpu : usr=94.82%, sys=4.68%, ctx=47, majf=0, minf=183 00:29:49.486 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.486 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 issued rwts: total=2061,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.486 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.486 filename0: (groupid=0, jobs=1): err= 0: pid=2905038: Tue Nov 19 15:30:45 2024 00:29:49.486 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(271MiB/10048msec) 00:29:49.486 slat (nsec): min=4288, max=78874, avg=19722.48, stdev=3975.73 00:29:49.486 clat (usec): min=10370, max=55833, avg=13885.85, stdev=2138.66 00:29:49.486 lat (usec): min=10404, max=55851, avg=13905.57, stdev=2138.54 00:29:49.486 clat percentiles (usec): 00:29:49.486 | 1.00th=[11469], 5.00th=[12256], 10.00th=[12518], 20.00th=[13042], 00:29:49.486 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:29:49.486 | 70.00th=[14222], 80.00th=[14484], 90.00th=[14877], 95.00th=[15401], 00:29:49.486 | 99.00th=[16450], 99.50th=[16909], 99.90th=[54264], 99.95th=[54264], 00:29:49.486 | 99.99th=[55837] 00:29:49.486 bw ( KiB/s): min=25600, max=28672, per=34.42%, avg=27673.60, stdev=648.17, samples=20 00:29:49.486 iops : min= 200, max= 224, avg=216.20, stdev= 5.06, samples=20 00:29:49.486 lat (msec) : 20=99.77%, 50=0.05%, 100=0.18% 00:29:49.486 cpu : usr=95.54%, sys=3.93%, ctx=37, majf=0, minf=184 00:29:49.486 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:49.486 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:49.486 issued rwts: total=2164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:49.486 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:49.486 00:29:49.486 Run status group 0 (all jobs): 00:29:49.486 READ: bw=78.5MiB/s (82.3MB/s), 25.6MiB/s-26.9MiB/s (26.9MB/s-28.2MB/s), io=789MiB (827MB), run=10045-10048msec 00:29:49.486 15:30:46 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:49.486 15:30:46 -- target/dif.sh@43 -- # local sub 00:29:49.486 15:30:46 -- target/dif.sh@45 -- # for sub in "$@" 00:29:49.486 15:30:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:49.486 15:30:46 -- target/dif.sh@36 -- # local sub_id=0 00:29:49.486 15:30:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:49.486 15:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.486 15:30:46 -- common/autotest_common.sh@10 -- # set +x 00:29:49.486 15:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.486 15:30:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:49.486 15:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.486 15:30:46 -- common/autotest_common.sh@10 -- # set +x 00:29:49.486 15:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.486 00:29:49.486 real 0m11.145s 00:29:49.486 user 0m29.690s 00:29:49.486 sys 0m1.573s 00:29:49.486 15:30:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.486 15:30:46 -- common/autotest_common.sh@10 -- # set +x 00:29:49.486 ************************************ 00:29:49.486 END TEST fio_dif_digest 00:29:49.486 ************************************ 00:29:49.486 15:30:46 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:49.486 15:30:46 -- target/dif.sh@147 -- # nvmftestfini 00:29:49.486 15:30:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:49.486 15:30:46 -- nvmf/common.sh@116 -- # sync 00:29:49.486 15:30:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:49.486 15:30:46 -- nvmf/common.sh@119 -- # set +e 00:29:49.486 15:30:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:49.486 15:30:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:49.486 rmmod nvme_tcp 00:29:49.486 rmmod nvme_fabrics 00:29:49.486 rmmod nvme_keyring 00:29:49.486 15:30:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:49.486 15:30:46 -- nvmf/common.sh@123 -- # set -e 00:29:49.486 15:30:46 -- nvmf/common.sh@124 -- # return 0 00:29:49.486 15:30:46 -- nvmf/common.sh@477 -- # '[' -n 2898075 ']' 00:29:49.486 15:30:46 -- nvmf/common.sh@478 -- # killprocess 2898075 00:29:49.486 15:30:46 -- common/autotest_common.sh@936 -- # '[' -z 2898075 ']' 00:29:49.486 15:30:46 -- common/autotest_common.sh@940 -- # kill -0 2898075 00:29:49.486 15:30:46 -- common/autotest_common.sh@941 -- # uname 00:29:49.486 15:30:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.486 15:30:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2898075 00:29:49.486 15:30:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:49.486 15:30:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:49.486 15:30:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2898075' 00:29:49.486 killing process with pid 2898075 00:29:49.486 15:30:46 -- common/autotest_common.sh@955 -- # kill 2898075 00:29:49.486 15:30:46 -- common/autotest_common.sh@960 -- # wait 2898075 00:29:49.486 15:30:46 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:49.487 15:30:46 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:49.487 Waiting for block devices as requested 00:29:49.487 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:49.487 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:49.487 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:49.487 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:49.487 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:49.745 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:49.745 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:49.745 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:49.745 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:50.005 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:50.005 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:50.005 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:50.005 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:50.263 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:50.263 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:50.263 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:50.263 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:50.521 15:30:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:50.521 15:30:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:50.521 15:30:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:50.521 15:30:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:50.521 15:30:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:50.521 15:30:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:50.521 15:30:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:52.485 15:30:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:52.485 00:29:52.485 real 1m7.829s 00:29:52.485 user 6m31.346s 00:29:52.485 sys 0m16.925s 00:29:52.485 15:30:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:52.485 15:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:52.485 ************************************ 00:29:52.485 END TEST nvmf_dif 00:29:52.485 ************************************ 00:29:52.485 15:30:50 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:52.485 15:30:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:52.485 15:30:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:52.485 15:30:50 -- common/autotest_common.sh@10 -- # set +x 00:29:52.485 ************************************ 00:29:52.485 START TEST nvmf_abort_qd_sizes 00:29:52.485 ************************************ 00:29:52.485 15:30:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:52.485 * Looking for test storage... 00:29:52.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:52.485 15:30:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:52.485 15:30:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:52.485 15:30:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:52.772 15:30:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:52.772 15:30:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:52.772 15:30:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:52.772 15:30:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:52.772 15:30:51 -- scripts/common.sh@335 -- # IFS=.-: 00:29:52.772 15:30:51 -- scripts/common.sh@335 -- # read -ra ver1 00:29:52.772 15:30:51 -- scripts/common.sh@336 -- # IFS=.-: 00:29:52.772 15:30:51 -- scripts/common.sh@336 -- # read -ra ver2 00:29:52.772 15:30:51 -- scripts/common.sh@337 -- # local 'op=<' 00:29:52.772 15:30:51 -- scripts/common.sh@339 -- # ver1_l=2 00:29:52.772 15:30:51 -- scripts/common.sh@340 -- # ver2_l=1 00:29:52.772 15:30:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:52.772 15:30:51 -- scripts/common.sh@343 -- # case "$op" in 00:29:52.772 15:30:51 -- scripts/common.sh@344 -- # : 1 00:29:52.772 15:30:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:52.772 15:30:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:52.772 15:30:51 -- scripts/common.sh@364 -- # decimal 1 00:29:52.772 15:30:51 -- scripts/common.sh@352 -- # local d=1 00:29:52.772 15:30:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:52.772 15:30:51 -- scripts/common.sh@354 -- # echo 1 00:29:52.772 15:30:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:52.772 15:30:51 -- scripts/common.sh@365 -- # decimal 2 00:29:52.772 15:30:51 -- scripts/common.sh@352 -- # local d=2 00:29:52.772 15:30:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:52.772 15:30:51 -- scripts/common.sh@354 -- # echo 2 00:29:52.772 15:30:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:52.772 15:30:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:52.772 15:30:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:52.772 15:30:51 -- scripts/common.sh@367 -- # return 0 00:29:52.773 15:30:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:52.773 15:30:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:52.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.773 --rc genhtml_branch_coverage=1 00:29:52.773 --rc genhtml_function_coverage=1 00:29:52.773 --rc genhtml_legend=1 00:29:52.773 --rc geninfo_all_blocks=1 00:29:52.773 --rc geninfo_unexecuted_blocks=1 00:29:52.773 00:29:52.773 ' 00:29:52.773 15:30:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:52.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.773 --rc genhtml_branch_coverage=1 00:29:52.773 --rc genhtml_function_coverage=1 00:29:52.773 --rc genhtml_legend=1 00:29:52.773 --rc geninfo_all_blocks=1 00:29:52.773 --rc geninfo_unexecuted_blocks=1 00:29:52.773 00:29:52.773 ' 00:29:52.773 15:30:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:52.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.773 --rc genhtml_branch_coverage=1 00:29:52.773 --rc genhtml_function_coverage=1 00:29:52.773 --rc genhtml_legend=1 00:29:52.773 --rc geninfo_all_blocks=1 00:29:52.773 --rc geninfo_unexecuted_blocks=1 00:29:52.773 00:29:52.773 ' 00:29:52.773 15:30:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:52.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:52.773 --rc genhtml_branch_coverage=1 00:29:52.773 --rc genhtml_function_coverage=1 00:29:52.773 --rc genhtml_legend=1 00:29:52.773 --rc geninfo_all_blocks=1 00:29:52.773 --rc geninfo_unexecuted_blocks=1 00:29:52.773 00:29:52.773 ' 00:29:52.773 15:30:51 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:52.773 15:30:51 -- nvmf/common.sh@7 -- # uname -s 00:29:52.773 15:30:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:52.773 15:30:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:52.773 15:30:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:52.773 15:30:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:52.773 15:30:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:52.773 15:30:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:52.773 15:30:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:52.773 15:30:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:52.773 15:30:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:52.773 15:30:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:52.773 15:30:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:52.773 15:30:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:52.773 15:30:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:52.773 15:30:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:52.773 15:30:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:52.773 15:30:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:52.773 15:30:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:52.773 15:30:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:52.773 15:30:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:52.773 15:30:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.773 15:30:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.773 15:30:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.773 15:30:51 -- paths/export.sh@5 -- # export PATH 00:29:52.773 15:30:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:52.773 15:30:51 -- nvmf/common.sh@46 -- # : 0 00:29:52.773 15:30:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:52.773 15:30:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:52.773 15:30:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:52.773 15:30:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:52.773 15:30:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:52.773 15:30:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:52.773 15:30:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:52.773 15:30:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:52.773 15:30:51 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:52.773 15:30:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:52.773 15:30:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:52.773 15:30:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:52.773 15:30:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:52.773 15:30:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:52.773 15:30:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.773 15:30:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:52.773 15:30:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:52.773 15:30:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:52.773 15:30:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:52.773 15:30:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:52.773 15:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:54.675 15:30:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:54.675 15:30:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:54.675 15:30:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:54.675 15:30:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:54.675 15:30:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:54.675 15:30:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:54.675 15:30:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:54.675 15:30:53 -- nvmf/common.sh@294 -- # net_devs=() 00:29:54.675 15:30:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:54.675 15:30:53 -- nvmf/common.sh@295 -- # e810=() 00:29:54.675 15:30:53 -- nvmf/common.sh@295 -- # local -ga e810 00:29:54.675 15:30:53 -- nvmf/common.sh@296 -- # x722=() 00:29:54.675 15:30:53 -- nvmf/common.sh@296 -- # local -ga x722 00:29:54.675 15:30:53 -- nvmf/common.sh@297 -- # mlx=() 00:29:54.675 15:30:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:54.675 15:30:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:54.675 15:30:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:54.675 15:30:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:54.675 15:30:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:54.675 15:30:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:54.675 15:30:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:54.675 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:54.675 15:30:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:54.675 15:30:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:54.676 15:30:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:54.676 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:54.676 15:30:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:54.676 15:30:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:54.676 15:30:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:54.676 15:30:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:54.676 15:30:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:54.676 15:30:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:54.676 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:54.676 15:30:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:54.676 15:30:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:54.676 15:30:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:54.676 15:30:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:54.676 15:30:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:54.676 15:30:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:54.676 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:54.676 15:30:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:54.676 15:30:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:54.676 15:30:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:54.676 15:30:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:54.676 15:30:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:54.676 15:30:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:54.676 15:30:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:54.676 15:30:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:54.676 15:30:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:54.676 15:30:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:54.676 15:30:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:54.676 15:30:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:54.676 15:30:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:54.676 15:30:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:54.676 15:30:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:54.676 15:30:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:54.676 15:30:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:54.676 15:30:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:54.933 15:30:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:54.933 15:30:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:54.933 15:30:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:54.933 15:30:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:54.933 15:30:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:54.933 15:30:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:54.933 15:30:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:54.933 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:54.933 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:29:54.933 00:29:54.933 --- 10.0.0.2 ping statistics --- 00:29:54.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:54.933 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:29:54.933 15:30:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:54.933 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:54.933 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:29:54.933 00:29:54.933 --- 10.0.0.1 ping statistics --- 00:29:54.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:54.933 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:29:54.933 15:30:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:54.933 15:30:53 -- nvmf/common.sh@410 -- # return 0 00:29:54.933 15:30:53 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:54.933 15:30:53 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:56.309 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:56.309 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:56.309 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:57.248 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:57.248 15:30:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:57.248 15:30:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:57.248 15:30:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:57.248 15:30:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:57.248 15:30:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:57.248 15:30:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:57.248 15:30:55 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:57.248 15:30:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:57.248 15:30:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:57.248 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:29:57.248 15:30:55 -- nvmf/common.sh@469 -- # nvmfpid=2909950 00:29:57.248 15:30:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:57.248 15:30:55 -- nvmf/common.sh@470 -- # waitforlisten 2909950 00:29:57.248 15:30:55 -- common/autotest_common.sh@829 -- # '[' -z 2909950 ']' 00:29:57.248 15:30:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:57.248 15:30:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:57.248 15:30:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:57.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:57.248 15:30:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:57.248 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:29:57.248 [2024-11-19 15:30:55.701127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:57.248 [2024-11-19 15:30:55.701194] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:57.248 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.248 [2024-11-19 15:30:55.765411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:57.508 [2024-11-19 15:30:55.889798] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:57.508 [2024-11-19 15:30:55.889963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:57.508 [2024-11-19 15:30:55.889981] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:57.508 [2024-11-19 15:30:55.889994] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:57.508 [2024-11-19 15:30:55.890050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.508 [2024-11-19 15:30:55.890111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:57.508 [2024-11-19 15:30:55.890163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:57.508 [2024-11-19 15:30:55.890166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:58.443 15:30:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:58.443 15:30:56 -- common/autotest_common.sh@862 -- # return 0 00:29:58.444 15:30:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:58.444 15:30:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:58.444 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:29:58.444 15:30:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:58.444 15:30:56 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:58.444 15:30:56 -- scripts/common.sh@312 -- # local nvmes 00:29:58.444 15:30:56 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:58.444 15:30:56 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:58.444 15:30:56 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:58.444 15:30:56 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:58.444 15:30:56 -- scripts/common.sh@322 -- # uname -s 00:29:58.444 15:30:56 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:58.444 15:30:56 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:58.444 15:30:56 -- scripts/common.sh@327 -- # (( 1 )) 00:29:58.444 15:30:56 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:58.444 15:30:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:58.444 15:30:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:58.444 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:29:58.444 ************************************ 00:29:58.444 START TEST spdk_target_abort 00:29:58.444 ************************************ 00:29:58.444 15:30:56 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:58.444 15:30:56 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:58.444 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.444 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:30:01.729 spdk_targetn1 00:30:01.729 15:30:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:01.729 15:30:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.729 15:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:01.729 [2024-11-19 15:30:59.542855] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:01.729 15:30:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:01.729 15:30:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.729 15:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:01.729 15:30:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:01.729 15:30:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.729 15:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:01.729 15:30:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:01.729 15:30:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.729 15:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:01.729 [2024-11-19 15:30:59.575140] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:01.729 15:30:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:01.729 15:30:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:01.729 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.260 Initializing NVMe Controllers 00:30:04.260 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:04.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:04.260 Initialization complete. Launching workers. 00:30:04.260 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12492, failed: 0 00:30:04.260 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1292, failed to submit 11200 00:30:04.260 success 727, unsuccess 565, failed 0 00:30:04.260 15:31:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:04.260 15:31:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:04.260 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.541 Initializing NVMe Controllers 00:30:07.541 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:07.541 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:07.541 Initialization complete. Launching workers. 00:30:07.541 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8720, failed: 0 00:30:07.541 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1258, failed to submit 7462 00:30:07.541 success 326, unsuccess 932, failed 0 00:30:07.541 15:31:05 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:07.541 15:31:05 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:07.541 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.832 Initializing NVMe Controllers 00:30:10.832 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:10.832 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:10.832 Initialization complete. Launching workers. 00:30:10.832 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31061, failed: 0 00:30:10.832 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2674, failed to submit 28387 00:30:10.832 success 544, unsuccess 2130, failed 0 00:30:10.832 15:31:09 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:10.832 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.832 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:30:10.832 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.832 15:31:09 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:10.833 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.833 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:30:12.210 15:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.210 15:31:10 -- target/abort_qd_sizes.sh@62 -- # killprocess 2909950 00:30:12.210 15:31:10 -- common/autotest_common.sh@936 -- # '[' -z 2909950 ']' 00:30:12.210 15:31:10 -- common/autotest_common.sh@940 -- # kill -0 2909950 00:30:12.210 15:31:10 -- common/autotest_common.sh@941 -- # uname 00:30:12.210 15:31:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.210 15:31:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2909950 00:30:12.210 15:31:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:12.210 15:31:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:12.210 15:31:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2909950' 00:30:12.210 killing process with pid 2909950 00:30:12.210 15:31:10 -- common/autotest_common.sh@955 -- # kill 2909950 00:30:12.210 15:31:10 -- common/autotest_common.sh@960 -- # wait 2909950 00:30:12.469 00:30:12.470 real 0m14.235s 00:30:12.470 user 0m56.418s 00:30:12.470 sys 0m2.514s 00:30:12.470 15:31:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:12.470 15:31:10 -- common/autotest_common.sh@10 -- # set +x 00:30:12.470 ************************************ 00:30:12.470 END TEST spdk_target_abort 00:30:12.470 ************************************ 00:30:12.470 15:31:10 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:12.470 15:31:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:12.470 15:31:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:12.470 15:31:10 -- common/autotest_common.sh@10 -- # set +x 00:30:12.470 ************************************ 00:30:12.470 START TEST kernel_target_abort 00:30:12.470 ************************************ 00:30:12.470 15:31:10 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:12.470 15:31:10 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:12.470 15:31:10 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:12.470 15:31:10 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:12.470 15:31:10 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:12.470 15:31:10 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:12.470 15:31:10 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:12.470 15:31:10 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:12.470 15:31:10 -- nvmf/common.sh@627 -- # local block nvme 00:30:12.470 15:31:10 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:12.470 15:31:10 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:12.470 15:31:10 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:12.470 15:31:10 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:13.847 Waiting for block devices as requested 00:30:13.847 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:13.847 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:13.848 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:14.107 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:14.108 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:14.108 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:14.108 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:14.366 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:14.366 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:14.366 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:14.366 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:14.625 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:14.625 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:14.625 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:14.625 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:14.885 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:14.885 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:14.885 15:31:13 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:14.885 15:31:13 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:14.885 15:31:13 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:14.885 15:31:13 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:14.885 15:31:13 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:15.143 No valid GPT data, bailing 00:30:15.144 15:31:13 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:15.144 15:31:13 -- scripts/common.sh@393 -- # pt= 00:30:15.144 15:31:13 -- scripts/common.sh@394 -- # return 1 00:30:15.144 15:31:13 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:15.144 15:31:13 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:15.144 15:31:13 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:15.144 15:31:13 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:15.144 15:31:13 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:15.144 15:31:13 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:15.144 15:31:13 -- nvmf/common.sh@654 -- # echo 1 00:30:15.144 15:31:13 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:15.144 15:31:13 -- nvmf/common.sh@656 -- # echo 1 00:30:15.144 15:31:13 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:15.144 15:31:13 -- nvmf/common.sh@663 -- # echo tcp 00:30:15.144 15:31:13 -- nvmf/common.sh@664 -- # echo 4420 00:30:15.144 15:31:13 -- nvmf/common.sh@665 -- # echo ipv4 00:30:15.144 15:31:13 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:15.144 15:31:13 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:15.144 00:30:15.144 Discovery Log Number of Records 2, Generation counter 2 00:30:15.144 =====Discovery Log Entry 0====== 00:30:15.144 trtype: tcp 00:30:15.144 adrfam: ipv4 00:30:15.144 subtype: current discovery subsystem 00:30:15.144 treq: not specified, sq flow control disable supported 00:30:15.144 portid: 1 00:30:15.144 trsvcid: 4420 00:30:15.144 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:15.144 traddr: 10.0.0.1 00:30:15.144 eflags: none 00:30:15.144 sectype: none 00:30:15.144 =====Discovery Log Entry 1====== 00:30:15.144 trtype: tcp 00:30:15.144 adrfam: ipv4 00:30:15.144 subtype: nvme subsystem 00:30:15.144 treq: not specified, sq flow control disable supported 00:30:15.144 portid: 1 00:30:15.144 trsvcid: 4420 00:30:15.144 subnqn: kernel_target 00:30:15.144 traddr: 10.0.0.1 00:30:15.144 eflags: none 00:30:15.144 sectype: none 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:15.144 15:31:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:15.144 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.429 Initializing NVMe Controllers 00:30:18.429 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:18.429 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:18.429 Initialization complete. Launching workers. 00:30:18.429 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 43565, failed: 0 00:30:18.429 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 43565, failed to submit 0 00:30:18.429 success 0, unsuccess 43565, failed 0 00:30:18.429 15:31:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:18.429 15:31:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:18.429 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.712 Initializing NVMe Controllers 00:30:21.712 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:21.712 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:21.712 Initialization complete. Launching workers. 00:30:21.712 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79508, failed: 0 00:30:21.712 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20034, failed to submit 59474 00:30:21.712 success 0, unsuccess 20034, failed 0 00:30:21.712 15:31:19 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:21.712 15:31:19 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:21.712 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.001 Initializing NVMe Controllers 00:30:25.001 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:25.001 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:25.001 Initialization complete. Launching workers. 00:30:25.001 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79095, failed: 0 00:30:25.001 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19746, failed to submit 59349 00:30:25.001 success 0, unsuccess 19746, failed 0 00:30:25.001 15:31:22 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:25.001 15:31:22 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:25.001 15:31:22 -- nvmf/common.sh@677 -- # echo 0 00:30:25.001 15:31:22 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:25.001 15:31:22 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:25.001 15:31:22 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:25.001 15:31:22 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:25.001 15:31:22 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:25.001 15:31:22 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:25.001 00:30:25.001 real 0m12.010s 00:30:25.001 user 0m5.676s 00:30:25.001 sys 0m2.437s 00:30:25.001 15:31:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:25.001 15:31:22 -- common/autotest_common.sh@10 -- # set +x 00:30:25.001 ************************************ 00:30:25.001 END TEST kernel_target_abort 00:30:25.001 ************************************ 00:30:25.001 15:31:22 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:25.001 15:31:22 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:25.001 15:31:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:25.001 15:31:22 -- nvmf/common.sh@116 -- # sync 00:30:25.001 15:31:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:25.001 15:31:22 -- nvmf/common.sh@119 -- # set +e 00:30:25.001 15:31:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:25.001 15:31:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:25.001 rmmod nvme_tcp 00:30:25.001 rmmod nvme_fabrics 00:30:25.001 rmmod nvme_keyring 00:30:25.001 15:31:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:25.001 15:31:23 -- nvmf/common.sh@123 -- # set -e 00:30:25.001 15:31:23 -- nvmf/common.sh@124 -- # return 0 00:30:25.001 15:31:23 -- nvmf/common.sh@477 -- # '[' -n 2909950 ']' 00:30:25.001 15:31:23 -- nvmf/common.sh@478 -- # killprocess 2909950 00:30:25.001 15:31:23 -- common/autotest_common.sh@936 -- # '[' -z 2909950 ']' 00:30:25.001 15:31:23 -- common/autotest_common.sh@940 -- # kill -0 2909950 00:30:25.001 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2909950) - No such process 00:30:25.001 15:31:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2909950 is not found' 00:30:25.001 Process with pid 2909950 is not found 00:30:25.001 15:31:23 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:25.001 15:31:23 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:25.937 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:25.937 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:25.937 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:25.937 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:25.937 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:25.937 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:25.937 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:25.937 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:25.937 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:25.937 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:25.937 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:25.937 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:25.937 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:25.937 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:25.937 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:25.937 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:25.937 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:26.196 15:31:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.196 15:31:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.196 15:31:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.196 15:31:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.196 15:31:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.196 15:31:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:26.196 15:31:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.100 15:31:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:28.100 00:30:28.100 real 0m35.669s 00:30:28.100 user 1m4.594s 00:30:28.100 sys 0m8.489s 00:30:28.100 15:31:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.100 15:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:28.100 ************************************ 00:30:28.100 END TEST nvmf_abort_qd_sizes 00:30:28.100 ************************************ 00:30:28.100 15:31:26 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:28.100 15:31:26 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:28.100 15:31:26 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:28.100 15:31:26 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:28.100 15:31:26 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:28.100 15:31:26 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:28.100 15:31:26 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:28.100 15:31:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:28.100 15:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:28.100 15:31:26 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:28.100 15:31:26 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:28.100 15:31:26 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:28.100 15:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:30.002 INFO: APP EXITING 00:30:30.002 INFO: killing all VMs 00:30:30.002 INFO: killing vhost app 00:30:30.002 INFO: EXIT DONE 00:30:31.381 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:31.381 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:31.381 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:31.381 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:31.381 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:31.381 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:31.381 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:31.381 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:31.381 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:31.381 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:31.381 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:31.381 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:31.381 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:31.381 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:31.381 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:31.381 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:31.381 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:32.758 Cleaning 00:30:32.758 Removing: /var/run/dpdk/spdk0/config 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:32.758 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:32.758 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:32.758 Removing: /var/run/dpdk/spdk1/config 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:32.758 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:32.758 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:32.758 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:32.758 Removing: /var/run/dpdk/spdk2/config 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:32.758 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:32.758 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:32.758 Removing: /var/run/dpdk/spdk3/config 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:32.758 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:32.758 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:32.758 Removing: /var/run/dpdk/spdk4/config 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:32.758 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:32.758 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:32.758 Removing: /dev/shm/bdev_svc_trace.1 00:30:32.758 Removing: /dev/shm/nvmf_trace.0 00:30:32.758 Removing: /dev/shm/spdk_tgt_trace.pid2640141 00:30:32.758 Removing: /var/run/dpdk/spdk0 00:30:32.758 Removing: /var/run/dpdk/spdk1 00:30:32.758 Removing: /var/run/dpdk/spdk2 00:30:32.758 Removing: /var/run/dpdk/spdk3 00:30:32.758 Removing: /var/run/dpdk/spdk4 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2638415 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2639302 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2640141 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2640653 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2641985 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2642935 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2643261 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2643594 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2643823 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2644145 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2644306 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2644480 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2644782 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2645244 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2647914 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2648596 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2649004 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2649041 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2649468 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2649608 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650023 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650068 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650364 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650506 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650672 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2650814 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2651196 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2651353 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2651679 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2651855 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652004 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652064 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652207 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652492 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652630 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2652795 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653057 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653219 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653357 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653646 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653788 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2653949 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2654188 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2654377 00:30:32.758 Removing: /var/run/dpdk/spdk_pid2654515 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2654752 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2654944 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2655105 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2655250 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2655533 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2655671 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2655834 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656098 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656254 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656398 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656681 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656826 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2656981 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2657249 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2657410 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2657554 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2657829 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2657981 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2658137 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2658388 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2658566 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2658718 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2658959 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2659143 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2659303 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2659500 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2659727 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2659920 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2660135 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2662361 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2719813 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2722480 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2729622 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2733092 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2735480 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2736013 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2741741 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2742021 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2744703 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2748612 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2750849 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2757556 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2763043 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2764399 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2765080 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2775845 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2778601 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2781559 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2782778 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2784144 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2784399 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2784569 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2784726 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2785448 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2786825 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2787852 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2788306 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2791937 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2795520 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2799159 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2823490 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2826332 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2830303 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2831287 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2832523 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2835269 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2838278 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2842804 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2842810 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2845751 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2845897 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2846031 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2846306 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2846431 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2847536 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2848758 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2849976 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2851196 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2852412 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2853627 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2857528 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2857984 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2859309 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2860067 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2863985 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2866039 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2870279 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2874040 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2877713 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2878129 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2878551 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2879031 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2879688 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2880242 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2880796 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2881319 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2883928 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2884171 00:30:33.018 Removing: /var/run/dpdk/spdk_pid2888042 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2888228 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2890006 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2895170 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2895260 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2898256 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2899696 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2901760 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2902640 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2903967 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2904865 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2910388 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2910788 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2911191 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2912677 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2913085 00:30:33.277 Removing: /var/run/dpdk/spdk_pid2913494 00:30:33.277 Clean 00:30:33.277 killing process with pid 2610733 00:30:41.462 killing process with pid 2610730 00:30:41.462 killing process with pid 2610732 00:30:41.721 killing process with pid 2610731 00:30:41.721 15:31:40 -- common/autotest_common.sh@1446 -- # return 0 00:30:41.721 15:31:40 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:41.721 15:31:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:41.721 15:31:40 -- common/autotest_common.sh@10 -- # set +x 00:30:41.721 15:31:40 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:41.721 15:31:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:41.721 15:31:40 -- common/autotest_common.sh@10 -- # set +x 00:30:41.721 15:31:40 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:41.721 15:31:40 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:41.721 15:31:40 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:41.721 15:31:40 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:41.721 15:31:40 -- spdk/autotest.sh@383 -- # hostname 00:30:41.721 15:31:40 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:41.980 geninfo: WARNING: invalid characters removed from testname! 00:31:08.510 15:32:06 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.790 15:32:10 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.320 15:32:12 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:17.617 15:32:15 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:20.911 15:32:18 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:23.449 15:32:21 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:25.991 15:32:24 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:25.991 15:32:24 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:25.991 15:32:24 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:25.991 15:32:24 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:25.991 15:32:24 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:25.991 15:32:24 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:25.991 15:32:24 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:25.991 15:32:24 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:25.991 15:32:24 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:25.991 15:32:24 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:25.991 15:32:24 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:25.991 15:32:24 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:25.991 15:32:24 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:25.991 15:32:24 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:25.991 15:32:24 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:25.991 15:32:24 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:25.991 15:32:24 -- scripts/common.sh@343 -- $ case "$op" in 00:31:25.991 15:32:24 -- scripts/common.sh@344 -- $ : 1 00:31:25.991 15:32:24 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:25.991 15:32:24 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:25.991 15:32:24 -- scripts/common.sh@364 -- $ decimal 1 00:31:25.991 15:32:24 -- scripts/common.sh@352 -- $ local d=1 00:31:25.991 15:32:24 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:25.991 15:32:24 -- scripts/common.sh@354 -- $ echo 1 00:31:25.991 15:32:24 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:25.991 15:32:24 -- scripts/common.sh@365 -- $ decimal 2 00:31:25.991 15:32:24 -- scripts/common.sh@352 -- $ local d=2 00:31:25.991 15:32:24 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:25.991 15:32:24 -- scripts/common.sh@354 -- $ echo 2 00:31:25.991 15:32:24 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:25.991 15:32:24 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:25.991 15:32:24 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:25.991 15:32:24 -- scripts/common.sh@367 -- $ return 0 00:31:25.991 15:32:24 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:25.991 15:32:24 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:25.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.991 --rc genhtml_branch_coverage=1 00:31:25.991 --rc genhtml_function_coverage=1 00:31:25.991 --rc genhtml_legend=1 00:31:25.991 --rc geninfo_all_blocks=1 00:31:25.991 --rc geninfo_unexecuted_blocks=1 00:31:25.991 00:31:25.991 ' 00:31:25.991 15:32:24 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:25.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.991 --rc genhtml_branch_coverage=1 00:31:25.991 --rc genhtml_function_coverage=1 00:31:25.991 --rc genhtml_legend=1 00:31:25.991 --rc geninfo_all_blocks=1 00:31:25.991 --rc geninfo_unexecuted_blocks=1 00:31:25.991 00:31:25.991 ' 00:31:25.991 15:32:24 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:25.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.991 --rc genhtml_branch_coverage=1 00:31:25.991 --rc genhtml_function_coverage=1 00:31:25.991 --rc genhtml_legend=1 00:31:25.991 --rc geninfo_all_blocks=1 00:31:25.991 --rc geninfo_unexecuted_blocks=1 00:31:25.991 00:31:25.991 ' 00:31:25.991 15:32:24 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:25.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:25.991 --rc genhtml_branch_coverage=1 00:31:25.991 --rc genhtml_function_coverage=1 00:31:25.991 --rc genhtml_legend=1 00:31:25.991 --rc geninfo_all_blocks=1 00:31:25.991 --rc geninfo_unexecuted_blocks=1 00:31:25.991 00:31:25.991 ' 00:31:25.992 15:32:24 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:25.992 15:32:24 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:25.992 15:32:24 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:25.992 15:32:24 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:25.992 15:32:24 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.992 15:32:24 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.992 15:32:24 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.992 15:32:24 -- paths/export.sh@5 -- $ export PATH 00:31:25.992 15:32:24 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:25.992 15:32:24 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:25.992 15:32:24 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:25.992 15:32:24 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732026744.XXXXXX 00:31:25.992 15:32:24 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732026744.5XlbwY 00:31:25.992 15:32:24 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:25.992 15:32:24 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:25.992 15:32:24 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:25.992 15:32:24 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:25.992 15:32:24 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:25.992 15:32:24 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:25.992 15:32:24 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:25.992 15:32:24 -- common/autotest_common.sh@10 -- $ set +x 00:31:25.992 15:32:24 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:25.992 15:32:24 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:25.992 15:32:24 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:25.992 15:32:24 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:25.992 15:32:24 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:25.992 15:32:24 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:25.992 15:32:24 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:25.992 15:32:24 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:25.992 15:32:24 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:25.992 15:32:24 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:25.992 15:32:24 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:25.992 + [[ -n 2567789 ]] 00:31:25.992 + sudo kill 2567789 00:31:26.003 [Pipeline] } 00:31:26.019 [Pipeline] // stage 00:31:26.024 [Pipeline] } 00:31:26.039 [Pipeline] // timeout 00:31:26.044 [Pipeline] } 00:31:26.058 [Pipeline] // catchError 00:31:26.063 [Pipeline] } 00:31:26.074 [Pipeline] // wrap 00:31:26.079 [Pipeline] } 00:31:26.088 [Pipeline] // catchError 00:31:26.095 [Pipeline] stage 00:31:26.097 [Pipeline] { (Epilogue) 00:31:26.109 [Pipeline] catchError 00:31:26.111 [Pipeline] { 00:31:26.123 [Pipeline] echo 00:31:26.124 Cleanup processes 00:31:26.130 [Pipeline] sh 00:31:26.416 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.416 2925479 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.430 [Pipeline] sh 00:31:26.714 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:26.714 ++ grep -v 'sudo pgrep' 00:31:26.714 ++ awk '{print $1}' 00:31:26.714 + sudo kill -9 00:31:26.714 + true 00:31:26.726 [Pipeline] sh 00:31:27.010 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:36.989 [Pipeline] sh 00:31:37.276 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:37.276 Artifacts sizes are good 00:31:37.292 [Pipeline] archiveArtifacts 00:31:37.300 Archiving artifacts 00:31:37.482 [Pipeline] sh 00:31:37.823 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:37.838 [Pipeline] cleanWs 00:31:37.849 [WS-CLEANUP] Deleting project workspace... 00:31:37.849 [WS-CLEANUP] Deferred wipeout is used... 00:31:37.859 [WS-CLEANUP] done 00:31:37.860 [Pipeline] } 00:31:37.878 [Pipeline] // catchError 00:31:37.889 [Pipeline] sh 00:31:38.169 + logger -p user.info -t JENKINS-CI 00:31:38.177 [Pipeline] } 00:31:38.190 [Pipeline] // stage 00:31:38.195 [Pipeline] } 00:31:38.212 [Pipeline] // node 00:31:38.218 [Pipeline] End of Pipeline 00:31:38.256 Finished: SUCCESS